Sep 08 15:12:52.786989 ip-10-0-128-19 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 15:12:53.166322 ip-10-0-128-19 kubenswrapper[2556]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:12:53.166322 ip-10-0-128-19 kubenswrapper[2556]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 15:12:53.166322 ip-10-0-128-19 kubenswrapper[2556]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:12:53.166322 ip-10-0-128-19 kubenswrapper[2556]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 15:12:53.166322 ip-10-0-128-19 kubenswrapper[2556]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:12:53.167301 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.167225    2556 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 15:12:53.173344 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173322    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:53.173344 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173341    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:53.173344 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173345    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:53.173344 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173348    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173351    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173354    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173360    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173363    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173366    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173369    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173372    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173375    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173378    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173381    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173384    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173386    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173389    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173395    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173397    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173400    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173403    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173405    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173408    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:53.173541 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173410    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173413    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173416    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173418    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173421    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173423    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173426    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173428    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173431    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173433    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173436    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173438    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173441    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173444    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173447    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173449    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173452    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173455    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173457    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173460    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:53.174030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173462    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173465    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173468    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173471    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173475    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173479    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173482    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173487    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173489    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173492    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173494    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173497    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173499    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173502    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173506    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173509    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173511    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173514    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173517    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:53.174500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173519    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173523    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173525    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173527    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173530    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173533    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173535    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173538    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173541    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173544    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173547    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173550    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173552    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173555    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173558    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173560    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173563    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173565    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173568    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173570    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:53.174971 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173573    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173576    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173579    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173581    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173584    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173586    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173589    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173591    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173594    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173597    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173599    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173602    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173604    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173607    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173609    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173612    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.173614    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174305    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174313    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:53.175456 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174318    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174321    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174325    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174328    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174331    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174334    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174336    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174339    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174341    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174344    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174347    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174349    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174352    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174355    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174357    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174363    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174365    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174368    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174370    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174373    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:53.175920 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174375    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174378    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174380    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174383    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174386    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174388    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174391    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174395    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174398    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174400    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174403    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174406    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174408    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174412    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174414    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174418    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174422    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174425    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174428    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:53.176453 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174430    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174433    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174436    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174438    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174441    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174443    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174445    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174448    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174450    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174453    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174456    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174458    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174461    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174463    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174466    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174468    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174471    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174474    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174476    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174478    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:53.176936 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174481    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174484    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174486    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174489    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174491    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174494    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174497    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174499    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174502    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174505    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174509    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174512    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174515    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174517    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174520    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174523    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174525    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174528    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174530    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174532    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:53.177427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174535    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174537    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174540    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174543    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174545    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174548    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174551    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174554    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174556    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174559    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174561    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174564    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174566    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174569    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174571    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174574    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174576    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174579    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174961    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:53.177921 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174965    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174968    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174971    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174973    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174977    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174980    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174982    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174985    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174988    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174990    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174995    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.174999    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175002    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175005    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175009    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175014    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175017    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175019    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175022    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:53.178373 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175025    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175027    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175030    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175032    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175035    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175037    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175040    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175042    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175045    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175047    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175050    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175053    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175055    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175058    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175060    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175063    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175065    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175068    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175070    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175073    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:53.178842 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175075    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175077    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175080    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175085    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175087    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175090    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175093    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175095    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175098    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175101    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175103    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175106    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175108    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175110    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175113    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175116    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175118    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175121    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175123    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:53.179335 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175126    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175128    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175131    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175134    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175137    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175140    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175143    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175145    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175148    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175150    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175153    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175155    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175158    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175160    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175163    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175165    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175169    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175172    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175174    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:53.179875 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175177    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175181    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175183    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175186    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175189    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175192    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175195    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175198    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175200    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175203    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175206    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175208    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175211    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175213    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175216    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175218    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175221    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175223    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175225    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175228    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:53.180349 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175230    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175304    2556 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175346    2556 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175353    2556 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175358    2556 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175362    2556 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175365    2556 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175369    2556 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175373    2556 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175380    2556 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175383    2556 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175386    2556 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175389    2556 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175392    2556 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175395    2556 flags.go:64] FLAG: --cgroup-root=""
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175398    2556 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175401    2556 flags.go:64] FLAG: --client-ca-file=""
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175404    2556 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175407    2556 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175411    2556 flags.go:64] FLAG: --cluster-domain=""
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175414    2556 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175417    2556 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175420    2556 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175423    2556 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 15:12:53.180861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175426    2556 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175429    2556 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175431    2556 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175435    2556 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175438    2556 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175440    2556 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175443    2556 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175446    2556 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175449    2556 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175453    2556 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175455    2556 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175458    2556 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175461    2556 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175464    2556 flags.go:64] FLAG: --enable-server="true"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175467    2556 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175472    2556 flags.go:64] FLAG: --event-burst="100"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175475    2556 flags.go:64] FLAG: --event-qps="50"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175479    2556 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175482    2556 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175485    2556 flags.go:64] FLAG: --eviction-hard=""
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175488    2556 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175491    2556 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175494    2556 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175497    2556 flags.go:64] FLAG: --eviction-soft=""
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175499    2556 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 15:12:53.181473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175502    2556 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175507    2556 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175510    2556 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175513    2556 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175516    2556 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175519    2556 flags.go:64] FLAG: --feature-gates=""
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175522    2556 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175525    2556 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175528    2556 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175531    2556 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175534    2556 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175537    2556 flags.go:64] FLAG: --help="false"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175540    2556 flags.go:64] FLAG: --hostname-override="ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175544    2556 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175547    2556 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175549    2556 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175553    2556 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175556    2556 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175559    2556 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175562    2556 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175565    2556 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175568    2556 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175570    2556 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175574    2556 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 15:12:53.182100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175577    2556 flags.go:64] FLAG: --kube-reserved=""
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175580    2556 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175583    2556 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175586    2556 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175589    2556 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175591    2556 flags.go:64] FLAG: --lock-file=""
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175594    2556 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175597    2556 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175600    2556 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175606    2556 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175609    2556 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175612    2556 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175614    2556 flags.go:64] FLAG: --logging-format="text"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175617    2556 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175620    2556 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175623    2556 flags.go:64] FLAG: --manifest-url=""
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175626    2556 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175630    2556 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175633    2556 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175637    2556 flags.go:64] FLAG: --max-pods="110"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175639    2556 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175643    2556 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175645    2556 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175648    2556 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175651    2556 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 15:12:53.182686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175654    2556 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175657    2556 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175663    2556 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175678    2556 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175682    2556 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175685    2556 flags.go:64] FLAG: --pod-cidr=""
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175687    2556 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175694    2556 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175697    2556 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175700    2556 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175703    2556 flags.go:64] FLAG: --port="10250"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175706    2556 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175709    2556 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0d9e4e6686c674a3c"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175712    2556 flags.go:64] FLAG: --qos-reserved=""
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175715    2556 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175718    2556 flags.go:64] FLAG: --register-node="true"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175720    2556 flags.go:64] FLAG: --register-with-taints=""
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175725    2556 flags.go:64] FLAG: --registry-burst="10"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175729    2556 flags.go:64] FLAG: --registry-qps="5"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175732    2556 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175734    2556 flags.go:64] FLAG: --reserved-memory=""
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175739    2556 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175742    2556 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175745    2556 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175747    2556 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 15:12:53.183314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175750    2556 flags.go:64] FLAG: --runonce="false"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175753    2556 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175756    2556 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175759    2556 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175762    2556 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175765    2556 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175768    2556 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175771    2556 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175774    2556 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175776    2556 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175779    2556 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175782    2556 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175785    2556 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175788    2556 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175792    2556 flags.go:64] FLAG: --system-cgroups=""
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175795    2556 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175800    2556 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175802    2556 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175805    2556 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175809    2556 flags.go:64] FLAG: --tls-min-version=""
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175812    2556 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175814    2556 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175817    2556 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175820    2556 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175824    2556 flags.go:64] FLAG: --v="2"
Sep 08 15:12:53.183940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175828    2556 flags.go:64] FLAG: --version="false"
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175832    2556 flags.go:64] FLAG: --vmodule=""
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175836    2556 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.175839    2556 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175946    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175950    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175953    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175957    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175961    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175964    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175967    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175970    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175972    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175975    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175977    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175980    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175983    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175987    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175990    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:53.184562 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175993    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175996    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.175999    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176002    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176005    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176007    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176010    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176012    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176015    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176018    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176020    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176023    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176028    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176030    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176033    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176036    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176047    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176051    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176054    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:53.185077 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176057    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176060    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176062    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176064    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176067    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176069    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176072    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176075    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176077    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176080    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176082    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176085    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176088    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176090    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176093    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176096    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176099    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176102    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176105    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176107    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:53.185529 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176110    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176112    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176115    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176118    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176120    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176124    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176127    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176129    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176132    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176135    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176138    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176140    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176143    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176145    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176149    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176153    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176156    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176159    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176161    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176163    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:53.186121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176166    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176169    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176171    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176174    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176176    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176179    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176181    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176185    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176187    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176190    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176192    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176195    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176198    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176203    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176206    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176210    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176213    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176218    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176220    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176223    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:53.186601 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176231    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176233    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176236    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176239    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.176242    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.176897    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.184146    2556 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.184160    2556 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.184174    2556 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.184179    2556 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184232    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184238    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184241    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184245    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:53.187171 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184249    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184252    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184255    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184258    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184261    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184264    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184267    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184270    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184273    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184275    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184278    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184280    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184283    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184286    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184289    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184291    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184294    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184296    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184299    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184302    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:53.187521 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184304    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184306    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184309    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184311    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184314    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184318    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184321    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184324    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184326    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184329    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184332    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184334    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184337    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184341    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184344    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184347    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184349    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184352    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184355    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184357    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:53.188064 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184360    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184362    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184365    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184368    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184371    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184373    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184376    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184379    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184381    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184384    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184386    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184389    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184391    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184394    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184397    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184399    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184402    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184405    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184408    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:53.188572 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184411    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184413    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184416    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184418    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184421    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184423    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184426    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184428    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184431    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184435    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184438    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184441    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184444    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184446    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184449    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184451    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184454    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184456    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184459    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:53.189135 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184461    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184464    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184467    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184469    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184472    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184474    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184476    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184479    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184481    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184484    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184486    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184489    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184492    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184495    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184498    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184500    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:53.189596 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184503    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.184508    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184615    2556 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184620    2556 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184623    2556 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184626    2556 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184629    2556 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184631    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184634    2556 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184636    2556 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184639    2556 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184641    2556 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184646    2556 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184650    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:12:53.190030 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184653    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184656    2556 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184659    2556 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184662    2556 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184665    2556 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184684    2556 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184688    2556 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184690    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184694    2556 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184696    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184699    2556 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184701    2556 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184704    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184708    2556 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184710    2556 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184713    2556 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184717    2556 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184719    2556 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184722    2556 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184724    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:12:53.190379 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184727    2556 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184729    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184732    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184734    2556 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184737    2556 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184739    2556 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184760    2556 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184763    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184766    2556 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184769    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184772    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184775    2556 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184778    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184781    2556 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184784    2556 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184786    2556 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184789    2556 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184791    2556 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184794    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184796    2556 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:12:53.191022 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184799    2556 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184802    2556 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184804    2556 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184807    2556 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184809    2556 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184812    2556 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184815    2556 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184817    2556 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184820    2556 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184823    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184826    2556 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184828    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184831    2556 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184833    2556 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184836    2556 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184838    2556 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184841    2556 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184843    2556 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184846    2556 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184849    2556 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:12:53.191510 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184851    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184854    2556 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184856    2556 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184858    2556 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184861    2556 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184864    2556 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184867    2556 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184869    2556 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184872    2556 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184874    2556 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184877    2556 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184880    2556 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184882    2556 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184884    2556 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184887    2556 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184889    2556 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184892    2556 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184895    2556 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184897    2556 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184900    2556 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:12:53.192336 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184903    2556 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184906    2556 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184911    2556 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184914    2556 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184917    2556 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184920    2556 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:53.184924    2556 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.184929    2556 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.185025    2556 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.187577    2556 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.188612    2556 server.go:1019] "Starting client certificate rotation"
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.188730    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.188768    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:12:53.192932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.191249    2556 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:12:53.193303 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.192343    2556 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:12:53.208031 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.208011    2556 log.go:25] "Validated CRI v1 runtime API"
Sep 08 15:12:53.211753 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.211737    2556 log.go:25] "Validated CRI v1 image API"
Sep 08 15:12:53.212576 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.212555    2556 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 15:12:53.217509 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.217490    2556 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b6d35ac0-63b0-4d54-98ef-98c8c7db9246:/dev/nvme0n1p4 e2188d31-ffb9-4975-8800-4a69569e5299:/dev/nvme0n1p3]
Sep 08 15:12:53.217587 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.217507    2556 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 15:12:53.222283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.222179    2556 manager.go:216] Machine: {Timestamp:2026-09-08 15:12:53.221026618 +0000 UTC m=+0.321920720 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104399 MemoryCapacity:33164476416 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20d260abf1384b8812fc6703861997 SystemUUID:ec20d260-abf1-384b-8812-fc6703861997 BootID:74b6a2a6-2ab5-416d-8c8b-5f5c2f24684e Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:08:cb:43:37:5f Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:08:cb:43:37:5f Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8a:dd:9d:23:59:81 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164476416 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 15:12:53.222283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.222281    2556 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 15:12:53.222386 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.222375    2556 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 15:12:53.223529 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.223508    2556 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 15:12:53.223660 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.223532    2556 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-19.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 15:12:53.224325 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.224314    2556 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 15:12:53.224357 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.224327    2556 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 15:12:53.224357 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.224335    2556 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:12:53.225202 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.225191    2556 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:12:53.226295 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.226285    2556 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 15:12:53.227828 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.227815    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:12:53.230655 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.230643    2556 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:12:53.230785 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.230775    2556 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 15:12:53.230818 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.230807    2556 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 15:12:53.230845 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.230825    2556 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 15:12:53.230845 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.230839    2556 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 15:12:53.230908 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.230853    2556 kubelet.go:398] "Adding apiserver pod source"
Sep 08 15:12:53.230908 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.230877    2556 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 15:12:53.231199 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.231185    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:12:53.231261 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.231208    2556 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:12:53.233604 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.233587    2556 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 15:12:53.236252 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.236239    2556 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 15:12:53.236302 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.236269    2556 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 15:12:53.237181 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237167    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 15:12:53.237220 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237186    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 15:12:53.237220 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237192    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 15:12:53.237220 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237197    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 15:12:53.237220 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237206    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 15:12:53.237220 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237211    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 15:12:53.237344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237224    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 15:12:53.237344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237229    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 15:12:53.237344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237239    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 15:12:53.237344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237254    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 15:12:53.237344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237267    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 15:12:53.237344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.237272    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 15:12:53.238063 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.238053    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 15:12:53.238063 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.238062    2556 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 15:12:53.241331 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.241312    2556 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-19.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 15:12:53.241910 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.241899    2556 server.go:1268] "Started kubelet"
Sep 08 15:12:53.241967 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.241944    2556 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 15:12:53.242061 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.242037    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 15:12:53.242109 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.242033    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 15:12:53.242253 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.242090    2556 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 15:12:53.242433 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.242419    2556 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 15:12:53.242645 ip-10-0-128-19 systemd[1]: Started Kubernetes Kubelet.
Sep 08 15:12:53.244025 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.244011    2556 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 15:12:53.245481 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.245117    2556 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 15:12:53.247092 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.247074    2556 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 15:12:53.251540 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.251526    2556 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 15:12:53.251606 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.251537    2556 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 15:12:53.251691 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.251658    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:53.252269 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.252252    2556 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 15:12:53.256850 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.256706    2556 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 15:12:53.256925 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.256854    2556 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 15:12:53.257014 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.252057    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-19.ec2.internal.18d36138b8c0083d  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-19.ec2.internal,UID:ip-10-0-128-19.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-19.ec2.internal,},FirstTimestamp:2026-09-08 15:12:53.241874493 +0000 UTC m=+0.342768597,LastTimestamp:2026-09-08 15:12:53.241874493 +0000 UTC m=+0.342768597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-19.ec2.internal,}"
Sep 08 15:12:53.257077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.257057    2556 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 15:12:53.257077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.257066    2556 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 15:12:53.257161 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.257083    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cflpk"
Sep 08 15:12:53.257747 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.257723    2556 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-19.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 15:12:53.257866 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.257741    2556 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 15:12:53.258239 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.258220    2556 factory.go:153] Registering CRI-O factory
Sep 08 15:12:53.258317 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.258246    2556 factory.go:223] Registration of the crio container factory successfully
Sep 08 15:12:53.258364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.258328    2556 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 15:12:53.258364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.258337    2556 factory.go:55] Registering systemd factory
Sep 08 15:12:53.258364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.258346    2556 factory.go:223] Registration of the systemd container factory successfully
Sep 08 15:12:53.258489 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.258367    2556 factory.go:103] Registering Raw factory
Sep 08 15:12:53.258489 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.258383    2556 manager.go:1196] Started watching for new ooms in manager
Sep 08 15:12:53.259504 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.259487    2556 manager.go:349] Starting recovery of all containers
Sep 08 15:12:53.260665 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.260642    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-cflpk"
Sep 08 15:12:53.265507 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.265480    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 15:12:53.271465 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.271449    2556 manager.go:354] Recovery completed
Sep 08 15:12:53.272613 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.272596    2556 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Sep 08 15:12:53.275538 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.275522    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:53.277383 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.277364    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:53.277448 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.277395    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:53.277448 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.277409    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:53.277989 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.277969    2556 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 15:12:53.277989 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.277977    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:53.278085 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.277978    2556 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 15:12:53.278085 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.278050    2556 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:12:53.278688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.278657    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:53.278746 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.278697    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:53.278746 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.278709    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:53.279590 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.279531    2556 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-19.ec2.internal.18d36138baddd1dd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-19.ec2.internal,UID:ip-10-0-128-19.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-19.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-19.ec2.internal,},FirstTimestamp:2026-09-08 15:12:53.277381085 +0000 UTC m=+0.378275186,LastTimestamp:2026-09-08 15:12:53.277381085 +0000 UTC m=+0.378275186,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-19.ec2.internal,}"
Sep 08 15:12:53.279934 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.279920    2556 policy_none.go:49] "None policy: Start"
Sep 08 15:12:53.279997 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.279941    2556 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 15:12:53.279997 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.279955    2556 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 15:12:53.281826 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.281812    2556 policy_none.go:47] "Start"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.329256    2556 manager.go:337] "Starting Device Plugin manager"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.329295    2556 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.329307    2556 server.go:87] "Starting device plugin registration server"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.329541    2556 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.329554    2556 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.329647    2556 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.329749    2556 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.329759    2556 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.330266    2556 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 15:12:53.332104 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.330313    2556 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:53.347704 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.347682    2556 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 15:12:53.347783 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.347726    2556 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 15:12:53.347783 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.347744    2556 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 15:12:53.347862 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.347777    2556 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 15:12:53.350319 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.350301    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:12:53.430642 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.430569    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:53.431551 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.431530    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:53.431633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.431562    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:53.431633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.431583    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:53.431633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.431603    2556 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.440020 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.440002    2556 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.440124 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.440028    2556 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-19.ec2.internal\": node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:53.448150 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.448132    2556 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal"]
Sep 08 15:12:53.448234 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.448198    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:53.448970 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.448947    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:53.449055 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.448985    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:53.449055 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.449000    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:53.451178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451166    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:53.451315 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451302    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.451355 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451331    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:53.451873 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451855    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:53.451950 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451874    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:53.451950 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451879    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:53.451950 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451923    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:53.451950 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451900    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:53.452085 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.451962    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:53.452622 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.452600    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:53.454149 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.454132    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.454231 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.454156    2556 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:12:53.456529 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.456510    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:12:53.456601 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.456545    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:12:53.456601 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.456560    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:12:53.457598 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.457581    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40a7e68b85de9b585f0754ef6a9d318b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"40a7e68b85de9b585f0754ef6a9d318b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.457657 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.457606    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a7e68b85de9b585f0754ef6a9d318b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"40a7e68b85de9b585f0754ef6a9d318b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.457657 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.457621    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad804f188e808aed7f4cdb7919ae721f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-19.ec2.internal\" (UID: \"ad804f188e808aed7f4cdb7919ae721f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.476287 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.476268    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-19.ec2.internal\" not found" node="ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.480615 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.480601    2556 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-19.ec2.internal\" not found" node="ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.553445 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.553415    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:53.558129 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.558111    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40a7e68b85de9b585f0754ef6a9d318b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"40a7e68b85de9b585f0754ef6a9d318b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.558201 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.558136    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a7e68b85de9b585f0754ef6a9d318b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"40a7e68b85de9b585f0754ef6a9d318b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.558201 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.558153    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad804f188e808aed7f4cdb7919ae721f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-19.ec2.internal\" (UID: \"ad804f188e808aed7f4cdb7919ae721f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.558281 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.558217    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/40a7e68b85de9b585f0754ef6a9d318b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"40a7e68b85de9b585f0754ef6a9d318b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.558281 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.558245    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad804f188e808aed7f4cdb7919ae721f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-19.ec2.internal\" (UID: \"ad804f188e808aed7f4cdb7919ae721f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.558281 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.558218    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40a7e68b85de9b585f0754ef6a9d318b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal\" (UID: \"40a7e68b85de9b585f0754ef6a9d318b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.653511 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.653485    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:53.754332 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.754247    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:53.777566 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.777544    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.783287 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:53.783222    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:53.854904 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.854856    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:53.955409 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:53.955389    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:54.055928 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:54.055868    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:54.156423 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:54.156392    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:54.188756 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.188728    2556 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 15:12:54.189254 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.188869    2556 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 15:12:54.256704 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:54.256549    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:54.267684 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.267625    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 15:07:52 +0000 UTC" deadline="2028-04-25 08:26:10.177418377 +0000 UTC"
Sep 08 15:12:54.267684 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.267679    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14273h13m15.909760975s"
Sep 08 15:12:54.340123 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:54.340090    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad804f188e808aed7f4cdb7919ae721f.slice/crio-8146e3d423b7b7b85fec58162a45a3b385b6cd9a6a6dc7c485f8dd323f59291c WatchSource:0}: Error finding container 8146e3d423b7b7b85fec58162a45a3b385b6cd9a6a6dc7c485f8dd323f59291c: Status 404 returned error can't find the container with id 8146e3d423b7b7b85fec58162a45a3b385b6cd9a6a6dc7c485f8dd323f59291c
Sep 08 15:12:54.340500 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:54.340476    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40a7e68b85de9b585f0754ef6a9d318b.slice/crio-d9e5f76ce35b99de1a85143b126cdcac33e72d03abc03e84dfc2d98067e21414 WatchSource:0}: Error finding container d9e5f76ce35b99de1a85143b126cdcac33e72d03abc03e84dfc2d98067e21414: Status 404 returned error can't find the container with id d9e5f76ce35b99de1a85143b126cdcac33e72d03abc03e84dfc2d98067e21414
Sep 08 15:12:54.345458 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.345444    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:12:54.350838 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.350802    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" event={"ID":"ad804f188e808aed7f4cdb7919ae721f","Type":"ContainerStarted","Data":"8146e3d423b7b7b85fec58162a45a3b385b6cd9a6a6dc7c485f8dd323f59291c"}
Sep 08 15:12:54.352058 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.352041    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" event={"ID":"40a7e68b85de9b585f0754ef6a9d318b","Type":"ContainerStarted","Data":"d9e5f76ce35b99de1a85143b126cdcac33e72d03abc03e84dfc2d98067e21414"}
Sep 08 15:12:54.356850 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:54.356835    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:54.457701 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:54.457650    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:54.558006 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:54.557970    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:54.647824 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.647766    2556 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:12:54.658822 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:54.658805    2556 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-19.ec2.internal\" not found"
Sep 08 15:12:54.674172 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.674155    2556 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:12:54.728991 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.728969    2556 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:12:54.752743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.752727    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:54.763655 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.763637    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:12:54.764693 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.764682    2556 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal"
Sep 08 15:12:54.772265 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:54.772240    2556 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:12:55.046340 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.046264    2556 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:12:55.232411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.232388    2556 apiserver.go:52] "Watching apiserver"
Sep 08 15:12:55.238452 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.238427    2556 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 15:12:55.240992 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.240966    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8jb99","kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s","openshift-dns/node-resolver-kvvkc","openshift-image-registry/node-ca-l8bd8","openshift-multus/multus-additional-cni-plugins-swkdn","openshift-network-diagnostics/network-check-target-jkkjc","kube-system/konnectivity-agent-njrjl","openshift-cluster-node-tuning-operator/tuned-kzw5m","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal","openshift-multus/multus-4l4jl","openshift-multus/network-metrics-daemon-mhw82","openshift-network-operator/iptables-alerter-8l7qh","openshift-ovn-kubernetes/ovnkube-node-dvwxt"]
Sep 08 15:12:55.243369 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.243346    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:12:55.243465 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.243423    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:12:55.245344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.245315    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.247169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.247113    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vxps2\""
Sep 08 15:12:55.247288 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.247271    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 15:12:55.247466 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.247365    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 15:12:55.247551 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.247487    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:12:55.247730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.247708    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.249489 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.249469    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 15:12:55.249746 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.249733    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.250210 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.250182    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 15:12:55.250286 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.250205    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-shvbl\""
Sep 08 15:12:55.250286 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.250209    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 15:12:55.251814 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.251771    2556 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 15:12:55.252056 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.252039    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 15:12:55.252254 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.252240    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p9c76\""
Sep 08 15:12:55.252563 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.252324    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 15:12:55.252563 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.252364    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.255043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.254492    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 15:12:55.255043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.254887    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bnh8h\""
Sep 08 15:12:55.255043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.254976    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 15:12:55.255043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.255006    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 15:12:55.256195 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.256177    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.257832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.257813    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 15:12:55.258075 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.258061    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 15:12:55.258215 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.258194    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 15:12:55.258312 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.258198    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.258367 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.258320    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 15:12:55.258441 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.258422    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wwkxw\""
Sep 08 15:12:55.258655 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.258639    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 15:12:55.259911 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.259895    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:12:55.260051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.260033    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 15:12:55.260108 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.260080    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-sg6pd\""
Sep 08 15:12:55.260367 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.260350    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.260439 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.260413    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:12:55.262595 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.262565    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.263809 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.263790    2556 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:12:55.264633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.264617    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-79wnw\""
Sep 08 15:12:55.264739 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.264650    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 15:12:55.264791 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.264740    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:12:55.265074 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.265058    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 15:12:55.265074 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.265065    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 15:12:55.265188 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.265091    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 15:12:55.265380 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.265364    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 15:12:55.265448 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.265365    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 15:12:55.266550 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.266536    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 15:12:55.266926 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.266905    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 15:12:55.267026 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.266937    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jshnn\""
Sep 08 15:12:55.267026 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.266966    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.268272 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268252    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7v9f\" (UniqueName: \"kubernetes.io/projected/65668f60-2edb-466d-9412-4d1ff328fed1-kube-api-access-c7v9f\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.268364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268286    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cni-binary-copy\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.268364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268311    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.268364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268342    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:12:55.268513 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268366    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x54gw\" (UniqueName: \"kubernetes.io/projected/f195a560-8e9e-41d5-881d-1db4d67cdfbd-kube-api-access-x54gw\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.268513 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268389    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.268513 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268412    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7918019-eab8-461e-8168-0b482a89b3a5-hosts-file\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.268513 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268436    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65668f60-2edb-466d-9412-4d1ff328fed1-serviceca\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.268513 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.268513 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268493    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f195a560-8e9e-41d5-881d-1db4d67cdfbd-host-slash\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268522    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-device-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268539    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-sys-fs\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268565    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-system-cni-dir\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268586    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-socket-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268619    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-registration-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268654    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqtqw\" (UniqueName: \"kubernetes.io/projected/4d1276b1-49fe-4704-9088-d7e6d161eb8e-kube-api-access-kqtqw\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268691    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkbgc\" (UniqueName: \"kubernetes.io/projected/c7918019-eab8-461e-8168-0b482a89b3a5-kube-api-access-jkbgc\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268720    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cnibin\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268743    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-m6gm8\""
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268752    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268777    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crtxq\" (UniqueName: \"kubernetes.io/projected/4c41c9e0-74fd-44de-b4b5-ace0a249a777-kube-api-access-crtxq\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268793    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f195a560-8e9e-41d5-881d-1db4d67cdfbd-iptables-alerter-script\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.268805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268809    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7918019-eab8-461e-8168-0b482a89b3a5-tmp-dir\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.269385 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.268822    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65668f60-2edb-466d-9412-4d1ff328fed1-host\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.269385 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.269021    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 15:12:55.269385 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.269143    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:55.269385 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.269206    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:12:55.283538 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.283522    2556 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9j8d"
Sep 08 15:12:55.293449 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.293379    2556 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-n9j8d"
Sep 08 15:12:55.353764 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.353604    2556 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 15:12:55.368989 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.368965    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-run\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.368989 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.368989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-sys\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.369163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369005    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-log-socket\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.369163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369025    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-multus-certs\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.369163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369069    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65668f60-2edb-466d-9412-4d1ff328fed1-host\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.369163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369112    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7v9f\" (UniqueName: \"kubernetes.io/projected/65668f60-2edb-466d-9412-4d1ff328fed1-kube-api-access-c7v9f\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.369163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369124    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/65668f60-2edb-466d-9412-4d1ff328fed1-host\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.369163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369143    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369247    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369275    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-sys-fs\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369293    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-kubernetes\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369313    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-cni-bin\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369335    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-sys-fs\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369356    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysconfig\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-systemd\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.369421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369401    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-tuning-conf-dir\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369457    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovnkube-config\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369488    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-etc-kubernetes\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369510    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369573    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-cni-bin\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369600    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-etc-selinux\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369609    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-cni-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369635    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjthx\" (UniqueName: \"kubernetes.io/projected/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-kube-api-access-qjthx\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369687    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkbgc\" (UniqueName: \"kubernetes.io/projected/c7918019-eab8-461e-8168-0b482a89b3a5-kube-api-access-jkbgc\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369714    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysctl-d\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369737    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369759    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-socket-dir-parent\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369783    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7918019-eab8-461e-8168-0b482a89b3a5-tmp-dir\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.369835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369806    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x54gw\" (UniqueName: \"kubernetes.io/projected/f195a560-8e9e-41d5-881d-1db4d67cdfbd-kube-api-access-x54gw\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369890    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369925    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-var-lib-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369954    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-env-overrides\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369971    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-cni-multus\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369984    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-daemon-config\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.369999    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-etc-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370018    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370027    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c7918019-eab8-461e-8168-0b482a89b3a5-tmp-dir\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370037    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysctl-conf\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc844\" (UniqueName: \"kubernetes.io/projected/019c6fb8-1487-4d6b-935a-d2f476e86b06-kube-api-access-zc844\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370081    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-cnibin\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370029    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370121    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqtqw\" (UniqueName: \"kubernetes.io/projected/4d1276b1-49fe-4704-9088-d7e6d161eb8e-kube-api-access-kqtqw\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370153    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-var-lib-kubelet\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370177    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.370399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370203    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370244    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-netns\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-hostroot\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370303    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cnibin\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370334    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-cni-netd\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370360    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cni-binary-copy\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370365    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cnibin\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370389    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovnkube-script-lib\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370417    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-lib-modules\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370460    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79e91d38-55a8-45a6-abd3-3836ff1c05cc-kubelet-config\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfqkn\" (UniqueName: \"kubernetes.io/projected/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-kube-api-access-bfqkn\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370519    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-kubelet\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370538    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-cni-binary-copy\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370588    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-socket-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370615    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crtxq\" (UniqueName: \"kubernetes.io/projected/4c41c9e0-74fd-44de-b4b5-ace0a249a777-kube-api-access-crtxq\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f195a560-8e9e-41d5-881d-1db4d67cdfbd-iptables-alerter-script\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.371005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370684    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-modprobe-d\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370708    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-slash\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370728    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-systemd\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370749    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370779    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovn-node-metrics-cert\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370790    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-cni-binary-copy\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370818    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8kn2k\" (UniqueName: \"kubernetes.io/projected/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-kube-api-access-8kn2k\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370846    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-device-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370867    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-host\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370893    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-socket-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-tuned\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370929    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-device-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370969    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-systemd-units\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.370991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-run-netns\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371020    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5dd06d06-113d-451c-960e-94953d46245c-agent-certs\") pod \"konnectivity-agent-njrjl\" (UID: \"5dd06d06-113d-451c-960e-94953d46245c\") " pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371052    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5dd06d06-113d-451c-960e-94953d46245c-konnectivity-ca\") pod \"konnectivity-agent-njrjl\" (UID: \"5dd06d06-113d-451c-960e-94953d46245c\") " pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371076    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-system-cni-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.371688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371107    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-ovn\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371150    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-node-log\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371174    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7918019-eab8-461e-8168-0b482a89b3a5-hosts-file\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371203    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65668f60-2edb-466d-9412-4d1ff328fed1-serviceca\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371228    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f195a560-8e9e-41d5-881d-1db4d67cdfbd-host-slash\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371239    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c7918019-eab8-461e-8168-0b482a89b3a5-hosts-file\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371250    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/019c6fb8-1487-4d6b-935a-d2f476e86b06-tmp\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371270    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f195a560-8e9e-41d5-881d-1db4d67cdfbd-iptables-alerter-script\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371281    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f195a560-8e9e-41d5-881d-1db4d67cdfbd-host-slash\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371270    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79e91d38-55a8-45a6-abd3-3836ff1c05cc-dbus\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371312    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-kubelet\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371337    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-system-cni-dir\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371362    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-registration-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371383    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371418    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4c41c9e0-74fd-44de-b4b5-ace0a249a777-system-cni-dir\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371449    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d1276b1-49fe-4704-9088-d7e6d161eb8e-registration-dir\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371473    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-k8s-cni-cncf-io\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.372178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371489    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-conf-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.372696 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371512    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.372696 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371592    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/65668f60-2edb-466d-9412-4d1ff328fed1-serviceca\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.372696 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.371902    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4c41c9e0-74fd-44de-b4b5-ace0a249a777-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.380736 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.380591    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:12:55.380736 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.380613    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:12:55.380736 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.380625    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pbtml for pod openshift-network-diagnostics/network-check-target-jkkjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:12:55.380736 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.380714    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml podName:2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f nodeName:}" failed. No retries permitted until 2026-09-08 15:12:55.880684944 +0000 UTC m=+2.981579058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pbtml" (UniqueName: "kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml") pod "network-check-target-jkkjc" (UID: "2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:12:55.381109 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.381091    2556 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 15:12:55.385162 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.385143    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7v9f\" (UniqueName: \"kubernetes.io/projected/65668f60-2edb-466d-9412-4d1ff328fed1-kube-api-access-c7v9f\") pod \"node-ca-l8bd8\" (UID: \"65668f60-2edb-466d-9412-4d1ff328fed1\") " pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.385283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.385169    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkbgc\" (UniqueName: \"kubernetes.io/projected/c7918019-eab8-461e-8168-0b482a89b3a5-kube-api-access-jkbgc\") pod \"node-resolver-kvvkc\" (UID: \"c7918019-eab8-461e-8168-0b482a89b3a5\") " pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.385415 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.385393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crtxq\" (UniqueName: \"kubernetes.io/projected/4c41c9e0-74fd-44de-b4b5-ace0a249a777-kube-api-access-crtxq\") pod \"multus-additional-cni-plugins-swkdn\" (UID: \"4c41c9e0-74fd-44de-b4b5-ace0a249a777\") " pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.385995 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.385973    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqtqw\" (UniqueName: \"kubernetes.io/projected/4d1276b1-49fe-4704-9088-d7e6d161eb8e-kube-api-access-kqtqw\") pod \"aws-ebs-csi-driver-node-5757s\" (UID: \"4d1276b1-49fe-4704-9088-d7e6d161eb8e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.387338 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.387319    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x54gw\" (UniqueName: \"kubernetes.io/projected/f195a560-8e9e-41d5-881d-1db4d67cdfbd-kube-api-access-x54gw\") pod \"iptables-alerter-8l7qh\" (UID: \"f195a560-8e9e-41d5-881d-1db4d67cdfbd\") " pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.471884 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.471864    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-var-lib-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.471884 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.471887    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-env-overrides\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.471904    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-cni-multus\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.471920    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-daemon-config\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.471940    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-etc-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.471959    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysctl-conf\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.471981    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-cni-multus\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472001    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-var-lib-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472022    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc844\" (UniqueName: \"kubernetes.io/projected/019c6fb8-1487-4d6b-935a-d2f476e86b06-kube-api-access-zc844\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-etc-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472048    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-cnibin\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472070    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-var-lib-kubelet\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472090    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472113    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472136    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-netns\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472144    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-cnibin\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472156    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-hostroot\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472117    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysctl-conf\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472199    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-hostroot\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472217    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-var-lib-kubelet\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472234    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-cni-netd\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.472259    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472254    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-netns\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472313    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472326    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-cni-netd\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472259    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovnkube-script-lib\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.472398    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret podName:79e91d38-55a8-45a6-abd3-3836ff1c05cc nodeName:}" failed. No retries permitted until 2026-09-08 15:12:55.972373734 +0000 UTC m=+3.073267829 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret") pod "global-pull-secret-syncer-8jb99" (UID: "79e91d38-55a8-45a6-abd3-3836ff1c05cc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472416    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-env-overrides\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.472492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472432    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-lib-modules\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472457    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79e91d38-55a8-45a6-abd3-3836ff1c05cc-kubelet-config\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472473    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-daemon-config\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfqkn\" (UniqueName: \"kubernetes.io/projected/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-kube-api-access-bfqkn\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472503    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-kubelet\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472527    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-cni-binary-copy\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472534    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/79e91d38-55a8-45a6-abd3-3836ff1c05cc-kubelet-config\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472551    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-modprobe-d\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472566    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-kubelet\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472572    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-slash\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472602    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-slash\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-systemd\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472578    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-lib-modules\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472641    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472652    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-systemd\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472691    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovn-node-metrics-cert\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472717    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8kn2k\" (UniqueName: \"kubernetes.io/projected/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-kube-api-access-8kn2k\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.473321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472727    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovnkube-script-lib\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472707    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-openvswitch\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472721    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-modprobe-d\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472743    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-host\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472792    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-tuned\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472814    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-systemd-units\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472822    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-host\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472835    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-run-netns\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472857    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5dd06d06-113d-451c-960e-94953d46245c-agent-certs\") pod \"konnectivity-agent-njrjl\" (UID: \"5dd06d06-113d-451c-960e-94953d46245c\") " pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472866    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-systemd-units\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5dd06d06-113d-451c-960e-94953d46245c-konnectivity-ca\") pod \"konnectivity-agent-njrjl\" (UID: \"5dd06d06-113d-451c-960e-94953d46245c\") " pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472896    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-run-netns\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472902    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-system-cni-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472932    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-ovn\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472955    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-node-log\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472976    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/019c6fb8-1487-4d6b-935a-d2f476e86b06-tmp\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472981    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-cni-binary-copy\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472989    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-system-cni-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.474155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.472994    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79e91d38-55a8-45a6-abd3-3836ff1c05cc-dbus\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473029    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-kubelet\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473033    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-run-ovn\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473035    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-node-log\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473055    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473079    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-k8s-cni-cncf-io\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473101    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-conf-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473126    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-run\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473150    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-sys\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473166    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/79e91d38-55a8-45a6-abd3-3836ff1c05cc-dbus\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473170    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-log-socket\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473204    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-multus-certs\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473248    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-kubernetes\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473271    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-cni-bin\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473265    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-kubelet\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473296    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysconfig\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473320    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-systemd\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473342    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovnkube-config\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475029 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.473359    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473364    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-etc-kubernetes\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473385    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-cni-bin\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-cni-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473443    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjthx\" (UniqueName: \"kubernetes.io/projected/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-kube-api-access-qjthx\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.473472    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs podName:7b23ecc3-72b8-44c7-922c-7b6d69cfd347 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:55.973456814 +0000 UTC m=+3.074350905 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs") pod "network-metrics-daemon-mhw82" (UID: "7b23ecc3-72b8-44c7-922c-7b6d69cfd347") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473498    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysctl-d\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473520    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473532    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5dd06d06-113d-451c-960e-94953d46245c-konnectivity-ca\") pod \"konnectivity-agent-njrjl\" (UID: \"5dd06d06-113d-451c-960e-94953d46245c\") " pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473544    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-socket-dir-parent\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473206    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-log-socket\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473639    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-etc-kubernetes\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473692    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-cni-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473698    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-systemd\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473715    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-socket-dir-parent\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473730    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-run-ovn-kubernetes\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473777    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-host-cni-bin\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.475519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473762    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-sys\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473851    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-k8s-cni-cncf-io\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473861    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysctl-d\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473885    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-multus-conf-dir\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473902    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-run-multus-certs\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473922    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-kubernetes\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473943    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-run\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473952    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-host-var-lib-cni-bin\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.473993    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-sysconfig\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.474139    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovnkube-config\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.475057    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/019c6fb8-1487-4d6b-935a-d2f476e86b06-etc-tuned\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.475283    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-ovn-node-metrics-cert\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.475640    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/019c6fb8-1487-4d6b-935a-d2f476e86b06-tmp\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.476236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.475859    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5dd06d06-113d-451c-960e-94953d46245c-agent-certs\") pod \"konnectivity-agent-njrjl\" (UID: \"5dd06d06-113d-451c-960e-94953d46245c\") " pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:12:55.480102 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.480074    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc844\" (UniqueName: \"kubernetes.io/projected/019c6fb8-1487-4d6b-935a-d2f476e86b06-kube-api-access-zc844\") pod \"tuned-kzw5m\" (UID: \"019c6fb8-1487-4d6b-935a-d2f476e86b06\") " pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.480190 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.480175    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfqkn\" (UniqueName: \"kubernetes.io/projected/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-kube-api-access-bfqkn\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:55.480331 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.480316    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8kn2k\" (UniqueName: \"kubernetes.io/projected/b2ab5c7e-8eea-4b5b-967f-1a74a10d8854-kube-api-access-8kn2k\") pod \"ovnkube-node-dvwxt\" (UID: \"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854\") " pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.480645 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.480632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjthx\" (UniqueName: \"kubernetes.io/projected/ef70d42e-8937-46c3-b3f6-39ca76ab3d38-kube-api-access-qjthx\") pod \"multus-4l4jl\" (UID: \"ef70d42e-8937-46c3-b3f6-39ca76ab3d38\") " pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.559365 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.559309    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8l7qh"
Sep 08 15:12:55.565551 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.565530    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s"
Sep 08 15:12:55.574004 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.573985    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-kvvkc"
Sep 08 15:12:55.579567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.579547    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-l8bd8"
Sep 08 15:12:55.587082 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.587068    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-swkdn"
Sep 08 15:12:55.594477 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.594462    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kzw5m"
Sep 08 15:12:55.601712 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.601694    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:12:55.607945 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.607926    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:12:55.614394 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.614378    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4l4jl"
Sep 08 15:12:55.975799 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.975718    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:55.975799 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.975788    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:55.975997 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:55.975836    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:12:55.975997 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.975861    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:12:55.975997 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.975937    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:12:55.975997 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.975949    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:12:55.975997 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.975964    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:12:55.975997 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.975977    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pbtml for pod openshift-network-diagnostics/network-check-target-jkkjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:12:55.976227 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.975935    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret podName:79e91d38-55a8-45a6-abd3-3836ff1c05cc nodeName:}" failed. No retries permitted until 2026-09-08 15:12:56.975914569 +0000 UTC m=+4.076808662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret") pod "global-pull-secret-syncer-8jb99" (UID: "79e91d38-55a8-45a6-abd3-3836ff1c05cc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:12:55.976227 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.976031    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs podName:7b23ecc3-72b8-44c7-922c-7b6d69cfd347 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:56.976014688 +0000 UTC m=+4.076908775 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs") pod "network-metrics-daemon-mhw82" (UID: "7b23ecc3-72b8-44c7-922c-7b6d69cfd347") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:12:55.976227 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:55.976047    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml podName:2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f nodeName:}" failed. No retries permitted until 2026-09-08 15:12:56.976038797 +0000 UTC m=+4.076932883 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-pbtml" (UniqueName: "kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml") pod "network-check-target-jkkjc" (UID: "2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:12:56.119928 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.119898    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c41c9e0_74fd_44de_b4b5_ace0a249a777.slice/crio-b02e5be07d21c3c8da0cb0b53947716bc4d4218b3959c0dc89711d95e8fc9590 WatchSource:0}: Error finding container b02e5be07d21c3c8da0cb0b53947716bc4d4218b3959c0dc89711d95e8fc9590: Status 404 returned error can't find the container with id b02e5be07d21c3c8da0cb0b53947716bc4d4218b3959c0dc89711d95e8fc9590
Sep 08 15:12:56.121566 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.121491    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65668f60_2edb_466d_9412_4d1ff328fed1.slice/crio-1c491699b12530347db1f8da475599bcc39391355f44be3ff544cf9c46426866 WatchSource:0}: Error finding container 1c491699b12530347db1f8da475599bcc39391355f44be3ff544cf9c46426866: Status 404 returned error can't find the container with id 1c491699b12530347db1f8da475599bcc39391355f44be3ff544cf9c46426866
Sep 08 15:12:56.123836 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.123804    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7918019_eab8_461e_8168_0b482a89b3a5.slice/crio-d2d53af18fcdcde6981eec14db752343bc39cd718b8548d5748c8c91067cbbb9 WatchSource:0}: Error finding container d2d53af18fcdcde6981eec14db752343bc39cd718b8548d5748c8c91067cbbb9: Status 404 returned error can't find the container with id d2d53af18fcdcde6981eec14db752343bc39cd718b8548d5748c8c91067cbbb9
Sep 08 15:12:56.125291 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.125276    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef70d42e_8937_46c3_b3f6_39ca76ab3d38.slice/crio-8776bd57968953119cc09703e27ae625154a745e6e51e4a0c0ebaaa4fb34224f WatchSource:0}: Error finding container 8776bd57968953119cc09703e27ae625154a745e6e51e4a0c0ebaaa4fb34224f: Status 404 returned error can't find the container with id 8776bd57968953119cc09703e27ae625154a745e6e51e4a0c0ebaaa4fb34224f
Sep 08 15:12:56.126704 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.126680    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod019c6fb8_1487_4d6b_935a_d2f476e86b06.slice/crio-3523b416549a013972f6ba3b3d1babd216d6e7472c301106159543cf6308909d WatchSource:0}: Error finding container 3523b416549a013972f6ba3b3d1babd216d6e7472c301106159543cf6308909d: Status 404 returned error can't find the container with id 3523b416549a013972f6ba3b3d1babd216d6e7472c301106159543cf6308909d
Sep 08 15:12:56.128437 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.128421    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd06d06_113d_451c_960e_94953d46245c.slice/crio-4a6559b8133dcf4d8bda64467020c60e9c753f8d0b8aaa5da2c5b3e8f6ec5ba6 WatchSource:0}: Error finding container 4a6559b8133dcf4d8bda64467020c60e9c753f8d0b8aaa5da2c5b3e8f6ec5ba6: Status 404 returned error can't find the container with id 4a6559b8133dcf4d8bda64467020c60e9c753f8d0b8aaa5da2c5b3e8f6ec5ba6
Sep 08 15:12:56.129283 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.129240    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d1276b1_49fe_4704_9088_d7e6d161eb8e.slice/crio-699a327eb21bc80e80c4d98def713e159a6f4aeff08b81b851269c0cad427ac0 WatchSource:0}: Error finding container 699a327eb21bc80e80c4d98def713e159a6f4aeff08b81b851269c0cad427ac0: Status 404 returned error can't find the container with id 699a327eb21bc80e80c4d98def713e159a6f4aeff08b81b851269c0cad427ac0
Sep 08 15:12:56.130201 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.130176    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2ab5c7e_8eea_4b5b_967f_1a74a10d8854.slice/crio-b8ac0eace28e6d8453407109e9d5f91c846d17d8afe9e5f4f6fd907ec748e7d5 WatchSource:0}: Error finding container b8ac0eace28e6d8453407109e9d5f91c846d17d8afe9e5f4f6fd907ec748e7d5: Status 404 returned error can't find the container with id b8ac0eace28e6d8453407109e9d5f91c846d17d8afe9e5f4f6fd907ec748e7d5
Sep 08 15:12:56.131904 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:12:56.131888    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf195a560_8e9e_41d5_881d_1db4d67cdfbd.slice/crio-d134445b9ae9614a512e0f9bf568c9403aa2798b0b89d698828cda5cb4bfacf8 WatchSource:0}: Error finding container d134445b9ae9614a512e0f9bf568c9403aa2798b0b89d698828cda5cb4bfacf8: Status 404 returned error can't find the container with id d134445b9ae9614a512e0f9bf568c9403aa2798b0b89d698828cda5cb4bfacf8
Sep 08 15:12:56.296200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.296119    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:07:55 +0000 UTC" deadline="2028-02-13 03:48:38.21957351 +0000 UTC"
Sep 08 15:12:56.296200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.296156    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12540h35m41.923419343s"
Sep 08 15:12:56.348750 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.348720    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:56.348866 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.348845    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:12:56.356894 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.356869    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8l7qh" event={"ID":"f195a560-8e9e-41d5-881d-1db4d67cdfbd","Type":"ContainerStarted","Data":"d134445b9ae9614a512e0f9bf568c9403aa2798b0b89d698828cda5cb4bfacf8"}
Sep 08 15:12:56.357858 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.357836    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s" event={"ID":"4d1276b1-49fe-4704-9088-d7e6d161eb8e","Type":"ContainerStarted","Data":"699a327eb21bc80e80c4d98def713e159a6f4aeff08b81b851269c0cad427ac0"}
Sep 08 15:12:56.358764 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.358742    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-njrjl" event={"ID":"5dd06d06-113d-451c-960e-94953d46245c","Type":"ContainerStarted","Data":"4a6559b8133dcf4d8bda64467020c60e9c753f8d0b8aaa5da2c5b3e8f6ec5ba6"}
Sep 08 15:12:56.359784 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.359763    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kzw5m" event={"ID":"019c6fb8-1487-4d6b-935a-d2f476e86b06","Type":"ContainerStarted","Data":"3523b416549a013972f6ba3b3d1babd216d6e7472c301106159543cf6308909d"}
Sep 08 15:12:56.360836 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.360815    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4l4jl" event={"ID":"ef70d42e-8937-46c3-b3f6-39ca76ab3d38","Type":"ContainerStarted","Data":"8776bd57968953119cc09703e27ae625154a745e6e51e4a0c0ebaaa4fb34224f"}
Sep 08 15:12:56.361766 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.361748    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8bd8" event={"ID":"65668f60-2edb-466d-9412-4d1ff328fed1","Type":"ContainerStarted","Data":"1c491699b12530347db1f8da475599bcc39391355f44be3ff544cf9c46426866"}
Sep 08 15:12:56.363341 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.363320    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" event={"ID":"ad804f188e808aed7f4cdb7919ae721f","Type":"ContainerStarted","Data":"555dcd827cab607baf2d9a63052dc205258983c689e801b8bf258685c7274a5b"}
Sep 08 15:12:56.364364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.364347    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"b8ac0eace28e6d8453407109e9d5f91c846d17d8afe9e5f4f6fd907ec748e7d5"}
Sep 08 15:12:56.365291 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.365274    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kvvkc" event={"ID":"c7918019-eab8-461e-8168-0b482a89b3a5","Type":"ContainerStarted","Data":"d2d53af18fcdcde6981eec14db752343bc39cd718b8548d5748c8c91067cbbb9"}
Sep 08 15:12:56.366129 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.366113    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swkdn" event={"ID":"4c41c9e0-74fd-44de-b4b5-ace0a249a777","Type":"ContainerStarted","Data":"b02e5be07d21c3c8da0cb0b53947716bc4d4218b3959c0dc89711d95e8fc9590"}
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.983894    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.983966    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:56.984000    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.984143    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.984160    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.984171    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pbtml for pod openshift-network-diagnostics/network-check-target-jkkjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.984222    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml podName:2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f nodeName:}" failed. No retries permitted until 2026-09-08 15:12:58.98420605 +0000 UTC m=+6.085100154 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-pbtml" (UniqueName: "kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml") pod "network-check-target-jkkjc" (UID: "2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.984594    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.984641    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret podName:79e91d38-55a8-45a6-abd3-3836ff1c05cc nodeName:}" failed. No retries permitted until 2026-09-08 15:12:58.984628588 +0000 UTC m=+6.085522678 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret") pod "global-pull-secret-syncer-8jb99" (UID: "79e91d38-55a8-45a6-abd3-3836ff1c05cc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.984716    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:12:56.984782 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:56.984747    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs podName:7b23ecc3-72b8-44c7-922c-7b6d69cfd347 nodeName:}" failed. No retries permitted until 2026-09-08 15:12:58.984737364 +0000 UTC m=+6.085631466 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs") pod "network-metrics-daemon-mhw82" (UID: "7b23ecc3-72b8-44c7-922c-7b6d69cfd347") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:12:57.296901 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:57.296803    2556 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:07:55 +0000 UTC" deadline="2028-03-09 07:04:53.633250864 +0000 UTC"
Sep 08 15:12:57.296901 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:57.296846    2556 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13143h51m56.336410283s"
Sep 08 15:12:57.350249 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:57.350218    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:57.350446 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:57.350354    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:12:57.350814 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:57.350791    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:12:57.350920 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:57.350900    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:12:57.377358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:57.376316    2556 generic.go:356] "Generic (PLEG): container finished" podID="40a7e68b85de9b585f0754ef6a9d318b" containerID="cdcba71d0559cf920726d88a75066b648b37356487acc31a2b376a1d15723463" exitCode=0
Sep 08 15:12:57.377358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:57.377163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" event={"ID":"40a7e68b85de9b585f0754ef6a9d318b","Type":"ContainerDied","Data":"cdcba71d0559cf920726d88a75066b648b37356487acc31a2b376a1d15723463"}
Sep 08 15:12:57.393219 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:57.393157    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-19.ec2.internal" podStartSLOduration=3.393137325 podStartE2EDuration="3.393137325s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:56.376149592 +0000 UTC m=+3.477043699" watchObservedRunningTime="2026-09-08 15:12:57.393137325 +0000 UTC m=+4.494031437"
Sep 08 15:12:58.349142 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:58.348879    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:58.349573 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:58.349203    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:12:58.385528 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:58.385050    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" event={"ID":"40a7e68b85de9b585f0754ef6a9d318b","Type":"ContainerStarted","Data":"f620e7a1fd155a0caee8554ce9fa99f50ded491ff95a135a0435cb8727332460"}
Sep 08 15:12:59.003176 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:59.003139    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:12:59.003364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:59.003197    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:12:59.003364 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.003317    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:12:59.003364 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.003350    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:12:59.003518 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.003371    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:12:59.003518 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.003383    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs podName:7b23ecc3-72b8-44c7-922c-7b6d69cfd347 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:03.003364056 +0000 UTC m=+10.104258161 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs") pod "network-metrics-daemon-mhw82" (UID: "7b23ecc3-72b8-44c7-922c-7b6d69cfd347") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:12:59.003518 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.003385    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pbtml for pod openshift-network-diagnostics/network-check-target-jkkjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:12:59.003518 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:59.003414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:59.003518 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.003427    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml podName:2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f nodeName:}" failed. No retries permitted until 2026-09-08 15:13:03.003416646 +0000 UTC m=+10.104310743 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-pbtml" (UniqueName: "kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml") pod "network-check-target-jkkjc" (UID: "2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:12:59.003518 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.003479    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:12:59.003822 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.003526    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret podName:79e91d38-55a8-45a6-abd3-3836ff1c05cc nodeName:}" failed. No retries permitted until 2026-09-08 15:13:03.003511442 +0000 UTC m=+10.104405534 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret") pod "global-pull-secret-syncer-8jb99" (UID: "79e91d38-55a8-45a6-abd3-3836ff1c05cc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:12:59.350989 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:59.350314    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:12:59.350989 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.350435    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:12:59.350989 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:12:59.350808    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:12:59.350989 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:12:59.350893    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:00.348963 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:00.348930    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:00.349132 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:00.349084    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:01.348189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:01.348154    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:01.348627 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:01.348294    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:01.348720 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:01.348645    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:01.348791 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:01.348768    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:02.348931 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:02.348850    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:02.349354 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:02.348978    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:03.039405    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:03.039477    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:03.039513    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.039645    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.039664    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.039693    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pbtml for pod openshift-network-diagnostics/network-check-target-jkkjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.039751    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml podName:2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f nodeName:}" failed. No retries permitted until 2026-09-08 15:13:11.039732209 +0000 UTC m=+18.140626311 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-pbtml" (UniqueName: "kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml") pod "network-check-target-jkkjc" (UID: "2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.040146    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.040197    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret podName:79e91d38-55a8-45a6-abd3-3836ff1c05cc nodeName:}" failed. No retries permitted until 2026-09-08 15:13:11.04018035 +0000 UTC m=+18.141074452 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret") pod "global-pull-secret-syncer-8jb99" (UID: "79e91d38-55a8-45a6-abd3-3836ff1c05cc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.040254    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:03.040323 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.040287    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs podName:7b23ecc3-72b8-44c7-922c-7b6d69cfd347 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:11.040275428 +0000 UTC m=+18.141169530 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs") pod "network-metrics-daemon-mhw82" (UID: "7b23ecc3-72b8-44c7-922c-7b6d69cfd347") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:03.350096 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:03.349385    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:03.350096 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.349501    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:03.350096 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:03.349919    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:03.350096 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:03.350011    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:04.348785 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:04.348752    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:04.348960 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:04.348900    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:05.348787 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:05.348753    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:05.349234 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:05.348802    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:05.349234 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:05.348893    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:05.349234 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:05.349010    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:06.348101 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:06.348063    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:06.348245 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:06.348207    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:07.348204 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:07.348176    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:07.348652 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:07.348295    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:07.348652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:07.348354    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:07.348652 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:07.348462    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:08.348556 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:08.348521    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:08.348946 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:08.348665    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:09.348228 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:09.348195    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:09.348393 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:09.348317    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:09.348393 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:09.348372    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:09.348518 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:09.348489    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:10.348501 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:10.348470    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:10.348974 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:10.348584    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:11.096280 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:11.096250    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:11.096483 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:11.096294    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:11.096483 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:11.096343    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:11.096483 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.096421    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:11.096483 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.096430    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:11.096483 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.096447    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:11.096483 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.096459    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pbtml for pod openshift-network-diagnostics/network-check-target-jkkjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:11.096483 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.096479    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs podName:7b23ecc3-72b8-44c7-922c-7b6d69cfd347 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:27.096460465 +0000 UTC m=+34.197354574 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs") pod "network-metrics-daemon-mhw82" (UID: "7b23ecc3-72b8-44c7-922c-7b6d69cfd347") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:11.096829 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.096495    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml podName:2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f nodeName:}" failed. No retries permitted until 2026-09-08 15:13:27.096485311 +0000 UTC m=+34.197379407 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-pbtml" (UniqueName: "kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml") pod "network-check-target-jkkjc" (UID: "2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:11.096829 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.096545    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:11.096829 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.096572    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret podName:79e91d38-55a8-45a6-abd3-3836ff1c05cc nodeName:}" failed. No retries permitted until 2026-09-08 15:13:27.096562747 +0000 UTC m=+34.197456835 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret") pod "global-pull-secret-syncer-8jb99" (UID: "79e91d38-55a8-45a6-abd3-3836ff1c05cc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:11.348243 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:11.348161    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:11.348390 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.348305    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:11.348390 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:11.348348    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:11.348506 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:11.348434    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:12.348608 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:12.348576    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:12.349092 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:12.348693    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:13.348935 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:13.348906    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:13.349283 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:13.349029    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:13.349283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:13.349069    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:13.349283 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:13.349182    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:14.348536 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.348234    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:14.348701 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:14.348620    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:14.418963 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.418931    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s" event={"ID":"4d1276b1-49fe-4704-9088-d7e6d161eb8e","Type":"ContainerStarted","Data":"47b4642e66a7895ea41b98ce747ba3b32ab9716ab7fe47ebb35799abd3625bb3"}
Sep 08 15:13:14.420407 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.420379    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-njrjl" event={"ID":"5dd06d06-113d-451c-960e-94953d46245c","Type":"ContainerStarted","Data":"8be9c8305ce43e0a797df5e6a24a582bdc4ac4d22a26104002526611a2e96d62"}
Sep 08 15:13:14.422029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.422002    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kzw5m" event={"ID":"019c6fb8-1487-4d6b-935a-d2f476e86b06","Type":"ContainerStarted","Data":"3fe3a1248f4131b1103cd206addaf8ab00c7e3dd4af636e1215c8d5a649c5342"}
Sep 08 15:13:14.423840 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.423815    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4l4jl" event={"ID":"ef70d42e-8937-46c3-b3f6-39ca76ab3d38","Type":"ContainerStarted","Data":"a804c92ead6f6d1bffa51b8c480a139690753cb3aa000c1fee349157dd74d6be"}
Sep 08 15:13:14.425606 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.425551    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-l8bd8" event={"ID":"65668f60-2edb-466d-9412-4d1ff328fed1","Type":"ContainerStarted","Data":"0739dd8d9257f054b00b0e2ed3550830c2eb1a8ad694b08e17a249363d88730e"}
Sep 08 15:13:14.429537 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.429512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"8a29af49aced2c162ad391707e7014407b879f6ad71b7df5e94b073550eac4aa"}
Sep 08 15:13:14.429640 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.429585    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"5fc2f9cf168d99bc6d12b04325ea83e242ca752d341085b460fd9fdb48ad0d35"}
Sep 08 15:13:14.429640 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.429630    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"a8ed91686486dba722604fa80ff517d10c3a1fe735c6a6686c8042efb954ebed"}
Sep 08 15:13:14.429790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.429662    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"a4e41bd90c61e6d677c244fc619f56211f643971170bbc9aa400a81ca2923276"}
Sep 08 15:13:14.429790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.429739    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"d6db4253aea0e8af4632816a931a70d3d14bb6c27129fbecc46192adff734f66"}
Sep 08 15:13:14.429790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.429781    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"a7bc13990c16a8b89f8abdf7d7ceef3d813b983cbe29c52410d8a994439deea6"}
Sep 08 15:13:14.431064 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.431042    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-kvvkc" event={"ID":"c7918019-eab8-461e-8168-0b482a89b3a5","Type":"ContainerStarted","Data":"fd6ffa4fb7ec2b091c566cd5fd8c7d65ddc9f1e04a17dd97629330fba70d2211"}
Sep 08 15:13:14.432709 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.432688    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c41c9e0-74fd-44de-b4b5-ace0a249a777" containerID="7b9e2c489aac5aed386f1dd3d8a601837cdf88ae7eb037eff2ba63ccf6a68385" exitCode=0
Sep 08 15:13:14.432806 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.432721    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swkdn" event={"ID":"4c41c9e0-74fd-44de-b4b5-ace0a249a777","Type":"ContainerDied","Data":"7b9e2c489aac5aed386f1dd3d8a601837cdf88ae7eb037eff2ba63ccf6a68385"}
Sep 08 15:13:14.445371 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.445335    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-19.ec2.internal" podStartSLOduration=20.445323453 podStartE2EDuration="20.445323453s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:12:58.404693663 +0000 UTC m=+5.505587777" watchObservedRunningTime="2026-09-08 15:13:14.445323453 +0000 UTC m=+21.546217563"
Sep 08 15:13:14.446124 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.446090    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-njrjl" podStartSLOduration=4.03671711 podStartE2EDuration="21.44608164s" totalImagesPullingTime="17.40936453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:14.445709128 +0000 UTC m=+21.546603239" watchObservedRunningTime="2026-09-08 15:13:14.44608164 +0000 UTC m=+21.546975791"
Sep 08 15:13:14.502784 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.502737    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4l4jl" podStartSLOduration=3.873046925 podStartE2EDuration="21.502722713s" totalImagesPullingTime="17.629675788s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:14.50265779 +0000 UTC m=+21.603551920" watchObservedRunningTime="2026-09-08 15:13:14.502722713 +0000 UTC m=+21.603616839"
Sep 08 15:13:14.529247 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.529210    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-kvvkc" podStartSLOduration=4.132368973 podStartE2EDuration="21.529197881s" totalImagesPullingTime="17.396828908s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:14.528865394 +0000 UTC m=+21.629759504" watchObservedRunningTime="2026-09-08 15:13:14.529197881 +0000 UTC m=+21.630091991"
Sep 08 15:13:14.544090 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.544039    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-l8bd8" podStartSLOduration=4.176469338 podStartE2EDuration="21.544021118s" totalImagesPullingTime="17.36755178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:14.543721729 +0000 UTC m=+21.644615842" watchObservedRunningTime="2026-09-08 15:13:14.544021118 +0000 UTC m=+21.644915231"
Sep 08 15:13:14.562514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:14.562478    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kzw5m" podStartSLOduration=4.151573311 podStartE2EDuration="21.562465671s" totalImagesPullingTime="17.41089236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:14.562185491 +0000 UTC m=+21.663079602" watchObservedRunningTime="2026-09-08 15:13:14.562465671 +0000 UTC m=+21.663359779"
Sep 08 15:13:15.154481 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.154458    2556 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 15:13:15.341187 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.341055    2556 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T15:13:15.154476731Z","UUID":"4bdfff73-968a-4467-96ed-49d4e325d6f9","Handler":null,"Name":"","Endpoint":""}
Sep 08 15:13:15.342801 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.342780    2556 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 15:13:15.342943 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.342815    2556 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 15:13:15.348727 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.348704    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:15.348865 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:15.348825    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:15.348931 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.348866    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:15.348987 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:15.348969    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:15.435621 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.435590    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8l7qh" event={"ID":"f195a560-8e9e-41d5-881d-1db4d67cdfbd","Type":"ContainerStarted","Data":"c105b272c025a16a4ed981bb447e67c147fccda0a90e4f0741ca4293adb42c21"}
Sep 08 15:13:15.437491 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.437467    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s" event={"ID":"4d1276b1-49fe-4704-9088-d7e6d161eb8e","Type":"ContainerStarted","Data":"6b37984ecbc635ae240abc560b7f548afc0c56519cf29d787f7f5f3006614812"}
Sep 08 15:13:15.450514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.450453    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8l7qh" podStartSLOduration=5.043775962 podStartE2EDuration="22.45044014s" totalImagesPullingTime="17.406664178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:15.450238618 +0000 UTC m=+22.551132730" watchObservedRunningTime="2026-09-08 15:13:15.45044014 +0000 UTC m=+22.551334252"
Sep 08 15:13:15.919363 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.919334    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:13:15.920085 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:15.920063    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:13:16.348582 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:16.348558    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:16.348747 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:16.348723    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:16.443468 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:16.443431    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"94b23d8472c2a6eadbcf550075567b0d4a8b6bb07c7d7a611d4170df64b00a4f"}
Sep 08 15:13:16.443870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:16.443706    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:13:16.444160 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:16.444146    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-njrjl"
Sep 08 15:13:17.348830 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:17.348804    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:17.349073 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:17.348920    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:17.349073 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:17.349009    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:17.349186 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:17.349145    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:17.447617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:17.447579    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s" event={"ID":"4d1276b1-49fe-4704-9088-d7e6d161eb8e","Type":"ContainerStarted","Data":"fae1cbd716d477adc2794ff1518eee863d6ef4adcdd84ff02e6fe81811cc2052"}
Sep 08 15:13:18.348895 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:18.348861    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:18.349074 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:18.348993    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:19.348472 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:19.348286    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:19.348949 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:19.348357    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:19.348949 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:19.348563    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:19.348949 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:19.348648    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:20.347909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.347884    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:20.348055 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:20.347982    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:20.458213 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.458181    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" event={"ID":"b2ab5c7e-8eea-4b5b-967f-1a74a10d8854","Type":"ContainerStarted","Data":"e1b5ae7b1a9a1e9e81a0febfbe95156e25956c3b1cbadad33c93b3568b5bd0dc"}
Sep 08 15:13:20.459074 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.458408    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:13:20.459074 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.458473    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:13:20.460194 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.460171    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c41c9e0-74fd-44de-b4b5-ace0a249a777" containerID="7a44e1adbc79850a1cbbd9b95357c1727e3dbe25e2c6362df70eda58509fccec" exitCode=0
Sep 08 15:13:20.460297 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.460200    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swkdn" event={"ID":"4c41c9e0-74fd-44de-b4b5-ace0a249a777","Type":"ContainerDied","Data":"7a44e1adbc79850a1cbbd9b95357c1727e3dbe25e2c6362df70eda58509fccec"}
Sep 08 15:13:20.473525 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.473498    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:13:20.482653 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.482619    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt" podStartSLOduration=10.040978508 podStartE2EDuration="27.48260593s" totalImagesPullingTime="17.441627422s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:20.481232523 +0000 UTC m=+27.582126635" watchObservedRunningTime="2026-09-08 15:13:20.48260593 +0000 UTC m=+27.583500041"
Sep 08 15:13:20.482848 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:20.482823    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-5757s" podStartSLOduration=7.404974912 podStartE2EDuration="27.482818378s" totalImagesPullingTime="20.077843466s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:17.466853707 +0000 UTC m=+24.567747819" watchObservedRunningTime="2026-09-08 15:13:20.482818378 +0000 UTC m=+27.583712550"
Sep 08 15:13:21.348349 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.348185    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:21.348456 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.348185    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:21.348456 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:21.348433    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:21.348533 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:21.348514    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:21.465172 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.465073    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c41c9e0-74fd-44de-b4b5-ace0a249a777" containerID="dab3a27e6dce2b144db7910bc098a4a4124310c6adccc4203d2dda533a244d7b" exitCode=0
Sep 08 15:13:21.465172 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.465118    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swkdn" event={"ID":"4c41c9e0-74fd-44de-b4b5-ace0a249a777","Type":"ContainerDied","Data":"dab3a27e6dce2b144db7910bc098a4a4124310c6adccc4203d2dda533a244d7b"}
Sep 08 15:13:21.465842 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.465706    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:13:21.476817 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.476742    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8jb99"]
Sep 08 15:13:21.476921 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.476832    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:21.476974 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:21.476932    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:21.480332 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.480181    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mhw82"]
Sep 08 15:13:21.480332 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.480292    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:21.480470 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:21.480400    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:21.480885 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.480861    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jkkjc"]
Sep 08 15:13:21.481015 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.480948    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:21.481080 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:21.481045    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:21.482946 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:21.482926    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:13:23.350627 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:23.350598    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:23.351027 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:23.350695    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:23.351027 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:23.350705    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:23.351027 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:23.350774    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:23.351027 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:23.350793    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:23.351027 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:23.350873    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:24.855597 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:24.855570    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kvvkc_c7918019-eab8-461e-8168-0b482a89b3a5/dns-node-resolver/0.log"
Sep 08 15:13:25.348181 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:25.348024    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:25.348341 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:25.348035    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:25.348341 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:25.348255    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8jb99" podUID="79e91d38-55a8-45a6-abd3-3836ff1c05cc"
Sep 08 15:13:25.348410 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:25.348363    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mhw82" podUID="7b23ecc3-72b8-44c7-922c-7b6d69cfd347"
Sep 08 15:13:25.348410 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:25.348041    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:25.348485 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:25.348469    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jkkjc" podUID="2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f"
Sep 08 15:13:25.478370 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:25.478339    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c41c9e0-74fd-44de-b4b5-ace0a249a777" containerID="68191db713a7aaf227a6e225455e43cc145884c8ff6e81727b30bb72c5f526a1" exitCode=0
Sep 08 15:13:25.478535 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:25.478403    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swkdn" event={"ID":"4c41c9e0-74fd-44de-b4b5-ace0a249a777","Type":"ContainerDied","Data":"68191db713a7aaf227a6e225455e43cc145884c8ff6e81727b30bb72c5f526a1"}
Sep 08 15:13:26.039066 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:26.039040    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8bd8_65668f60-2edb-466d-9412-4d1ff328fed1/node-ca/0.log"
Sep 08 15:13:26.737524 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:26.737497    2556 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-19.ec2.internal" event="NodeReady"
Sep 08 15:13:26.737719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:26.737622    2556 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 15:13:27.117801 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.117769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:27.117801 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.117807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.117835    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:27.117918    2556 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:27.117920    2556 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:27.117944    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:27.117964    2556 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:27.117970    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret podName:79e91d38-55a8-45a6-abd3-3836ff1c05cc nodeName:}" failed. No retries permitted until 2026-09-08 15:13:59.117956461 +0000 UTC m=+66.218850551 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret") pod "global-pull-secret-syncer-8jb99" (UID: "79e91d38-55a8-45a6-abd3-3836ff1c05cc") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:27.117973    2556 projected.go:196] Error preparing data for projected volume kube-api-access-pbtml for pod openshift-network-diagnostics/network-check-target-jkkjc: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:27.117982    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs podName:7b23ecc3-72b8-44c7-922c-7b6d69cfd347 nodeName:}" failed. No retries permitted until 2026-09-08 15:13:59.117976025 +0000 UTC m=+66.218870114 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs") pod "network-metrics-daemon-mhw82" (UID: "7b23ecc3-72b8-44c7-922c-7b6d69cfd347") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:13:27.118214 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:27.118009    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml podName:2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f nodeName:}" failed. No retries permitted until 2026-09-08 15:13:59.117996921 +0000 UTC m=+66.218891015 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-pbtml" (UniqueName: "kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml") pod "network-check-target-jkkjc" (UID: "2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:13:27.348766 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.348733    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:27.348909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.348735    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:27.348947 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.348735    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:27.351261 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.351240    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:13:27.351433 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.351416    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:13:27.352294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.352276    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:13:27.352394 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.352313    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:13:27.352464 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.352449    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dtm8b\""
Sep 08 15:13:27.352509 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:27.352495    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ws5f4\""
Sep 08 15:13:31.497928 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:31.497863    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c41c9e0-74fd-44de-b4b5-ace0a249a777" containerID="aef6d10ba846726283cb7e1eb38878875c621eda2e901029ac28ebe526fc4420" exitCode=0
Sep 08 15:13:31.497928 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:31.497910    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swkdn" event={"ID":"4c41c9e0-74fd-44de-b4b5-ace0a249a777","Type":"ContainerDied","Data":"aef6d10ba846726283cb7e1eb38878875c621eda2e901029ac28ebe526fc4420"}
Sep 08 15:13:32.503210 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:32.503177    2556 generic.go:356] "Generic (PLEG): container finished" podID="4c41c9e0-74fd-44de-b4b5-ace0a249a777" containerID="afc68d8af6aa2e9ea4c34b8422c718822ee9342c3280e7a184fb0b49c4d147da" exitCode=0
Sep 08 15:13:32.503624 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:32.503252    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swkdn" event={"ID":"4c41c9e0-74fd-44de-b4b5-ace0a249a777","Type":"ContainerDied","Data":"afc68d8af6aa2e9ea4c34b8422c718822ee9342c3280e7a184fb0b49c4d147da"}
Sep 08 15:13:33.508845 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:33.508810    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-swkdn" event={"ID":"4c41c9e0-74fd-44de-b4b5-ace0a249a777","Type":"ContainerStarted","Data":"6f1f4d1624a5a484ca203811c7cbce09f8c2c583daf41c0c0191ea843f062621"}
Sep 08 15:13:33.532477 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:33.532426    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-swkdn" podStartSLOduration=8.252075235 podStartE2EDuration="40.532412165s" totalImagesPullingTime="32.28033693s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:33.530888168 +0000 UTC m=+40.631782279" watchObservedRunningTime="2026-09-08 15:13:33.532412165 +0000 UTC m=+40.633306276"
Sep 08 15:13:47.186972 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.186938    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6ff556664d-g64rt"]
Sep 08 15:13:47.188616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.188598    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.191648 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.191625    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 15:13:47.191982 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.191959    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nlfb9\""
Sep 08 15:13:47.192127 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.192042    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 15:13:47.192195 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.192179    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 15:13:47.204451 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.204428    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 15:13:47.229492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.229465    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6ff556664d-g64rt"]
Sep 08 15:13:47.277207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.277175    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-699dx"]
Sep 08 15:13:47.278790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.278775    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-699dx"
Sep 08 15:13:47.281300 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.281281    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 15:13:47.281369 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.281300    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 15:13:47.281572 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.281552    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 15:13:47.281871 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.281854    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9nsl6\""
Sep 08 15:13:47.292269 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.292244    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-699dx"]
Sep 08 15:13:47.299003 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.298974    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ff556664d-g64rt"]
Sep 08 15:13:47.299180 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:47.299159    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[bound-sa-token ca-trust-extracted image-registry-private-configuration installation-pull-secrets kube-api-access-46vrk registry-certificates registry-tls trusted-ca], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-6ff556664d-g64rt" podUID="a7efa371-f0b1-4421-9b24-398a67d5a569"
Sep 08 15:13:47.349622 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.349592    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-certificates\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.349622 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.349630    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-image-registry-private-configuration\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.349929 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.349650    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efa371-f0b1-4421-9b24-398a67d5a569-ca-trust-extracted\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.349929 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.349699    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-tls\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.349929 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.349733    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-trusted-ca\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.349929 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.349758    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-installation-pull-secrets\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.349929 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.349776    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-bound-sa-token\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.349929 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.349791    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46vrk\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-kube-api-access-46vrk\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.366462 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.366424    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ckqmm"]
Sep 08 15:13:47.371863 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.371833    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-85d98c998f-gkzjm"]
Sep 08 15:13:47.371969 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.371947    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.373616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.373599    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"]
Sep 08 15:13:47.373758 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.373743    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-gkzjm"
Sep 08 15:13:47.374782 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.374757    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-j59vx\""
Sep 08 15:13:47.375063 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.375046    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 15:13:47.375164 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.375149    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-mjpvn"]
Sep 08 15:13:47.375164 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.375151    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 15:13:47.375311 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.375215    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.376193 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.376178    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 15:13:47.376600 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.376583    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 15:13:47.377202 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.377182    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"]
Sep 08 15:13:47.377283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.377264    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.378722 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.378700    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-ddd5cf967-9rvsg"]
Sep 08 15:13:47.379189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.379175    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"
Sep 08 15:13:47.380374 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.380356    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"]
Sep 08 15:13:47.380467 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.380453    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.381193 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.381176    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-gz2tb\""
Sep 08 15:13:47.381350 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.381291    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 08 15:13:47.381462 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.381447    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 15:13:47.381527 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.381489    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xgtpp\""
Sep 08 15:13:47.381743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.381726    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 15:13:47.381743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.381733    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-xkcd2\""
Sep 08 15:13:47.381976 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.381961    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.382033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.381978    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 15:13:47.382081 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.382056    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 15:13:47.386589 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.386573    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ckqmm"]
Sep 08 15:13:47.387263 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.387243    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"]
Sep 08 15:13:47.388835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.388817    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 08 15:13:47.389001 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.388980    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 15:13:47.389235 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.389217    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjpvn"]
Sep 08 15:13:47.389347 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.389329    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 15:13:47.389911 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.389894    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 15:13:47.390888 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.390497    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 08 15:13:47.390888 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.390525    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 08 15:13:47.390888 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.390532    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 08 15:13:47.390888 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.390809    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 08 15:13:47.399126 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.399106    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-gkzjm"]
Sep 08 15:13:47.409207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.409186    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"]
Sep 08 15:13:47.410119 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.410099    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ddd5cf967-9rvsg"]
Sep 08 15:13:47.412288 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.412269    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"]
Sep 08 15:13:47.450526 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450505    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61660523-2fc2-4b9f-98fb-3c185e15f7ff-cert\") pod \"ingress-canary-699dx\" (UID: \"61660523-2fc2-4b9f-98fb-3c185e15f7ff\") " pod="openshift-ingress-canary/ingress-canary-699dx"
Sep 08 15:13:47.450603 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-certificates\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.450603 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450559    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcgt7\" (UniqueName: \"kubernetes.io/projected/61660523-2fc2-4b9f-98fb-3c185e15f7ff-kube-api-access-qcgt7\") pod \"ingress-canary-699dx\" (UID: \"61660523-2fc2-4b9f-98fb-3c185e15f7ff\") " pod="openshift-ingress-canary/ingress-canary-699dx"
Sep 08 15:13:47.450730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450620    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-image-registry-private-configuration\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.450730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450664    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efa371-f0b1-4421-9b24-398a67d5a569-ca-trust-extracted\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.450730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450707    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-tls\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.450730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450723    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-trusted-ca\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.450892 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450740    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-installation-pull-secrets\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.450892 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450754    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-bound-sa-token\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.450892 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.450769    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46vrk\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-kube-api-access-46vrk\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.451052 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.451025    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efa371-f0b1-4421-9b24-398a67d5a569-ca-trust-extracted\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.451565 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.451541    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-certificates\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.451660 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.451565    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-trusted-ca\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.454411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.454393    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-installation-pull-secrets\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.454486 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.454421    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-image-registry-private-configuration\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.454658 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.454639    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-tls\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.466823 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.466799    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46vrk\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-kube-api-access-46vrk\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.466900 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.466874    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-bound-sa-token\") pod \"image-registry-6ff556664d-g64rt\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") " pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.540744 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.540714    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.551908 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.551880    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5795edf9-e5cd-4d1e-9dce-9107893194be-installation-pull-secrets\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.551908 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.551908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80a218fb-6eff-43c2-84d2-659b824b97ea-tmp\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.552067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.551928    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n24r5\" (UniqueName: \"kubernetes.io/projected/0effb25a-05a8-4455-b6ee-ca8f59ae2d3d-kube-api-access-n24r5\") pod \"downloads-85d98c998f-gkzjm\" (UID: \"0effb25a-05a8-4455-b6ee-ca8f59ae2d3d\") " pod="openshift-console/downloads-85d98c998f-gkzjm"
Sep 08 15:13:47.552067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.551945    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5mf8\" (UniqueName: \"kubernetes.io/projected/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-kube-api-access-w5mf8\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.552067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.551964    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5795edf9-e5cd-4d1e-9dce-9107893194be-ca-trust-extracted\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.552067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.551991    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fk4jm\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-kube-api-access-fk4jm\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.552067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552027    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4002ba64-5bf7-4421-a4e2-d51238449cc4-crio-socket\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.552067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552056    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-ca\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.552294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552105    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5795edf9-e5cd-4d1e-9dce-9107893194be-image-registry-private-configuration\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.552294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552136    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5795edf9-e5cd-4d1e-9dce-9107893194be-registry-certificates\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.552294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552176    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/80a218fb-6eff-43c2-84d2-659b824b97ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.552294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552196    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4163df94-d80d-416b-8c76-e7d47c0bf11c-tmp-dir\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.552294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552218    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w69lf\" (UniqueName: \"kubernetes.io/projected/4002ba64-5bf7-4421-a4e2-d51238449cc4-kube-api-access-w69lf\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.552294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-hub\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.552294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552267    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8t54\" (UniqueName: \"kubernetes.io/projected/9ac22669-c2e1-425c-97cb-11136233ac09-kube-api-access-j8t54\") pod \"managed-serviceaccount-addon-agent-7d6dc98d94-lhswx\" (UID: \"9ac22669-c2e1-425c-97cb-11136233ac09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"
Sep 08 15:13:47.552294 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552289    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552324    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4002ba64-5bf7-4421-a4e2-d51238449cc4-data-volume\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552382    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552415    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tph9x\" (UniqueName: \"kubernetes.io/projected/80a218fb-6eff-43c2-84d2-659b824b97ea-kube-api-access-tph9x\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552441    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552493    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61660523-2fc2-4b9f-98fb-3c185e15f7ff-cert\") pod \"ingress-canary-699dx\" (UID: \"61660523-2fc2-4b9f-98fb-3c185e15f7ff\") " pod="openshift-ingress-canary/ingress-canary-699dx"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcgt7\" (UniqueName: \"kubernetes.io/projected/61660523-2fc2-4b9f-98fb-3c185e15f7ff-kube-api-access-qcgt7\") pod \"ingress-canary-699dx\" (UID: \"61660523-2fc2-4b9f-98fb-3c185e15f7ff\") " pod="openshift-ingress-canary/ingress-canary-699dx"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552546    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4163df94-d80d-416b-8c76-e7d47c0bf11c-metrics-tls\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552579    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-bound-sa-token\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552606    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-registry-tls\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.552694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552636    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5795edf9-e5cd-4d1e-9dce-9107893194be-trusted-ca\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.553030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552696    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fq765\" (UniqueName: \"kubernetes.io/projected/4163df94-d80d-416b-8c76-e7d47c0bf11c-kube-api-access-fq765\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.553030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552739    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4002ba64-5bf7-4421-a4e2-d51238449cc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.553030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552765    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4163df94-d80d-416b-8c76-e7d47c0bf11c-config-volume\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.553030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552779    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4002ba64-5bf7-4421-a4e2-d51238449cc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.553030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.552802    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ac22669-c2e1-425c-97cb-11136233ac09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6dc98d94-lhswx\" (UID: \"9ac22669-c2e1-425c-97cb-11136233ac09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"
Sep 08 15:13:47.554754 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.554740    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/61660523-2fc2-4b9f-98fb-3c185e15f7ff-cert\") pod \"ingress-canary-699dx\" (UID: \"61660523-2fc2-4b9f-98fb-3c185e15f7ff\") " pod="openshift-ingress-canary/ingress-canary-699dx"
Sep 08 15:13:47.563799 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.563778    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:47.564773 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.564752    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcgt7\" (UniqueName: \"kubernetes.io/projected/61660523-2fc2-4b9f-98fb-3c185e15f7ff-kube-api-access-qcgt7\") pod \"ingress-canary-699dx\" (UID: \"61660523-2fc2-4b9f-98fb-3c185e15f7ff\") " pod="openshift-ingress-canary/ingress-canary-699dx"
Sep 08 15:13:47.587383 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.587363    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-699dx"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653006    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-46vrk\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-kube-api-access-46vrk\") pod \"a7efa371-f0b1-4421-9b24-398a67d5a569\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") "
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653037    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-bound-sa-token\") pod \"a7efa371-f0b1-4421-9b24-398a67d5a569\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") "
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653062    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-trusted-ca\") pod \"a7efa371-f0b1-4421-9b24-398a67d5a569\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") "
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653101    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-tls\") pod \"a7efa371-f0b1-4421-9b24-398a67d5a569\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") "
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653122    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-installation-pull-secrets\") pod \"a7efa371-f0b1-4421-9b24-398a67d5a569\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") "
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653148    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efa371-f0b1-4421-9b24-398a67d5a569-ca-trust-extracted\") pod \"a7efa371-f0b1-4421-9b24-398a67d5a569\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") "
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653167    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-certificates\") pod \"a7efa371-f0b1-4421-9b24-398a67d5a569\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") "
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653182    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-image-registry-private-configuration\") pod \"a7efa371-f0b1-4421-9b24-398a67d5a569\" (UID: \"a7efa371-f0b1-4421-9b24-398a67d5a569\") "
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653237    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4002ba64-5bf7-4421-a4e2-d51238449cc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653258    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4163df94-d80d-416b-8c76-e7d47c0bf11c-config-volume\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4002ba64-5bf7-4421-a4e2-d51238449cc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653290    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ac22669-c2e1-425c-97cb-11136233ac09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6dc98d94-lhswx\" (UID: \"9ac22669-c2e1-425c-97cb-11136233ac09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653306    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5795edf9-e5cd-4d1e-9dce-9107893194be-installation-pull-secrets\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653323    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80a218fb-6eff-43c2-84d2-659b824b97ea-tmp\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653338    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n24r5\" (UniqueName: \"kubernetes.io/projected/0effb25a-05a8-4455-b6ee-ca8f59ae2d3d-kube-api-access-n24r5\") pod \"downloads-85d98c998f-gkzjm\" (UID: \"0effb25a-05a8-4455-b6ee-ca8f59ae2d3d\") " pod="openshift-console/downloads-85d98c998f-gkzjm"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5mf8\" (UniqueName: \"kubernetes.io/projected/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-kube-api-access-w5mf8\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.653909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653378    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5795edf9-e5cd-4d1e-9dce-9107893194be-ca-trust-extracted\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.654778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653393    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fk4jm\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-kube-api-access-fk4jm\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.654778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4002ba64-5bf7-4421-a4e2-d51238449cc4-crio-socket\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.654778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653427    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-ca\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.654778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653455    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5795edf9-e5cd-4d1e-9dce-9107893194be-image-registry-private-configuration\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.654778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653472    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5795edf9-e5cd-4d1e-9dce-9107893194be-registry-certificates\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.654778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.653495    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/80a218fb-6eff-43c2-84d2-659b824b97ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.654778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.654155    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "a7efa371-f0b1-4421-9b24-398a67d5a569" (UID: "a7efa371-f0b1-4421-9b24-398a67d5a569"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:47.655140 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.654772    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "a7efa371-f0b1-4421-9b24-398a67d5a569" (UID: "a7efa371-f0b1-4421-9b24-398a67d5a569"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:13:47.655140 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.655075    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80a218fb-6eff-43c2-84d2-659b824b97ea-tmp\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.655513 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.655482    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4163df94-d80d-416b-8c76-e7d47c0bf11c-config-volume\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.655946 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.655916    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5795edf9-e5cd-4d1e-9dce-9107893194be-ca-trust-extracted\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.657095 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657066    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7efa371-f0b1-4421-9b24-398a67d5a569-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "a7efa371-f0b1-4421-9b24-398a67d5a569" (UID: "a7efa371-f0b1-4421-9b24-398a67d5a569"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657482    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4163df94-d80d-416b-8c76-e7d47c0bf11c-tmp-dir\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657527    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w69lf\" (UniqueName: \"kubernetes.io/projected/4002ba64-5bf7-4421-a4e2-d51238449cc4-kube-api-access-w69lf\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657580    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-hub\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657608    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8t54\" (UniqueName: \"kubernetes.io/projected/9ac22669-c2e1-425c-97cb-11136233ac09-kube-api-access-j8t54\") pod \"managed-serviceaccount-addon-agent-7d6dc98d94-lhswx\" (UID: \"9ac22669-c2e1-425c-97cb-11136233ac09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657640    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657686    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4002ba64-5bf7-4421-a4e2-d51238449cc4-data-volume\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657720    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657748    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tph9x\" (UniqueName: \"kubernetes.io/projected/80a218fb-6eff-43c2-84d2-659b824b97ea-kube-api-access-tph9x\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657779    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657823    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4163df94-d80d-416b-8c76-e7d47c0bf11c-metrics-tls\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657856    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4002ba64-5bf7-4421-a4e2-d51238449cc4-crio-socket\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657865    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-bound-sa-token\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657935    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-registry-tls\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.657967    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5795edf9-e5cd-4d1e-9dce-9107893194be-trusted-ca\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.658016    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fq765\" (UniqueName: \"kubernetes.io/projected/4163df94-d80d-416b-8c76-e7d47c0bf11c-kube-api-access-fq765\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.658158    2556 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-trusted-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:13:47.659641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.658187    2556 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/a7efa371-f0b1-4421-9b24-398a67d5a569-ca-trust-extracted\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:13:47.660652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.658203    2556 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-certificates\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:13:47.660652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.658350    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4163df94-d80d-416b-8c76-e7d47c0bf11c-tmp-dir\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.660652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.659018    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "a7efa371-f0b1-4421-9b24-398a67d5a569" (UID: "a7efa371-f0b1-4421-9b24-398a67d5a569"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:47.660652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.659234    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4002ba64-5bf7-4421-a4e2-d51238449cc4-data-volume\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.660652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.659651    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "a7efa371-f0b1-4421-9b24-398a67d5a569" (UID: "a7efa371-f0b1-4421-9b24-398a67d5a569"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:47.660652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.659889    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5795edf9-e5cd-4d1e-9dce-9107893194be-registry-certificates\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.660652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.660280    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/9ac22669-c2e1-425c-97cb-11136233ac09-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7d6dc98d94-lhswx\" (UID: \"9ac22669-c2e1-425c-97cb-11136233ac09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"
Sep 08 15:13:47.660652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.660307    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5795edf9-e5cd-4d1e-9dce-9107893194be-installation-pull-secrets\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.661070 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.660704    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-ca\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.661736 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.661413    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-additional-service-ca\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.661736 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.661497    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "a7efa371-f0b1-4421-9b24-398a67d5a569" (UID: "a7efa371-f0b1-4421-9b24-398a67d5a569"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:13:47.661736 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.661725    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5795edf9-e5cd-4d1e-9dce-9107893194be-trusted-ca\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.662383 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.662359    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4002ba64-5bf7-4421-a4e2-d51238449cc4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.662872 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.662632    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/80a218fb-6eff-43c2-84d2-659b824b97ea-klusterlet-config\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.662965 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.662767    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-hub\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.663760 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.663721    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4002ba64-5bf7-4421-a4e2-d51238449cc4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.664120 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.664084    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5795edf9-e5cd-4d1e-9dce-9107893194be-image-registry-private-configuration\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.664742 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.664450    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4163df94-d80d-416b-8c76-e7d47c0bf11c-metrics-tls\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.664742 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.664701    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "a7efa371-f0b1-4421-9b24-398a67d5a569" (UID: "a7efa371-f0b1-4421-9b24-398a67d5a569"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:47.664872 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.664771    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-kube-api-access-46vrk" (OuterVolumeSpecName: "kube-api-access-46vrk") pod "a7efa371-f0b1-4421-9b24-398a67d5a569" (UID: "a7efa371-f0b1-4421-9b24-398a67d5a569"). InnerVolumeSpecName "kube-api-access-46vrk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:13:47.664930 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.664892    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.664930 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.664900    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.665272 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.665250    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-registry-tls\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.671070 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.671017    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fk4jm\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-kube-api-access-fk4jm\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.671070 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.671017    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n24r5\" (UniqueName: \"kubernetes.io/projected/0effb25a-05a8-4455-b6ee-ca8f59ae2d3d-kube-api-access-n24r5\") pod \"downloads-85d98c998f-gkzjm\" (UID: \"0effb25a-05a8-4455-b6ee-ca8f59ae2d3d\") " pod="openshift-console/downloads-85d98c998f-gkzjm"
Sep 08 15:13:47.671879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.671835    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5mf8\" (UniqueName: \"kubernetes.io/projected/b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e-kube-api-access-w5mf8\") pod \"cluster-proxy-proxy-agent-846cbb9dd-h84s8\" (UID: \"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.672013 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.671994    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5795edf9-e5cd-4d1e-9dce-9107893194be-bound-sa-token\") pod \"image-registry-ddd5cf967-9rvsg\" (UID: \"5795edf9-e5cd-4d1e-9dce-9107893194be\") " pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.672103 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.672085    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fq765\" (UniqueName: \"kubernetes.io/projected/4163df94-d80d-416b-8c76-e7d47c0bf11c-kube-api-access-fq765\") pod \"dns-default-ckqmm\" (UID: \"4163df94-d80d-416b-8c76-e7d47c0bf11c\") " pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.672988 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.672970    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8t54\" (UniqueName: \"kubernetes.io/projected/9ac22669-c2e1-425c-97cb-11136233ac09-kube-api-access-j8t54\") pod \"managed-serviceaccount-addon-agent-7d6dc98d94-lhswx\" (UID: \"9ac22669-c2e1-425c-97cb-11136233ac09\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"
Sep 08 15:13:47.673091 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.673074    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w69lf\" (UniqueName: \"kubernetes.io/projected/4002ba64-5bf7-4421-a4e2-d51238449cc4-kube-api-access-w69lf\") pod \"insights-runtime-extractor-mjpvn\" (UID: \"4002ba64-5bf7-4421-a4e2-d51238449cc4\") " pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.682009 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.681993    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:47.685889 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.685871    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tph9x\" (UniqueName: \"kubernetes.io/projected/80a218fb-6eff-43c2-84d2-659b824b97ea-kube-api-access-tph9x\") pod \"klusterlet-addon-workmgr-5f7f6b5d95-g5mmq\" (UID: \"80a218fb-6eff-43c2-84d2-659b824b97ea\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.687699 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.687664    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-85d98c998f-gkzjm"
Sep 08 15:13:47.695661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.695642    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:47.702614 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.702585    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-mjpvn"
Sep 08 15:13:47.733035 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.733004    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"
Sep 08 15:13:47.740041 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.739835    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:47.743440 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.742855    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"
Sep 08 15:13:47.759838 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.759089    2556 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-image-registry-private-configuration\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:13:47.759838 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.759115    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-46vrk\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-kube-api-access-46vrk\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:13:47.759838 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.759133    2556 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-bound-sa-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:13:47.759838 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.759149    2556 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/a7efa371-f0b1-4421-9b24-398a67d5a569-registry-tls\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:13:47.759838 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.759164    2556 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/a7efa371-f0b1-4421-9b24-398a67d5a569-installation-pull-secrets\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:13:47.860210 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.860179    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-699dx"]
Sep 08 15:13:47.863121 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:47.863099    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61660523_2fc2_4b9f_98fb_3c185e15f7ff.slice/crio-e37007ba948ed75a18850b14c7816aaf9f037f868f70bc577747770ecb4dc173 WatchSource:0}: Error finding container e37007ba948ed75a18850b14c7816aaf9f037f868f70bc577747770ecb4dc173: Status 404 returned error can't find the container with id e37007ba948ed75a18850b14c7816aaf9f037f868f70bc577747770ecb4dc173
Sep 08 15:13:47.956493 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.956463    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ckqmm"]
Sep 08 15:13:47.958063 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:47.958038    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4163df94_d80d_416b_8c76_e7d47c0bf11c.slice/crio-d8999538b04a15ce2e11a520b363dd3febdcdb1d70f2c907c37d30508ead1fa4 WatchSource:0}: Error finding container d8999538b04a15ce2e11a520b363dd3febdcdb1d70f2c907c37d30508ead1fa4: Status 404 returned error can't find the container with id d8999538b04a15ce2e11a520b363dd3febdcdb1d70f2c907c37d30508ead1fa4
Sep 08 15:13:47.971914 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.971888    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-85d98c998f-gkzjm"]
Sep 08 15:13:47.974907 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:47.974884    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0effb25a_05a8_4455_b6ee_ca8f59ae2d3d.slice/crio-7028fe533667158e22a3cadaf6caf3b93aa021d62c7ce68b76a564ef43139489 WatchSource:0}: Error finding container 7028fe533667158e22a3cadaf6caf3b93aa021d62c7ce68b76a564ef43139489: Status 404 returned error can't find the container with id 7028fe533667158e22a3cadaf6caf3b93aa021d62c7ce68b76a564ef43139489
Sep 08 15:13:47.987172 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.987151    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"]
Sep 08 15:13:47.990264 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:47.990244    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-mjpvn"]
Sep 08 15:13:47.991175 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:47.991156    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80a218fb_6eff_43c2_84d2_659b824b97ea.slice/crio-3df70fc6635084da0a43f60e171ce22c258d76fa4726356f97f5a209789bde7a WatchSource:0}: Error finding container 3df70fc6635084da0a43f60e171ce22c258d76fa4726356f97f5a209789bde7a: Status 404 returned error can't find the container with id 3df70fc6635084da0a43f60e171ce22c258d76fa4726356f97f5a209789bde7a
Sep 08 15:13:47.992637 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:47.992570    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4002ba64_5bf7_4421_a4e2_d51238449cc4.slice/crio-ec70ea5faa9e889dd5162cdf79d458fd8e6fbb72290d8e1effe2e720920fd617 WatchSource:0}: Error finding container ec70ea5faa9e889dd5162cdf79d458fd8e6fbb72290d8e1effe2e720920fd617: Status 404 returned error can't find the container with id ec70ea5faa9e889dd5162cdf79d458fd8e6fbb72290d8e1effe2e720920fd617
Sep 08 15:13:48.022270 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.022248    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx"]
Sep 08 15:13:48.024939 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:48.024917    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9ac22669_c2e1_425c_97cb_11136233ac09.slice/crio-28faa7ce453167b498fa5fa3853bf83bbb4a7f64a7bc246bec51db47dd4165ae WatchSource:0}: Error finding container 28faa7ce453167b498fa5fa3853bf83bbb4a7f64a7bc246bec51db47dd4165ae: Status 404 returned error can't find the container with id 28faa7ce453167b498fa5fa3853bf83bbb4a7f64a7bc246bec51db47dd4165ae
Sep 08 15:13:48.050331 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.050309    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8"]
Sep 08 15:13:48.052924 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.052904    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-ddd5cf967-9rvsg"]
Sep 08 15:13:48.053381 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:48.053352    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb2a99666_fa9a_4f0b_8fa2_f513f47b8e9e.slice/crio-55926cab3e39b54fde9cc3f6b747758d22e87ea68fe6775108d8057828a59d08 WatchSource:0}: Error finding container 55926cab3e39b54fde9cc3f6b747758d22e87ea68fe6775108d8057828a59d08: Status 404 returned error can't find the container with id 55926cab3e39b54fde9cc3f6b747758d22e87ea68fe6775108d8057828a59d08
Sep 08 15:13:48.056279 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:48.056253    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5795edf9_e5cd_4d1e_9dce_9107893194be.slice/crio-e6fe9c31a6db798864e591c00ccc0dff4f2efd08e863f61a6e10731e2fae9466 WatchSource:0}: Error finding container e6fe9c31a6db798864e591c00ccc0dff4f2efd08e863f61a6e10731e2fae9466: Status 404 returned error can't find the container with id e6fe9c31a6db798864e591c00ccc0dff4f2efd08e863f61a6e10731e2fae9466
Sep 08 15:13:48.546107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.546031    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8" event={"ID":"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e","Type":"ContainerStarted","Data":"55926cab3e39b54fde9cc3f6b747758d22e87ea68fe6775108d8057828a59d08"}
Sep 08 15:13:48.548602 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.548459    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjpvn" event={"ID":"4002ba64-5bf7-4421-a4e2-d51238449cc4","Type":"ContainerStarted","Data":"d82e43460587bf922be810b7c0b0e84558b2864edcb3b58086406d407239250c"}
Sep 08 15:13:48.548602 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.548518    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjpvn" event={"ID":"4002ba64-5bf7-4421-a4e2-d51238449cc4","Type":"ContainerStarted","Data":"ec70ea5faa9e889dd5162cdf79d458fd8e6fbb72290d8e1effe2e720920fd617"}
Sep 08 15:13:48.556475 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.552070    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq" event={"ID":"80a218fb-6eff-43c2-84d2-659b824b97ea","Type":"ContainerStarted","Data":"3df70fc6635084da0a43f60e171ce22c258d76fa4726356f97f5a209789bde7a"}
Sep 08 15:13:48.556475 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.554088    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg" event={"ID":"5795edf9-e5cd-4d1e-9dce-9107893194be","Type":"ContainerStarted","Data":"97a6b346ebd5045df559ea3171be56dc44b7d9f1b856fe671c13b6f76204a503"}
Sep 08 15:13:48.556475 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.554131    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg" event={"ID":"5795edf9-e5cd-4d1e-9dce-9107893194be","Type":"ContainerStarted","Data":"e6fe9c31a6db798864e591c00ccc0dff4f2efd08e863f61a6e10731e2fae9466"}
Sep 08 15:13:48.556475 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.554834    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:13:48.556808 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.556503    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckqmm" event={"ID":"4163df94-d80d-416b-8c76-e7d47c0bf11c","Type":"ContainerStarted","Data":"d8999538b04a15ce2e11a520b363dd3febdcdb1d70f2c907c37d30508ead1fa4"}
Sep 08 15:13:48.558165 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.558139    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx" event={"ID":"9ac22669-c2e1-425c-97cb-11136233ac09","Type":"ContainerStarted","Data":"28faa7ce453167b498fa5fa3853bf83bbb4a7f64a7bc246bec51db47dd4165ae"}
Sep 08 15:13:48.560523 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.560432    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-699dx" event={"ID":"61660523-2fc2-4b9f-98fb-3c185e15f7ff","Type":"ContainerStarted","Data":"e37007ba948ed75a18850b14c7816aaf9f037f868f70bc577747770ecb4dc173"}
Sep 08 15:13:48.568792 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.564761    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6ff556664d-g64rt"
Sep 08 15:13:48.568792 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.565722    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-gkzjm" event={"ID":"0effb25a-05a8-4455-b6ee-ca8f59ae2d3d","Type":"ContainerStarted","Data":"7028fe533667158e22a3cadaf6caf3b93aa021d62c7ce68b76a564ef43139489"}
Sep 08 15:13:48.576588 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.576542    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg" podStartSLOduration=1.5765260909999999 podStartE2EDuration="1.576526091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:48.575974593 +0000 UTC m=+55.676868705" watchObservedRunningTime="2026-09-08 15:13:48.576526091 +0000 UTC m=+55.677420203"
Sep 08 15:13:48.604422 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.604386    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6ff556664d-g64rt"]
Sep 08 15:13:48.610583 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:48.610559    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6ff556664d-g64rt"]
Sep 08 15:13:49.358061 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:49.358031    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7efa371-f0b1-4421-9b24-398a67d5a569" path="/var/lib/kubelet/pods/a7efa371-f0b1-4421-9b24-398a67d5a569/volumes"
Sep 08 15:13:49.598242 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:49.598094    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjpvn" event={"ID":"4002ba64-5bf7-4421-a4e2-d51238449cc4","Type":"ContainerStarted","Data":"cfa45527fcd3760f03fb28b13216a57bcae7948f89754d40748fba8c67752d17"}
Sep 08 15:13:53.482245 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:53.481846    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dvwxt"
Sep 08 15:13:58.628269 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.628226    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8" event={"ID":"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e","Type":"ContainerStarted","Data":"8f3ddbebd39a16e4cd16017732209f070724392db8817788def127dd356787a4"}
Sep 08 15:13:58.628726 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.628282    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8" event={"ID":"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e","Type":"ContainerStarted","Data":"cbe7688490d81febc5b8c794d69589deece036e8b1adfb88f9af26e0b00568e0"}
Sep 08 15:13:58.628726 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.628300    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8" event={"ID":"b2a99666-fa9a-4f0b-8fa2-f513f47b8e9e","Type":"ContainerStarted","Data":"97ee871923cd8fc976e0176002a20e95f64a0c5b659e11045525a0593dc048b7"}
Sep 08 15:13:58.630645 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.630591    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-mjpvn" event={"ID":"4002ba64-5bf7-4421-a4e2-d51238449cc4","Type":"ContainerStarted","Data":"a434a67b0b7ef63936ab0719004a87d0103ff077c6f902961c6de8330ea39ded"}
Sep 08 15:13:58.632240 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.632213    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq" event={"ID":"80a218fb-6eff-43c2-84d2-659b824b97ea","Type":"ContainerStarted","Data":"9f1a61f6457944d8b99492ea08e0defb946ff7f9d14a88d07d1aa4171e6a66ab"}
Sep 08 15:13:58.632373 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.632351    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:58.634127 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.634094    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq"
Sep 08 15:13:58.634417 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.634389    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckqmm" event={"ID":"4163df94-d80d-416b-8c76-e7d47c0bf11c","Type":"ContainerStarted","Data":"5f81ac159a0f1e507efc403f4713261aac2e5ad161056633320c5da3d45e2f8f"}
Sep 08 15:13:58.634534 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.634444    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:13:58.634534 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.634469    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ckqmm" event={"ID":"4163df94-d80d-416b-8c76-e7d47c0bf11c","Type":"ContainerStarted","Data":"4b631a7f67e7296b818ee85135575e3e80a57f3087071df701b43c8b8f7697f6"}
Sep 08 15:13:58.635962 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.635939    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx" event={"ID":"9ac22669-c2e1-425c-97cb-11136233ac09","Type":"ContainerStarted","Data":"b17dc05568d659169783ca7104e07efbdc73fe70b50db1d278fe0042cf8b22da"}
Sep 08 15:13:58.637523 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.637503    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-699dx" event={"ID":"61660523-2fc2-4b9f-98fb-3c185e15f7ff","Type":"ContainerStarted","Data":"dd0e18fab63f41cc93fc9ff2b2e97d2774dc589baa75cf9a8b971ebd66adeabd"}
Sep 08 15:13:58.652274 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.652216    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-846cbb9dd-h84s8" podStartSLOduration=1.7378016029999999 podStartE2EDuration="11.652199121s" totalImagesPullingTime="9.914397518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:58.649714119 +0000 UTC m=+65.750608231" watchObservedRunningTime="2026-09-08 15:13:58.652199121 +0000 UTC m=+65.753093234"
Sep 08 15:13:58.673925 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.673882    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7d6dc98d94-lhswx" podStartSLOduration=1.748453384 podStartE2EDuration="11.673865792s" totalImagesPullingTime="9.925412408s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:58.673176852 +0000 UTC m=+65.774070965" watchObservedRunningTime="2026-09-08 15:13:58.673865792 +0000 UTC m=+65.774759894"
Sep 08 15:13:58.691603 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.691410    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5f7f6b5d95-g5mmq" podStartSLOduration=1.7242930269999999 podStartE2EDuration="11.691394641s" totalImagesPullingTime="9.967101614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:58.691076281 +0000 UTC m=+65.791970392" watchObservedRunningTime="2026-09-08 15:13:58.691394641 +0000 UTC m=+65.792288755"
Sep 08 15:13:58.711213 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.711172    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-mjpvn" podStartSLOduration=1.9777090560000001 podStartE2EDuration="11.711159465s" totalImagesPullingTime="9.733450409s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:13:47 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:58.710653169 +0000 UTC m=+65.811547280" watchObservedRunningTime="2026-09-08 15:13:58.711159465 +0000 UTC m=+65.812053587"
Sep 08 15:13:58.725619 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.725575    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-699dx" podStartSLOduration=1.645414112 podStartE2EDuration="11.725562962s" totalImagesPullingTime="10.08014885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:58.724473854 +0000 UTC m=+65.825367965" watchObservedRunningTime="2026-09-08 15:13:58.725562962 +0000 UTC m=+65.826457073"
Sep 08 15:13:58.740835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:58.740785    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ckqmm" podStartSLOduration=1.759956643 podStartE2EDuration="11.740770434s" totalImagesPullingTime="9.980813791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:13:58.739876629 +0000 UTC m=+65.840770750" watchObservedRunningTime="2026-09-08 15:13:58.740770434 +0000 UTC m=+65.841664546"
Sep 08 15:13:59.167932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.167892    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:59.168097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.167945    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:59.168097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.167986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:59.170266 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.170238    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:13:59.170403 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.170303    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:13:59.171008 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.170981    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:13:59.181043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.181022    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:13:59.181141 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.181097    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/79e91d38-55a8-45a6-abd3-3836ff1c05cc-original-pull-secret\") pod \"global-pull-secret-syncer-8jb99\" (UID: \"79e91d38-55a8-45a6-abd3-3836ff1c05cc\") " pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:59.181141 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.181113    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7b23ecc3-72b8-44c7-922c-7b6d69cfd347-metrics-certs\") pod \"network-metrics-daemon-mhw82\" (UID: \"7b23ecc3-72b8-44c7-922c-7b6d69cfd347\") " pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:59.192098 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.192074    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pbtml\" (UniqueName: \"kubernetes.io/projected/2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f-kube-api-access-pbtml\") pod \"network-check-target-jkkjc\" (UID: \"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f\") " pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:59.458745 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.458662    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8jb99"
Sep 08 15:13:59.465957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.465935    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ws5f4\""
Sep 08 15:13:59.470251 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.470225    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dtm8b\""
Sep 08 15:13:59.474305 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.474281    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mhw82"
Sep 08 15:13:59.478064 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.478038    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:13:59.733763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.733691    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ccdp6"]
Sep 08 15:13:59.738075 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.738056    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.740510 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.740487    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 15:13:59.740637 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.740557    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 15:13:59.740709 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.740659    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 15:13:59.741438 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.741386    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 15:13:59.741684 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.741456    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 15:13:59.741684 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.741388    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 15:13:59.741684 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.741388    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9k4qk\""
Sep 08 15:13:59.749305 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.749282    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8jb99"]
Sep 08 15:13:59.753558 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:59.753533    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79e91d38_55a8_45a6_abd3_3836ff1c05cc.slice/crio-29e70bf97842a2acaa112d12068644c7713ab964dc3c06b6faddef27408394c7 WatchSource:0}: Error finding container 29e70bf97842a2acaa112d12068644c7713ab964dc3c06b6faddef27408394c7: Status 404 returned error can't find the container with id 29e70bf97842a2acaa112d12068644c7713ab964dc3c06b6faddef27408394c7
Sep 08 15:13:59.777947 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.777915    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-wtmp\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.778059 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.777969    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-sys\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.778059 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.778006    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-accelerators-collector-config\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.778059 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.778033    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cvkvx\" (UniqueName: \"kubernetes.io/projected/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-kube-api-access-cvkvx\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.778185 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.778125    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-tls\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.778225 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.778180    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-root\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.778225 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.778204    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-textfile\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.778299 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.778246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-metrics-client-ca\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.778299 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.778280    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.782304 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.782162    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mhw82"]
Sep 08 15:13:59.783362 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.783344    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jkkjc"]
Sep 08 15:13:59.785055 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:59.785032    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bbef4b3_4bf7_4f52_b0b3_cf5e58b6bd2f.slice/crio-ad71cda04361c9cf1c023be09ba3b6a5a32955250b20965c2c597f00a3cadab7 WatchSource:0}: Error finding container ad71cda04361c9cf1c023be09ba3b6a5a32955250b20965c2c597f00a3cadab7: Status 404 returned error can't find the container with id ad71cda04361c9cf1c023be09ba3b6a5a32955250b20965c2c597f00a3cadab7
Sep 08 15:13:59.785744 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:13:59.785723    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b23ecc3_72b8_44c7_922c_7b6d69cfd347.slice/crio-9e827c7614f030c32121904f83b1db3d0f1118d2c321986b73bbc0eb6f066628 WatchSource:0}: Error finding container 9e827c7614f030c32121904f83b1db3d0f1118d2c321986b73bbc0eb6f066628: Status 404 returned error can't find the container with id 9e827c7614f030c32121904f83b1db3d0f1118d2c321986b73bbc0eb6f066628
Sep 08 15:13:59.878904 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.878880    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-root\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879044 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.878914    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-textfile\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879044 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.878954    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-metrics-client-ca\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879044 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.878982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879044 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879012    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-root\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879044 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879017    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-wtmp\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879291 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879086    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-sys\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879291 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879119    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-accelerators-collector-config\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879291 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879145    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cvkvx\" (UniqueName: \"kubernetes.io/projected/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-kube-api-access-cvkvx\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879291 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879199    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-tls\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879291 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879277    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-textfile\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879647 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:59.879282    2556 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 08 15:13:59.879647 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879307    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-sys\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879647 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:13:59.879358    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-tls podName:7d47f4a6-115c-4f46-a5a3-b05db3f11eec nodeName:}" failed. No retries permitted until 2026-09-08 15:14:00.379337811 +0000 UTC m=+67.480231907 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-tls") pod "node-exporter-ccdp6" (UID: "7d47f4a6-115c-4f46-a5a3-b05db3f11eec") : secret "node-exporter-tls" not found
Sep 08 15:13:59.879647 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879553    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-metrics-client-ca\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879647 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879622    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-wtmp\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.879917 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.879897    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-accelerators-collector-config\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.881491 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.881470    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:13:59.894238 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:13:59.894217    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cvkvx\" (UniqueName: \"kubernetes.io/projected/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-kube-api-access-cvkvx\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:14:00.383030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:00.382989    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-tls\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:14:00.385483 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:00.385452    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d47f4a6-115c-4f46-a5a3-b05db3f11eec-node-exporter-tls\") pod \"node-exporter-ccdp6\" (UID: \"7d47f4a6-115c-4f46-a5a3-b05db3f11eec\") " pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:14:00.648078 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:00.647994    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ccdp6"
Sep 08 15:14:00.648379 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:00.648347    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8jb99" event={"ID":"79e91d38-55a8-45a6-abd3-3836ff1c05cc","Type":"ContainerStarted","Data":"29e70bf97842a2acaa112d12068644c7713ab964dc3c06b6faddef27408394c7"}
Sep 08 15:14:00.649711 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:00.649657    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jkkjc" event={"ID":"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f","Type":"ContainerStarted","Data":"ad71cda04361c9cf1c023be09ba3b6a5a32955250b20965c2c597f00a3cadab7"}
Sep 08 15:14:00.651086 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:00.651053    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mhw82" event={"ID":"7b23ecc3-72b8-44c7-922c-7b6d69cfd347","Type":"ContainerStarted","Data":"9e827c7614f030c32121904f83b1db3d0f1118d2c321986b73bbc0eb6f066628"}
Sep 08 15:14:06.902257 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:14:06.902229    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d47f4a6_115c_4f46_a5a3_b05db3f11eec.slice/crio-7787bcb491a679e2b97b862a3069d91fca2bc1219b46410434a00a8aa2ed3937 WatchSource:0}: Error finding container 7787bcb491a679e2b97b862a3069d91fca2bc1219b46410434a00a8aa2ed3937: Status 404 returned error can't find the container with id 7787bcb491a679e2b97b862a3069d91fca2bc1219b46410434a00a8aa2ed3937
Sep 08 15:14:07.683222 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:07.682279    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-85d98c998f-gkzjm" event={"ID":"0effb25a-05a8-4455-b6ee-ca8f59ae2d3d","Type":"ContainerStarted","Data":"df24be4378d1507e2e53036fa4e3d8331ca9358d2ceea0a4c629297b2f881a57"}
Sep 08 15:14:07.683222 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:07.683029    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-85d98c998f-gkzjm"
Sep 08 15:14:07.686273 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:07.686204    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ccdp6" event={"ID":"7d47f4a6-115c-4f46-a5a3-b05db3f11eec","Type":"ContainerStarted","Data":"7787bcb491a679e2b97b862a3069d91fca2bc1219b46410434a00a8aa2ed3937"}
Sep 08 15:14:07.698482 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:07.698454    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-85d98c998f-gkzjm"
Sep 08 15:14:07.703084 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:07.703000    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-85d98c998f-gkzjm" podStartSLOduration=1.484856264 podStartE2EDuration="20.702984102s" totalImagesPullingTime="19.218127838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:13:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:07.701274512 +0000 UTC m=+74.802168647" watchObservedRunningTime="2026-09-08 15:14:07.702984102 +0000 UTC m=+74.803878214"
Sep 08 15:14:07.749467 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:07.749159    2556 patch_prober.go:28] interesting pod/image-registry-ddd5cf967-9rvsg container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 08 15:14:07.749467 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:07.749216    2556 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg" podUID="5795edf9-e5cd-4d1e-9dce-9107893194be" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:14:08.644349 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:08.644309    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ckqmm"
Sep 08 15:14:09.705464 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:09.704984    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mhw82" event={"ID":"7b23ecc3-72b8-44c7-922c-7b6d69cfd347","Type":"ContainerStarted","Data":"a2749269df15cb72b5049f1218d2567b86285b54b477ec530536145e656f9f39"}
Sep 08 15:14:09.705464 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:09.705051    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mhw82" event={"ID":"7b23ecc3-72b8-44c7-922c-7b6d69cfd347","Type":"ContainerStarted","Data":"8b2b8f6222ea18ac988d6c6151eb108f387975c96aef033cdd826e6abb918934"}
Sep 08 15:14:09.724615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:09.724009    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mhw82" podStartSLOduration=67.95023147 podStartE2EDuration="1m16.723989252s" totalImagesPullingTime="8.773757782s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:09.72273954 +0000 UTC m=+76.823633651" watchObservedRunningTime="2026-09-08 15:14:09.723989252 +0000 UTC m=+76.824883365"
Sep 08 15:14:10.609435 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:10.609400    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-ddd5cf967-9rvsg"
Sep 08 15:14:14.726472 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:14.726429    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8jb99" event={"ID":"79e91d38-55a8-45a6-abd3-3836ff1c05cc","Type":"ContainerStarted","Data":"c1e51911943ddd02127423b28a6ffe694c162911cd7808106ac1027185e729f6"}
Sep 08 15:14:14.728462 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:14.728427    2556 generic.go:356] "Generic (PLEG): container finished" podID="7d47f4a6-115c-4f46-a5a3-b05db3f11eec" containerID="1ef31b899d4b7c35292cbcca4251d08b41dc9c6659e2642c72580c415cc41ace" exitCode=0
Sep 08 15:14:14.728584 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:14.728509    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ccdp6" event={"ID":"7d47f4a6-115c-4f46-a5a3-b05db3f11eec","Type":"ContainerDied","Data":"1ef31b899d4b7c35292cbcca4251d08b41dc9c6659e2642c72580c415cc41ace"}
Sep 08 15:14:14.730409 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:14.730384    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jkkjc" event={"ID":"2bbef4b3-4bf7-4f52-b0b3-cf5e58b6bd2f","Type":"ContainerStarted","Data":"c90e87fef323af5f898ac1daa62c75f1719aa33599d8759f544515f730931e5c"}
Sep 08 15:14:14.730546 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:14.730525    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:14:14.743593 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:14.743549    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8jb99" podStartSLOduration=67.5841832 podStartE2EDuration="1m21.743530905s" totalImagesPullingTime="14.159347705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:14.741704682 +0000 UTC m=+81.842598794" watchObservedRunningTime="2026-09-08 15:14:14.743530905 +0000 UTC m=+81.844425018"
Sep 08 15:14:14.772791 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:14.772740    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jkkjc" podStartSLOduration=67.657788958 podStartE2EDuration="1m21.772720007s" totalImagesPullingTime="14.114931049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:12:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:14.771619242 +0000 UTC m=+81.872513355" watchObservedRunningTime="2026-09-08 15:14:14.772720007 +0000 UTC m=+81.873614121"
Sep 08 15:14:15.736774 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:15.736737    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ccdp6" event={"ID":"7d47f4a6-115c-4f46-a5a3-b05db3f11eec","Type":"ContainerStarted","Data":"dde6e35535f6e0a19a43a6b49df3b0c7bb3f5dedde1a91ecfd46b454dcd92bf9"}
Sep 08 15:14:15.737250 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:15.736798    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ccdp6" event={"ID":"7d47f4a6-115c-4f46-a5a3-b05db3f11eec","Type":"ContainerStarted","Data":"46c517af1ea9356b936c4cd24e0356883f2f81e6c122388424a6b3131b933683"}
Sep 08 15:14:15.755890 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:15.755835    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ccdp6" podStartSLOduration=9.679831284 podStartE2EDuration="16.755814504s" totalImagesPullingTime="6.998023854s" totalInitContainerRuntime="77.959366ms" isStatefulPod=true podCreationTimestamp="2026-09-08 15:13:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:14:15.75468013 +0000 UTC m=+82.855574232" watchObservedRunningTime="2026-09-08 15:14:15.755814504 +0000 UTC m=+82.856708639"
Sep 08 15:14:45.740137 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:14:45.740109    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jkkjc"
Sep 08 15:17:38.976644 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.976599    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"]
Sep 08 15:17:38.978483 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.978467    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:38.981521 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.981498    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 15:17:38.981739 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.981721    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 15:17:38.982057 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.982039    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 15:17:38.982127 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.982053    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-xw2jq\""
Sep 08 15:17:38.982127 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.982044    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 15:17:38.988962 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.988942    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e90173-a399-47b7-9571-3ecc1087f2c9-tmp\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:38.989052 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.988978    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93e90173-a399-47b7-9571-3ecc1087f2c9-manifests\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:38.989052 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.989031    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93e90173-a399-47b7-9571-3ecc1087f2c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:38.989120 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.989051    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7r2xb\" (UniqueName: \"kubernetes.io/projected/93e90173-a399-47b7-9571-3ecc1087f2c9-kube-api-access-7r2xb\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:38.989120 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:38.989073    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93e90173-a399-47b7-9571-3ecc1087f2c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.004913 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.004893    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"]
Sep 08 15:17:39.089628 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.089604    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93e90173-a399-47b7-9571-3ecc1087f2c9-manifests\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.089741 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.089647    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93e90173-a399-47b7-9571-3ecc1087f2c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.089741 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.089682    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7r2xb\" (UniqueName: \"kubernetes.io/projected/93e90173-a399-47b7-9571-3ecc1087f2c9-kube-api-access-7r2xb\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.089741 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.089704    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93e90173-a399-47b7-9571-3ecc1087f2c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.089741 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.089732    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e90173-a399-47b7-9571-3ecc1087f2c9-tmp\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.090047 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.090030    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/93e90173-a399-47b7-9571-3ecc1087f2c9-manifests\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.092052 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.092030    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/93e90173-a399-47b7-9571-3ecc1087f2c9-webhook-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.092291 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.092273    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/93e90173-a399-47b7-9571-3ecc1087f2c9-tmp\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.092429 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.092412    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/93e90173-a399-47b7-9571-3ecc1087f2c9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.111335 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.111309    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7r2xb\" (UniqueName: \"kubernetes.io/projected/93e90173-a399-47b7-9571-3ecc1087f2c9-kube-api-access-7r2xb\") pod \"opendatahub-operator-controller-manager-68dbb6d945-l56vg\" (UID: \"93e90173-a399-47b7-9571-3ecc1087f2c9\") " pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.288415 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.288342    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:39.561512 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:39.561393    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"]
Sep 08 15:17:39.563475 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:17:39.563453    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93e90173_a399_47b7_9571_3ecc1087f2c9.slice/crio-79ff82b34a674c116d4f5de0712d23f61e9975ec1c13690087ac474e00c5d9af WatchSource:0}: Error finding container 79ff82b34a674c116d4f5de0712d23f61e9975ec1c13690087ac474e00c5d9af: Status 404 returned error can't find the container with id 79ff82b34a674c116d4f5de0712d23f61e9975ec1c13690087ac474e00c5d9af
Sep 08 15:17:40.395947 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:40.395909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg" event={"ID":"93e90173-a399-47b7-9571-3ecc1087f2c9","Type":"ContainerStarted","Data":"79ff82b34a674c116d4f5de0712d23f61e9975ec1c13690087ac474e00c5d9af"}
Sep 08 15:17:43.407493 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:43.407451    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg" event={"ID":"93e90173-a399-47b7-9571-3ecc1087f2c9","Type":"ContainerStarted","Data":"afc255608ef4a347dcf9dd8c92a8dc7cd4953a966dbce8c5f1a7e0d73fbe3123"}
Sep 08 15:17:44.412463 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:44.412426    2556 generic.go:356] "Generic (PLEG): container finished" podID="93e90173-a399-47b7-9571-3ecc1087f2c9" containerID="afc255608ef4a347dcf9dd8c92a8dc7cd4953a966dbce8c5f1a7e0d73fbe3123" exitCode=0
Sep 08 15:17:44.412870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:44.412495    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg" event={"ID":"93e90173-a399-47b7-9571-3ecc1087f2c9","Type":"ContainerDied","Data":"afc255608ef4a347dcf9dd8c92a8dc7cd4953a966dbce8c5f1a7e0d73fbe3123"}
Sep 08 15:17:45.416960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:45.416925    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg" event={"ID":"93e90173-a399-47b7-9571-3ecc1087f2c9","Type":"ContainerStarted","Data":"16060c125de03c96ee0480d6303a5da0a06af281318c5be47774554569afcfda"}
Sep 08 15:17:45.417332 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:45.417055    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:17:45.438133 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:45.438090    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg" podStartSLOduration=3.110742236 podStartE2EDuration="7.438076693s" totalImagesPullingTime="3.350728293s" totalInitContainerRuntime="976.606164ms" isStatefulPod=false podCreationTimestamp="2026-09-08 15:17:38 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:17:45.437999836 +0000 UTC m=+292.538893957" watchObservedRunningTime="2026-09-08 15:17:45.438076693 +0000 UTC m=+292.538970805"
Sep 08 15:17:53.269211 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:53.269188    2556 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 15:17:56.422210 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:17:56.422174    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68dbb6d945-l56vg"
Sep 08 15:18:01.943799 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:01.943760    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"]
Sep 08 15:18:01.945653 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:01.945637    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:01.948268 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:01.948238    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 15:18:01.948398 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:01.948239    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 15:18:01.949164 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:01.949143    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 15:18:01.949281 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:01.949164    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-sx25d\""
Sep 08 15:18:01.949281 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:01.949142    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 15:18:01.960580 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:01.960557    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"]
Sep 08 15:18:02.028877 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.028845    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240ede5d-3596-44fe-a7f6-19cd82899836-tmp\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.028877 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.028881    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rgzf4\" (UniqueName: \"kubernetes.io/projected/240ede5d-3596-44fe-a7f6-19cd82899836-kube-api-access-rgzf4\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.029092 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.028945    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240ede5d-3596-44fe-a7f6-19cd82899836-tls-certs\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.129775 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.129741    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240ede5d-3596-44fe-a7f6-19cd82899836-tmp\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.129994 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.129782    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rgzf4\" (UniqueName: \"kubernetes.io/projected/240ede5d-3596-44fe-a7f6-19cd82899836-kube-api-access-rgzf4\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.129994 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.129828    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240ede5d-3596-44fe-a7f6-19cd82899836-tls-certs\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.131952 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.131923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/240ede5d-3596-44fe-a7f6-19cd82899836-tmp\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.132228 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.132209    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/240ede5d-3596-44fe-a7f6-19cd82899836-tls-certs\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.141569 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.141546    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rgzf4\" (UniqueName: \"kubernetes.io/projected/240ede5d-3596-44fe-a7f6-19cd82899836-kube-api-access-rgzf4\") pod \"kube-auth-proxy-565756cbb6-tw8jg\" (UID: \"240ede5d-3596-44fe-a7f6-19cd82899836\") " pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.255601 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.255510    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"
Sep 08 15:18:02.521721 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.521625    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg"]
Sep 08 15:18:02.524486 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:18:02.524460    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod240ede5d_3596_44fe_a7f6_19cd82899836.slice/crio-d39bafb7adb10c8db0e1c7f7fb23fb2ed322b840b5741eaf6eadc6e2b7302120 WatchSource:0}: Error finding container d39bafb7adb10c8db0e1c7f7fb23fb2ed322b840b5741eaf6eadc6e2b7302120: Status 404 returned error can't find the container with id d39bafb7adb10c8db0e1c7f7fb23fb2ed322b840b5741eaf6eadc6e2b7302120
Sep 08 15:18:02.526201 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:02.526185    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:18:03.476160 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:03.476128    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg" event={"ID":"240ede5d-3596-44fe-a7f6-19cd82899836","Type":"ContainerStarted","Data":"d39bafb7adb10c8db0e1c7f7fb23fb2ed322b840b5741eaf6eadc6e2b7302120"}
Sep 08 15:18:06.487798 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:06.487772    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg" event={"ID":"240ede5d-3596-44fe-a7f6-19cd82899836","Type":"ContainerStarted","Data":"fc303be4733b751c51f04d3ddf2448bc7952797d0b66e865cda1267cf358144b"}
Sep 08 15:18:06.510080 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:06.507545    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-565756cbb6-tw8jg" podStartSLOduration=1.639004125 podStartE2EDuration="5.507524352s" totalImagesPullingTime="3.868520227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:06.505019855 +0000 UTC m=+313.605913964" watchObservedRunningTime="2026-09-08 15:18:06.507524352 +0000 UTC m=+313.608418464"
Sep 08 15:18:08.185629 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.185598    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"]
Sep 08 15:18:08.188812 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.188796    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.191334 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.191308    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-wv5cn\""
Sep 08 15:18:08.191442 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.191383    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:18:08.204276 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.204254    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"]
Sep 08 15:18:08.277802 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277779    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.277908 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277806    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.277908 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277823    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.277908 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277870    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-llmwh\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-kube-api-access-llmwh\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.278033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.278033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277932    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.278033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277960    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.278033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.278033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.277989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.378879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.378859    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.378992 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.378883    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.378992 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.378899    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379126 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379074    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379177 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379121    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379261 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379378 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379261    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379378 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379341    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-llmwh\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-kube-api-access-llmwh\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379486 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379380    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379486 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379402    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379646    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379782 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379752    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.379830 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.379805    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.380106 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.380090    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.381120 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.381099    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.381328 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.381310    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.387564 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.387542    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.387710 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.387695    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-llmwh\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-kube-api-access-llmwh\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.498562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.498503    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:08.772272 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:08.772200    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"]
Sep 08 15:18:08.776190 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:18:08.776165    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bca32c6_8acc_4dc1_96d4_2196b33cd210.slice/crio-abbf7ed1e58366d4562e04687e1ad3c9a36d4440d59f081c38204aa72c285b75 WatchSource:0}: Error finding container abbf7ed1e58366d4562e04687e1ad3c9a36d4440d59f081c38204aa72c285b75: Status 404 returned error can't find the container with id abbf7ed1e58366d4562e04687e1ad3c9a36d4440d59f081c38204aa72c285b75
Sep 08 15:18:09.497899 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:09.497865    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q" event={"ID":"4bca32c6-8acc-4dc1-96d4-2196b33cd210","Type":"ContainerStarted","Data":"abbf7ed1e58366d4562e04687e1ad3c9a36d4440d59f081c38204aa72c285b75"}
Sep 08 15:18:11.775369 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.775337    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5hztk"]
Sep 08 15:18:11.779452 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.779414    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:11.782124 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.782099    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 08 15:18:11.782243 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.782101    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-85w2v\""
Sep 08 15:18:11.788785 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.788765    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5hztk"]
Sep 08 15:18:11.805132 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.805103    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert\") pod \"odh-model-controller-7998c67dc4-5hztk\" (UID: \"38ced7e9-9325-454b-ab82-53fc7787d998\") " pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:11.805238 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.805156    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhgnv\" (UniqueName: \"kubernetes.io/projected/38ced7e9-9325-454b-ab82-53fc7787d998-kube-api-access-rhgnv\") pod \"odh-model-controller-7998c67dc4-5hztk\" (UID: \"38ced7e9-9325-454b-ab82-53fc7787d998\") " pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:11.906270 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.906238    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert\") pod \"odh-model-controller-7998c67dc4-5hztk\" (UID: \"38ced7e9-9325-454b-ab82-53fc7787d998\") " pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:11.906408 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.906273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhgnv\" (UniqueName: \"kubernetes.io/projected/38ced7e9-9325-454b-ab82-53fc7787d998-kube-api-access-rhgnv\") pod \"odh-model-controller-7998c67dc4-5hztk\" (UID: \"38ced7e9-9325-454b-ab82-53fc7787d998\") " pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:11.906408 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:18:11.906388    2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 08 15:18:11.906515 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:18:11.906451    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert podName:38ced7e9-9325-454b-ab82-53fc7787d998 nodeName:}" failed. No retries permitted until 2026-09-08 15:18:12.406433939 +0000 UTC m=+319.507328027 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert") pod "odh-model-controller-7998c67dc4-5hztk" (UID: "38ced7e9-9325-454b-ab82-53fc7787d998") : secret "odh-model-controller-webhook-cert" not found
Sep 08 15:18:11.920151 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:11.920129    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhgnv\" (UniqueName: \"kubernetes.io/projected/38ced7e9-9325-454b-ab82-53fc7787d998-kube-api-access-rhgnv\") pod \"odh-model-controller-7998c67dc4-5hztk\" (UID: \"38ced7e9-9325-454b-ab82-53fc7787d998\") " pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:12.410560 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:12.410526    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert\") pod \"odh-model-controller-7998c67dc4-5hztk\" (UID: \"38ced7e9-9325-454b-ab82-53fc7787d998\") " pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:12.410805 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:18:12.410684    2556 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 08 15:18:12.410805 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:18:12.410740    2556 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert podName:38ced7e9-9325-454b-ab82-53fc7787d998 nodeName:}" failed. No retries permitted until 2026-09-08 15:18:13.410725461 +0000 UTC m=+320.511619554 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert") pod "odh-model-controller-7998c67dc4-5hztk" (UID: "38ced7e9-9325-454b-ab82-53fc7787d998") : secret "odh-model-controller-webhook-cert" not found
Sep 08 15:18:13.418887 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:13.418857    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert\") pod \"odh-model-controller-7998c67dc4-5hztk\" (UID: \"38ced7e9-9325-454b-ab82-53fc7787d998\") " pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:13.421251 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:13.421226    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/38ced7e9-9325-454b-ab82-53fc7787d998-cert\") pod \"odh-model-controller-7998c67dc4-5hztk\" (UID: \"38ced7e9-9325-454b-ab82-53fc7787d998\") " pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:13.590547 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:13.590517    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:13.858052 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:13.858025    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-5hztk"]
Sep 08 15:18:13.860322 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:18:13.860296    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38ced7e9_9325_454b_ab82_53fc7787d998.slice/crio-50c4b5ffca76903d997969d128140a3bda85830b72d4c7d26b1b5ccb36575e93 WatchSource:0}: Error finding container 50c4b5ffca76903d997969d128140a3bda85830b72d4c7d26b1b5ccb36575e93: Status 404 returned error can't find the container with id 50c4b5ffca76903d997969d128140a3bda85830b72d4c7d26b1b5ccb36575e93
Sep 08 15:18:14.315170 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:14.315090    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"]
Sep 08 15:18:14.515301 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:14.515265    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5hztk" event={"ID":"38ced7e9-9325-454b-ab82-53fc7787d998","Type":"ContainerStarted","Data":"50c4b5ffca76903d997969d128140a3bda85830b72d4c7d26b1b5ccb36575e93"}
Sep 08 15:18:18.909725 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:18.909683    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:18:18.910013 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:18.909761    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:18:18.910013 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:18.909793    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:18:19.012293 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.012267    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"]
Sep 08 15:18:19.018972 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.018952    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.022352 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.022327    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 15:18:19.022446 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.022362    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g5rf5\""
Sep 08 15:18:19.022516 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.022332    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 15:18:19.022632 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.022614    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 15:18:19.030514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.030493    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"]
Sep 08 15:18:19.067334 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.067297    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.067517 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.067377    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.067517 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.067427    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.067517 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.067451    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b0fd7b-4f77-4d73-ab10-157a84f5e657-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.067517 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.067501    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.067743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.067566    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8dqq\" (UniqueName: \"kubernetes.io/projected/24b0fd7b-4f77-4d73-ab10-157a84f5e657-kube-api-access-q8dqq\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.067743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.067618    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.168628 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.168538    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.168628 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.168579    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b0fd7b-4f77-4d73-ab10-157a84f5e657-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.168628 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.168619    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.168960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.168694    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8dqq\" (UniqueName: \"kubernetes.io/projected/24b0fd7b-4f77-4d73-ab10-157a84f5e657-kube-api-access-q8dqq\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.168960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.168808    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.168960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.168862    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.168960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.168889    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.169608 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.169582    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.171124 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.171102    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.171211 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.171177    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.171279 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.171246    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/24b0fd7b-4f77-4d73-ab10-157a84f5e657-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.171518 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.171499    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.176566 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.176549    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/24b0fd7b-4f77-4d73-ab10-157a84f5e657-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.176898 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.176881    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8dqq\" (UniqueName: \"kubernetes.io/projected/24b0fd7b-4f77-4d73-ab10-157a84f5e657-kube-api-access-q8dqq\") pod \"istiod-openshift-gateway-5677ccb49b-cgp6q\" (UID: \"24b0fd7b-4f77-4d73-ab10-157a84f5e657\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.329762 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.329730    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:19.535583 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.535481    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-5hztk" event={"ID":"38ced7e9-9325-454b-ab82-53fc7787d998","Type":"ContainerStarted","Data":"4b7d2b3423867c135dc6afe64c4922cb825147f879d44bf2052f51e57c37c8d9"}
Sep 08 15:18:19.535583 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.535557    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:18:19.536869 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.536841    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q" event={"ID":"4bca32c6-8acc-4dc1-96d4-2196b33cd210","Type":"ContainerStarted","Data":"8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63"}
Sep 08 15:18:19.536980 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.536914    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q" podUID="4bca32c6-8acc-4dc1-96d4-2196b33cd210" containerName="istio-proxy" containerID="cri-o://8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63" gracePeriod=30
Sep 08 15:18:19.554261 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.554214    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-5hztk" podStartSLOduration=3.457787677 podStartE2EDuration="8.554200739s" totalImagesPullingTime="5.096413062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:19.553069767 +0000 UTC m=+326.653963899" watchObservedRunningTime="2026-09-08 15:18:19.554200739 +0000 UTC m=+326.655094840"
Sep 08 15:18:19.583509 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.583279    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q" podStartSLOduration=1.45207403 podStartE2EDuration="11.583260973s" totalImagesPullingTime="10.131186943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:19.58300153 +0000 UTC m=+326.683895633" watchObservedRunningTime="2026-09-08 15:18:19.583260973 +0000 UTC m=+326.684155084"
Sep 08 15:18:19.608052 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:19.608031    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"]
Sep 08 15:18:19.610109 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:18:19.610087    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b0fd7b_4f77_4d73_ab10_157a84f5e657.slice/crio-68cb4886be438c928951b04491eab3b032ec9906979baa2e06104acfd9232a2c WatchSource:0}: Error finding container 68cb4886be438c928951b04491eab3b032ec9906979baa2e06104acfd9232a2c: Status 404 returned error can't find the container with id 68cb4886be438c928951b04491eab3b032ec9906979baa2e06104acfd9232a2c
Sep 08 15:18:20.541132 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:20.541096    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q" event={"ID":"24b0fd7b-4f77-4d73-ab10-157a84f5e657","Type":"ContainerStarted","Data":"68cb4886be438c928951b04491eab3b032ec9906979baa2e06104acfd9232a2c"}
Sep 08 15:18:23.499350 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:23.499303    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:23.659938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:23.659902    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:18:23.660042 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:23.659965    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:18:24.557597 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.557568    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q" event={"ID":"24b0fd7b-4f77-4d73-ab10-157a84f5e657","Type":"ContainerStarted","Data":"9bdfccc5cc36c8b6bc5b4a1832facd8e963815326ba535b3aa207110be6fd6ec"}
Sep 08 15:18:24.557961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.557836    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:24.559440 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.559422    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q"
Sep 08 15:18:24.581047 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.581011    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-cgp6q" podStartSLOduration=2.533460867 podStartE2EDuration="6.581001176s" totalImagesPullingTime="4.047540309s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:18:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:18:24.580860562 +0000 UTC m=+331.681754672" watchObservedRunningTime="2026-09-08 15:18:24.581001176 +0000 UTC m=+331.681895286"
Sep 08 15:18:24.773625 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.773602    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:24.814230 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814175    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-credential-socket\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814230 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814208    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-envoy\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814375 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814249    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istiod-ca-cert\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814375 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814274    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-podinfo\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814375 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814308    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-certs\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814375 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814337    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-llmwh\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-kube-api-access-llmwh\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814409    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-socket\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814453    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-data\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814455    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:24.814567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814476    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-token\") pod \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\" (UID: \"4bca32c6-8acc-4dc1-96d4-2196b33cd210\") "
Sep 08 15:18:24.814567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814546    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:24.814835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814659    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:24.814835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814706    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:24.814835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814721    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:24.814835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814742    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-data" (OuterVolumeSpecName: "istio-data") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:24.814835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.814747    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:18:24.816566 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.816536    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:18:24.816664 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.816604    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-token" (OuterVolumeSpecName: "istio-token") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:18:24.816664 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.816622    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-kube-api-access-llmwh" (OuterVolumeSpecName: "kube-api-access-llmwh") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "kube-api-access-llmwh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:18:24.816664 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.816621    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4bca32c6-8acc-4dc1-96d4-2196b33cd210" (UID: "4bca32c6-8acc-4dc1-96d4-2196b33cd210"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:18:24.915040 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.915016    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:24.915040 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.915036    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:24.915155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.915045    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:24.915155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.915053    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:24.915155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.915061    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:24.915155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.915068    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4bca32c6-8acc-4dc1-96d4-2196b33cd210-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:24.915155 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:24.915076    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-llmwh\" (UniqueName: \"kubernetes.io/projected/4bca32c6-8acc-4dc1-96d4-2196b33cd210-kube-api-access-llmwh\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:18:25.562399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.562366    2556 generic.go:356] "Generic (PLEG): container finished" podID="4bca32c6-8acc-4dc1-96d4-2196b33cd210" containerID="8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63" exitCode=0
Sep 08 15:18:25.562749 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.562416    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"
Sep 08 15:18:25.562749 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.562457    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q" event={"ID":"4bca32c6-8acc-4dc1-96d4-2196b33cd210","Type":"ContainerDied","Data":"8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63"}
Sep 08 15:18:25.562749 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.562512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q" event={"ID":"4bca32c6-8acc-4dc1-96d4-2196b33cd210","Type":"ContainerDied","Data":"abbf7ed1e58366d4562e04687e1ad3c9a36d4440d59f081c38204aa72c285b75"}
Sep 08 15:18:25.562749 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.562535    2556 scope.go:117] "RemoveContainer" containerID="8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63"
Sep 08 15:18:25.570439 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.570422    2556 scope.go:117] "RemoveContainer" containerID="8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63"
Sep 08 15:18:25.570748 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:18:25.570729    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63\": container with ID starting with 8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63 not found: ID does not exist" containerID="8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63"
Sep 08 15:18:25.570800 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.570756    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63"} err="failed to get container status \"8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63\": rpc error: code = NotFound desc = could not find container \"8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63\": container with ID starting with 8fdf627ec6c3d658ad4d38d64a1c7ebf8456a3e07b324c986f6e190629abec63 not found: ID does not exist"
Sep 08 15:18:25.583886 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.583862    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"]
Sep 08 15:18:25.587388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:25.587365    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-xg58q"]
Sep 08 15:18:27.352689 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:27.352645    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bca32c6-8acc-4dc1-96d4-2196b33cd210" path="/var/lib/kubelet/pods/4bca32c6-8acc-4dc1-96d4-2196b33cd210/volumes"
Sep 08 15:18:30.543238 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:18:30.543205    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-5hztk"
Sep 08 15:19:28.505430 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.505394    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"]
Sep 08 15:19:28.505909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.505683    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bca32c6-8acc-4dc1-96d4-2196b33cd210" containerName="istio-proxy"
Sep 08 15:19:28.505909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.505698    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bca32c6-8acc-4dc1-96d4-2196b33cd210" containerName="istio-proxy"
Sep 08 15:19:28.505909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.505754    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bca32c6-8acc-4dc1-96d4-2196b33cd210" containerName="istio-proxy"
Sep 08 15:19:28.512486 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.512462    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:28.515695 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.515659    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:19:28.516430 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.516415    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-9ql7h\""
Sep 08 15:19:28.516538 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.516465    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:19:28.523004 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.522981    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"]
Sep 08 15:19:28.578298 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.578271    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lgbdz\" (UniqueName: \"kubernetes.io/projected/20e32771-a9ed-4a94-86b5-25b76c4a6256-kube-api-access-lgbdz\") pod \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" (UID: \"20e32771-a9ed-4a94-86b5-25b76c4a6256\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:28.678932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.678900    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lgbdz\" (UniqueName: \"kubernetes.io/projected/20e32771-a9ed-4a94-86b5-25b76c4a6256-kube-api-access-lgbdz\") pod \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" (UID: \"20e32771-a9ed-4a94-86b5-25b76c4a6256\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:28.687508 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.687484    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lgbdz\" (UniqueName: \"kubernetes.io/projected/20e32771-a9ed-4a94-86b5-25b76c4a6256-kube-api-access-lgbdz\") pod \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" (UID: \"20e32771-a9ed-4a94-86b5-25b76c4a6256\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:28.822392 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:28.822358    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:29.093572 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:29.093501    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"]
Sep 08 15:19:29.096301 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:19:29.096269    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e32771_a9ed_4a94_86b5_25b76c4a6256.slice/crio-3c02bbdf482ec57949a62c59138429c3c6c07a7bec54e1dfa9b08875529fb97d WatchSource:0}: Error finding container 3c02bbdf482ec57949a62c59138429c3c6c07a7bec54e1dfa9b08875529fb97d: Status 404 returned error can't find the container with id 3c02bbdf482ec57949a62c59138429c3c6c07a7bec54e1dfa9b08875529fb97d
Sep 08 15:19:29.786593 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:29.786559    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w" event={"ID":"20e32771-a9ed-4a94-86b5-25b76c4a6256","Type":"ContainerStarted","Data":"3c02bbdf482ec57949a62c59138429c3c6c07a7bec54e1dfa9b08875529fb97d"}
Sep 08 15:19:30.608944 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.608910    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"]
Sep 08 15:19:30.612118 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.612093    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"
Sep 08 15:19:30.615330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.615252    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lfvnx\""
Sep 08 15:19:30.615537 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.615521    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 15:19:30.625265 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.625241    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"]
Sep 08 15:19:30.698498 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.698463    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbx8k\" (UniqueName: \"kubernetes.io/projected/0db3458f-f26d-4685-90ef-b61a1a785883-kube-api-access-cbx8k\") pod \"dns-operator-controller-manager-5985564776-xfprp\" (UID: \"0db3458f-f26d-4685-90ef-b61a1a785883\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"
Sep 08 15:19:30.799812 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.799786    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbx8k\" (UniqueName: \"kubernetes.io/projected/0db3458f-f26d-4685-90ef-b61a1a785883-kube-api-access-cbx8k\") pod \"dns-operator-controller-manager-5985564776-xfprp\" (UID: \"0db3458f-f26d-4685-90ef-b61a1a785883\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"
Sep 08 15:19:30.811976 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.811954    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbx8k\" (UniqueName: \"kubernetes.io/projected/0db3458f-f26d-4685-90ef-b61a1a785883-kube-api-access-cbx8k\") pod \"dns-operator-controller-manager-5985564776-xfprp\" (UID: \"0db3458f-f26d-4685-90ef-b61a1a785883\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"
Sep 08 15:19:30.923124 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:30.923049    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"
Sep 08 15:19:31.796858 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:31.796829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w" event={"ID":"20e32771-a9ed-4a94-86b5-25b76c4a6256","Type":"ContainerStarted","Data":"58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46"}
Sep 08 15:19:31.797026 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:31.796960    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:31.816478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:31.816390    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w" podStartSLOduration=1.290736984 podStartE2EDuration="3.816373648s" totalImagesPullingTime="2.525636664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:31.815409289 +0000 UTC m=+398.916303399" watchObservedRunningTime="2026-09-08 15:19:31.816373648 +0000 UTC m=+398.917267760"
Sep 08 15:19:31.829805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:31.829781    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"]
Sep 08 15:19:31.832086 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:19:31.832060    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0db3458f_f26d_4685_90ef_b61a1a785883.slice/crio-2d26ea79def9dafdc318404a236ddcd697a66144ce59e7976c53d2c0b70c704f WatchSource:0}: Error finding container 2d26ea79def9dafdc318404a236ddcd697a66144ce59e7976c53d2c0b70c704f: Status 404 returned error can't find the container with id 2d26ea79def9dafdc318404a236ddcd697a66144ce59e7976c53d2c0b70c704f
Sep 08 15:19:32.802004 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:32.801971    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp" event={"ID":"0db3458f-f26d-4685-90ef-b61a1a785883","Type":"ContainerStarted","Data":"2d26ea79def9dafdc318404a236ddcd697a66144ce59e7976c53d2c0b70c704f"}
Sep 08 15:19:37.668014 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:37.667977    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-q6vhb"]
Sep 08 15:19:37.677987 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:37.677965    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb"
Sep 08 15:19:37.680902 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:37.680882    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-hs7vw\""
Sep 08 15:19:37.688171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:37.688148    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-q6vhb"]
Sep 08 15:19:37.749404 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:37.749382    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8gg9\" (UniqueName: \"kubernetes.io/projected/9664ef33-9af6-436e-b2b2-711ecf5b2a52-kube-api-access-s8gg9\") pod \"authorino-operator-68d88948d8-q6vhb\" (UID: \"9664ef33-9af6-436e-b2b2-711ecf5b2a52\") " pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb"
Sep 08 15:19:37.850006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:37.849982    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8gg9\" (UniqueName: \"kubernetes.io/projected/9664ef33-9af6-436e-b2b2-711ecf5b2a52-kube-api-access-s8gg9\") pod \"authorino-operator-68d88948d8-q6vhb\" (UID: \"9664ef33-9af6-436e-b2b2-711ecf5b2a52\") " pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb"
Sep 08 15:19:37.860923 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:37.860902    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8gg9\" (UniqueName: \"kubernetes.io/projected/9664ef33-9af6-436e-b2b2-711ecf5b2a52-kube-api-access-s8gg9\") pod \"authorino-operator-68d88948d8-q6vhb\" (UID: \"9664ef33-9af6-436e-b2b2-711ecf5b2a52\") " pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb"
Sep 08 15:19:37.989043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:37.988952    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb"
Sep 08 15:19:38.261765 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:38.261567    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-q6vhb"]
Sep 08 15:19:38.264410 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:19:38.264382    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9664ef33_9af6_436e_b2b2_711ecf5b2a52.slice/crio-5664d9b670ad270ae67b86e93ed472791fd7b37b7e6809f9c808d0864b4d605a WatchSource:0}: Error finding container 5664d9b670ad270ae67b86e93ed472791fd7b37b7e6809f9c808d0864b4d605a: Status 404 returned error can't find the container with id 5664d9b670ad270ae67b86e93ed472791fd7b37b7e6809f9c808d0864b4d605a
Sep 08 15:19:38.829601 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:38.829565    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb" event={"ID":"9664ef33-9af6-436e-b2b2-711ecf5b2a52","Type":"ContainerStarted","Data":"5664d9b670ad270ae67b86e93ed472791fd7b37b7e6809f9c808d0864b4d605a"}
Sep 08 15:19:40.840601 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:40.840564    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp" event={"ID":"0db3458f-f26d-4685-90ef-b61a1a785883","Type":"ContainerStarted","Data":"4cd145ba7d8b3ce2e46e2f70e164afb5976627c0c4c416c2c9c1bb9e2d287fa7"}
Sep 08 15:19:40.841029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:40.840655    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"
Sep 08 15:19:40.842152 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:40.842127    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb" event={"ID":"9664ef33-9af6-436e-b2b2-711ecf5b2a52","Type":"ContainerStarted","Data":"3fb3af5fcb08d83977087054e67ce0c510555199b7d93d1a8d728033814479fc"}
Sep 08 15:19:40.842251 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:40.842180    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb"
Sep 08 15:19:40.859026 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:40.858985    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp" podStartSLOduration=2.388934926 podStartE2EDuration="10.858972164s" totalImagesPullingTime="8.470037238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:40.857462672 +0000 UTC m=+407.958356784" watchObservedRunningTime="2026-09-08 15:19:40.858972164 +0000 UTC m=+407.959866275"
Sep 08 15:19:40.873636 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:40.873582    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb" podStartSLOduration=1.835008251 podStartE2EDuration="3.873568443s" totalImagesPullingTime="2.038560192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:40.87229952 +0000 UTC m=+407.973193653" watchObservedRunningTime="2026-09-08 15:19:40.873568443 +0000 UTC m=+407.974462557"
Sep 08 15:19:42.803969 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:42.803939    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:51.848238 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:51.848198    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-q6vhb"
Sep 08 15:19:51.848763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:51.848276    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-xfprp"
Sep 08 15:19:53.418811 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.418781    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"]
Sep 08 15:19:53.422060 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.422031    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.424268 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.424250    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g2gcd\""
Sep 08 15:19:53.436165 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.436146    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"]
Sep 08 15:19:53.463862 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.463837    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1cc3e7-5071-44d2-b109-b4ec2296f445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ttpjg\" (UID: \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.463960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.463910    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mdpc\" (UniqueName: \"kubernetes.io/projected/fa1cc3e7-5071-44d2-b109-b4ec2296f445-kube-api-access-5mdpc\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ttpjg\" (UID: \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.526035 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.526001    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"]
Sep 08 15:19:53.526248 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:53.526230    2556 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-5mdpc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg" podUID="fa1cc3e7-5071-44d2-b109-b4ec2296f445"
Sep 08 15:19:53.564507 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.564469    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1cc3e7-5071-44d2-b109-b4ec2296f445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ttpjg\" (UID: \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.564725 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.564520    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mdpc\" (UniqueName: \"kubernetes.io/projected/fa1cc3e7-5071-44d2-b109-b4ec2296f445-kube-api-access-5mdpc\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ttpjg\" (UID: \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.564877 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.564857    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1cc3e7-5071-44d2-b109-b4ec2296f445-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ttpjg\" (UID: \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.573517 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.573485    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mdpc\" (UniqueName: \"kubernetes.io/projected/fa1cc3e7-5071-44d2-b109-b4ec2296f445-kube-api-access-5mdpc\") pod \"kuadrant-operator-controller-manager-6bd956ccf-ttpjg\" (UID: \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.892122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.892091    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.899083 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.899063    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:53.967898 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.967863    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1cc3e7-5071-44d2-b109-b4ec2296f445-extensions-socket-volume\") pod \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\" (UID: \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\") "
Sep 08 15:19:53.968073 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.967907    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mdpc\" (UniqueName: \"kubernetes.io/projected/fa1cc3e7-5071-44d2-b109-b4ec2296f445-kube-api-access-5mdpc\") pod \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\" (UID: \"fa1cc3e7-5071-44d2-b109-b4ec2296f445\") "
Sep 08 15:19:53.968137 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.968114    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fa1cc3e7-5071-44d2-b109-b4ec2296f445-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fa1cc3e7-5071-44d2-b109-b4ec2296f445" (UID: "fa1cc3e7-5071-44d2-b109-b4ec2296f445"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:19:53.970000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:53.969978    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa1cc3e7-5071-44d2-b109-b4ec2296f445-kube-api-access-5mdpc" (OuterVolumeSpecName: "kube-api-access-5mdpc") pod "fa1cc3e7-5071-44d2-b109-b4ec2296f445" (UID: "fa1cc3e7-5071-44d2-b109-b4ec2296f445"). InnerVolumeSpecName "kube-api-access-5mdpc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:54.047299 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.047267    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"]
Sep 08 15:19:54.060225 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.060193    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"]
Sep 08 15:19:54.068810 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.068779    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fa1cc3e7-5071-44d2-b109-b4ec2296f445-extensions-socket-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:19:54.068810 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.068811    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mdpc\" (UniqueName: \"kubernetes.io/projected/fa1cc3e7-5071-44d2-b109-b4ec2296f445-kube-api-access-5mdpc\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:19:54.075837 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.075808    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"]
Sep 08 15:19:54.076048 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.076026    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" containerName="manager" containerID="cri-o://58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46" gracePeriod=2
Sep 08 15:19:54.091398 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.091374    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"]
Sep 08 15:19:54.100949 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.100899    2556 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"20e32771-a9ed-4a94-86b5-25b76c4a6256\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-6c549b6d85-vvv7w\": pods \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" not found" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:54.118745 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.118700    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"]
Sep 08 15:19:54.119165 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.119144    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" containerName="manager"
Sep 08 15:19:54.119165 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.119165    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" containerName="manager"
Sep 08 15:19:54.119306 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.119232    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" containerName="manager"
Sep 08 15:19:54.122330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.122312    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"
Sep 08 15:19:54.140263 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.140234    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"]
Sep 08 15:19:54.163948 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.163910    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:54.169279 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.169253    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9qhq\" (UniqueName: \"kubernetes.io/projected/a05931fa-06e3-40e5-8673-0bdab5d417fb-kube-api-access-b9qhq\") pod \"limitador-operator-controller-manager-6c549b6d85-2w75m\" (UID: \"a05931fa-06e3-40e5-8673-0bdab5d417fb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"
Sep 08 15:19:54.269744 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.269707    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9qhq\" (UniqueName: \"kubernetes.io/projected/a05931fa-06e3-40e5-8673-0bdab5d417fb-kube-api-access-b9qhq\") pod \"limitador-operator-controller-manager-6c549b6d85-2w75m\" (UID: \"a05931fa-06e3-40e5-8673-0bdab5d417fb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"
Sep 08 15:19:54.279263 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.279237    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9qhq\" (UniqueName: \"kubernetes.io/projected/a05931fa-06e3-40e5-8673-0bdab5d417fb-kube-api-access-b9qhq\") pod \"limitador-operator-controller-manager-6c549b6d85-2w75m\" (UID: \"a05931fa-06e3-40e5-8673-0bdab5d417fb\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"
Sep 08 15:19:54.301891 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.301871    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:54.303729 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.303706    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:54.370227 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.370197    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lgbdz\" (UniqueName: \"kubernetes.io/projected/20e32771-a9ed-4a94-86b5-25b76c4a6256-kube-api-access-lgbdz\") pod \"20e32771-a9ed-4a94-86b5-25b76c4a6256\" (UID: \"20e32771-a9ed-4a94-86b5-25b76c4a6256\") "
Sep 08 15:19:54.372263 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.372239    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e32771-a9ed-4a94-86b5-25b76c4a6256-kube-api-access-lgbdz" (OuterVolumeSpecName: "kube-api-access-lgbdz") pod "20e32771-a9ed-4a94-86b5-25b76c4a6256" (UID: "20e32771-a9ed-4a94-86b5-25b76c4a6256"). InnerVolumeSpecName "kube-api-access-lgbdz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:19:54.450233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.450156    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"
Sep 08 15:19:54.471312 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.471286    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lgbdz\" (UniqueName: \"kubernetes.io/projected/20e32771-a9ed-4a94-86b5-25b76c4a6256-kube-api-access-lgbdz\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:19:54.727225 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.727055    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"]
Sep 08 15:19:54.729945 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:19:54.729914    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda05931fa_06e3_40e5_8673_0bdab5d417fb.slice/crio-8917e8740de3a613a58c13662ec58726eed9551152cca9632305d5716c1a8c3f WatchSource:0}: Error finding container 8917e8740de3a613a58c13662ec58726eed9551152cca9632305d5716c1a8c3f: Status 404 returned error can't find the container with id 8917e8740de3a613a58c13662ec58726eed9551152cca9632305d5716c1a8c3f
Sep 08 15:19:54.896944 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.896910    2556 generic.go:356] "Generic (PLEG): container finished" podID="20e32771-a9ed-4a94-86b5-25b76c4a6256" containerID="58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46" exitCode=0
Sep 08 15:19:54.897119 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.896952    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:54.897119 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.897020    2556 scope.go:117] "RemoveContainer" containerID="58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46"
Sep 08 15:19:54.898870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.898833    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m" event={"ID":"a05931fa-06e3-40e5-8673-0bdab5d417fb","Type":"ContainerStarted","Data":"5d1c79b176d42789c9289ea7a76ac04d62f6c17392cc7010d74fdf26fa0f7e7e"}
Sep 08 15:19:54.898870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.898864    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:54.899035 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.898900    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m" event={"ID":"a05931fa-06e3-40e5-8673-0bdab5d417fb","Type":"ContainerStarted","Data":"8917e8740de3a613a58c13662ec58726eed9551152cca9632305d5716c1a8c3f"}
Sep 08 15:19:54.899099 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.899078    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"
Sep 08 15:19:54.899144 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.899123    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:54.900878 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.900855    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-ttpjg\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="fa1cc3e7-5071-44d2-b109-b4ec2296f445" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:54.904844 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.904818    2556 scope.go:117] "RemoveContainer" containerID="58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46"
Sep 08 15:19:54.905138 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.905120    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46\": container with ID starting with 58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46 not found: ID does not exist" containerID="58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46"
Sep 08 15:19:54.905198 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.905143    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46"} err="failed to get container status \"58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46\": rpc error: code = NotFound desc = could not find container \"58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46\": container with ID starting with 58ba979e6c48093b5a99895572f9c5fabda1c5f62c58d3472c6cf2dfbc5c6a46 not found: ID does not exist"
Sep 08 15:19:54.920459 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:54.920420    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m" podStartSLOduration=0.920409781 podStartE2EDuration="920.409781ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:19:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:19:54.919279196 +0000 UTC m=+422.020173307" watchObservedRunningTime="2026-09-08 15:19:54.920409781 +0000 UTC m=+422.021303892"
Sep 08 15:19:54.921122 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.921099    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:54.922913 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.922893    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-vvv7w\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-vvv7w"
Sep 08 15:19:54.924562 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:19:54.924537    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6bd956ccf-ttpjg\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="fa1cc3e7-5071-44d2-b109-b4ec2296f445" pod="kuadrant-system/kuadrant-operator-controller-manager-6bd956ccf-ttpjg"
Sep 08 15:19:55.353121 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:55.353090    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="20e32771-a9ed-4a94-86b5-25b76c4a6256" path="/var/lib/kubelet/pods/20e32771-a9ed-4a94-86b5-25b76c4a6256/volumes"
Sep 08 15:19:55.353426 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:19:55.353414    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa1cc3e7-5071-44d2-b109-b4ec2296f445" path="/var/lib/kubelet/pods/fa1cc3e7-5071-44d2-b109-b4ec2296f445/volumes"
Sep 08 15:20:05.905914 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:05.905886    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-2w75m"
Sep 08 15:20:06.085137 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.085107    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"]
Sep 08 15:20:06.090180 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.090165    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:06.095485 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.095463    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g2gcd\""
Sep 08 15:20:06.112500 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.112479    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"]
Sep 08 15:20:06.157786 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.157731    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kr2zn\" (UniqueName: \"kubernetes.io/projected/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-kube-api-access-kr2zn\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-49jpp\" (UID: \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:06.157875 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.157797    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-49jpp\" (UID: \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:06.258314 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.258281    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-49jpp\" (UID: \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:06.258438 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.258327    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kr2zn\" (UniqueName: \"kubernetes.io/projected/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-kube-api-access-kr2zn\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-49jpp\" (UID: \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:06.258659 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.258640    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-49jpp\" (UID: \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:06.266860 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.266841    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kr2zn\" (UniqueName: \"kubernetes.io/projected/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-kube-api-access-kr2zn\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-49jpp\" (UID: \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:06.400189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.400152    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:06.685457 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.685434    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"]
Sep 08 15:20:06.687882 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:20:06.687854    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod519a7a6e_cedd_4056_8e3d_d7a4ac47fd78.slice/crio-0a3cc4a6bca942ffbe7c0ce17f40e3d5d87fa95beff305e46357922b1104f5e9 WatchSource:0}: Error finding container 0a3cc4a6bca942ffbe7c0ce17f40e3d5d87fa95beff305e46357922b1104f5e9: Status 404 returned error can't find the container with id 0a3cc4a6bca942ffbe7c0ce17f40e3d5d87fa95beff305e46357922b1104f5e9
Sep 08 15:20:06.948574 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:06.948484    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp" event={"ID":"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78","Type":"ContainerStarted","Data":"0a3cc4a6bca942ffbe7c0ce17f40e3d5d87fa95beff305e46357922b1104f5e9"}
Sep 08 15:20:10.968999 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:10.968916    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp" event={"ID":"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78","Type":"ContainerStarted","Data":"9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a"}
Sep 08 15:20:10.969432 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:10.969052    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:20:10.990983 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:10.990928    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp" podStartSLOduration=1.063043965 podStartE2EDuration="4.990913169s" totalImagesPullingTime="3.927869204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:20:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:20:10.988916831 +0000 UTC m=+438.089810942" watchObservedRunningTime="2026-09-08 15:20:10.990913169 +0000 UTC m=+438.091807296"
Sep 08 15:20:21.981169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:20:21.981089    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:22:01.505511 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.505428    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"]
Sep 08 15:22:01.507827 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.507811    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:01.512341 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.512318    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 15:22:01.512469 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.512318    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-2vd6p\""
Sep 08 15:22:01.519134 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.519098    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"]
Sep 08 15:22:01.525899 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.525872    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lsgf\" (UniqueName: \"kubernetes.io/projected/8bd76297-19b8-4d68-b87e-9e913ec5cfe7-kube-api-access-7lsgf\") pod \"payload-pre-processing-59fbc47bf8-vrgbs\" (UID: \"8bd76297-19b8-4d68-b87e-9e913ec5cfe7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:01.526016 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.525967    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bd76297-19b8-4d68-b87e-9e913ec5cfe7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vrgbs\" (UID: \"8bd76297-19b8-4d68-b87e-9e913ec5cfe7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:01.627114 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.627075    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bd76297-19b8-4d68-b87e-9e913ec5cfe7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vrgbs\" (UID: \"8bd76297-19b8-4d68-b87e-9e913ec5cfe7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:01.627320 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.627147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lsgf\" (UniqueName: \"kubernetes.io/projected/8bd76297-19b8-4d68-b87e-9e913ec5cfe7-kube-api-access-7lsgf\") pod \"payload-pre-processing-59fbc47bf8-vrgbs\" (UID: \"8bd76297-19b8-4d68-b87e-9e913ec5cfe7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:01.628224 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.628199    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8bd76297-19b8-4d68-b87e-9e913ec5cfe7-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-vrgbs\" (UID: \"8bd76297-19b8-4d68-b87e-9e913ec5cfe7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:01.635793 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.635763    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lsgf\" (UniqueName: \"kubernetes.io/projected/8bd76297-19b8-4d68-b87e-9e913ec5cfe7-kube-api-access-7lsgf\") pod \"payload-pre-processing-59fbc47bf8-vrgbs\" (UID: \"8bd76297-19b8-4d68-b87e-9e913ec5cfe7\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:01.817732 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:01.817650    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:02.090686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:02.090649    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"]
Sep 08 15:22:02.093594 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:22:02.093568    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8bd76297_19b8_4d68_b87e_9e913ec5cfe7.slice/crio-335d665d8f0d524cb4ff4b58c5ee420ddd0e5c49378d7701b1e0f9ce71725405 WatchSource:0}: Error finding container 335d665d8f0d524cb4ff4b58c5ee420ddd0e5c49378d7701b1e0f9ce71725405: Status 404 returned error can't find the container with id 335d665d8f0d524cb4ff4b58c5ee420ddd0e5c49378d7701b1e0f9ce71725405
Sep 08 15:22:02.437638 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:02.437557    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs" event={"ID":"8bd76297-19b8-4d68-b87e-9e913ec5cfe7","Type":"ContainerStarted","Data":"335d665d8f0d524cb4ff4b58c5ee420ddd0e5c49378d7701b1e0f9ce71725405"}
Sep 08 15:22:05.453143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:05.453098    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs" event={"ID":"8bd76297-19b8-4d68-b87e-9e913ec5cfe7","Type":"ContainerStarted","Data":"17e55096a8c21c9d1f26f65c7e2aa6d5eff29824c4d49d03cbbd18de55ca9d78"}
Sep 08 15:22:05.453515 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:05.453170    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:16.459501 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:16.459466    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs"
Sep 08 15:22:16.477934 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:16.477888    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-vrgbs" podStartSLOduration=13.160257342 podStartE2EDuration="15.477874635s" totalImagesPullingTime="2.317617293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:05.480069045 +0000 UTC m=+552.580963155" watchObservedRunningTime="2026-09-08 15:22:16.477874635 +0000 UTC m=+563.578768763"
Sep 08 15:22:43.733207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.733160    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"]
Sep 08 15:22:43.740694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.740658    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.744562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.744462    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 15:22:43.744562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.744506    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 15:22:43.745439 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.745419    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8qwbs\""
Sep 08 15:22:43.745543 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.745472    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-embedding-simulated-kserve-self-signed-certs\""
Sep 08 15:22:43.749335 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.749312    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"]
Sep 08 15:22:43.842652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.842620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.842823 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.842685    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/309c874f-a4ea-4858-a4ec-2612b52daa55-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.842823 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.842745    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.842823 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.842782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.842823 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.842800    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.842989 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.842831    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-79bjw\" (UniqueName: \"kubernetes.io/projected/309c874f-a4ea-4858-a4ec-2612b52daa55-kube-api-access-79bjw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.943681 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.943647    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/309c874f-a4ea-4858-a4ec-2612b52daa55-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.943844 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.943705    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.943844 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.943771    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.943844 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.943809    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.944000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.943858    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-79bjw\" (UniqueName: \"kubernetes.io/projected/309c874f-a4ea-4858-a4ec-2612b52daa55-kube-api-access-79bjw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.944000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.943927    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.944099 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.944067    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-tmp-dir\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.944210 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.944190    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-model-cache\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.944307 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.944291    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-home\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.946101 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.946074    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/309c874f-a4ea-4858-a4ec-2612b52daa55-dshm\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.946251 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.946236    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/309c874f-a4ea-4858-a4ec-2612b52daa55-tls-certs\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:43.952914 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:43.952888    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-79bjw\" (UniqueName: \"kubernetes.io/projected/309c874f-a4ea-4858-a4ec-2612b52daa55-kube-api-access-79bjw\") pod \"e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz\" (UID: \"309c874f-a4ea-4858-a4ec-2612b52daa55\") " pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:44.052458 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:44.052391    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:44.321853 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:44.321825    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"]
Sep 08 15:22:44.620621 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:44.620532    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz" event={"ID":"309c874f-a4ea-4858-a4ec-2612b52daa55","Type":"ContainerStarted","Data":"91cbbef66db9f3966844f818faf447c0201065cb97c8b902eedc684c7c037253"}
Sep 08 15:22:45.626869 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:45.626838    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz" event={"ID":"309c874f-a4ea-4858-a4ec-2612b52daa55","Type":"ContainerStarted","Data":"e5d99637b92699049f294afad3b3e1f058112360598b272797a3b555ed89553f"}
Sep 08 15:22:45.644651 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:45.644604    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz" podStartSLOduration=1.658044429 podStartE2EDuration="2.644587183s" totalImagesPullingTime="986.542754ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:45.6441531 +0000 UTC m=+592.745047213" watchObservedRunningTime="2026-09-08 15:22:45.644587183 +0000 UTC m=+592.745481295"
Sep 08 15:22:54.053572 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:54.053530    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:54.054055 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:54.053600    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:54.066046 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:54.066025    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:54.676021 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:54.675986    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz"
Sep 08 15:22:58.512714 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.512646    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"]
Sep 08 15:22:58.515843 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.515819    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.518286 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.518264    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 08 15:22:58.527791 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.527770    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"]
Sep 08 15:22:58.665235 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.665207    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.665358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.665246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.665358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.665274    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.665358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.665337    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab59f4e4-8052-4f45-9348-0f653c830b55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.665465 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.665371    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.665465 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.665390    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqvzz\" (UniqueName: \"kubernetes.io/projected/ab59f4e4-8052-4f45-9348-0f653c830b55-kube-api-access-zqvzz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.766578 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.766498    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab59f4e4-8052-4f45-9348-0f653c830b55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.766578 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.766542    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.766578 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.766566    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqvzz\" (UniqueName: \"kubernetes.io/projected/ab59f4e4-8052-4f45-9348-0f653c830b55-kube-api-access-zqvzz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.766840 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.766615    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.766840 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.766656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.766840 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.766725    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.766994 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.766948    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.766994 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.766948    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.767077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.767023    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.768828 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.768805    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ab59f4e4-8052-4f45-9348-0f653c830b55-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.769218 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.769195    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ab59f4e4-8052-4f45-9348-0f653c830b55-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.775006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.774971    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqvzz\" (UniqueName: \"kubernetes.io/projected/ab59f4e4-8052-4f45-9348-0f653c830b55-kube-api-access-zqvzz\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz\" (UID: \"ab59f4e4-8052-4f45-9348-0f653c830b55\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:58.826506 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:58.826475    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:22:59.097159 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:59.096970    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"]
Sep 08 15:22:59.099542 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:22:59.099515    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab59f4e4_8052_4f45_9348_0f653c830b55.slice/crio-c9fd9938cc4ecd2aa1dbed2dda62ae899773219db150b7e6498b16421c2acfb8 WatchSource:0}: Error finding container c9fd9938cc4ecd2aa1dbed2dda62ae899773219db150b7e6498b16421c2acfb8: Status 404 returned error can't find the container with id c9fd9938cc4ecd2aa1dbed2dda62ae899773219db150b7e6498b16421c2acfb8
Sep 08 15:22:59.686385 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:59.686296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz" event={"ID":"ab59f4e4-8052-4f45-9348-0f653c830b55","Type":"ContainerStarted","Data":"ec1204f535236acafb76d7372b24da1acbb57ce4a891ff4da460ff1a3a732510"}
Sep 08 15:22:59.686385 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:59.686352    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz" event={"ID":"ab59f4e4-8052-4f45-9348-0f653c830b55","Type":"ContainerStarted","Data":"c9fd9938cc4ecd2aa1dbed2dda62ae899773219db150b7e6498b16421c2acfb8"}
Sep 08 15:22:59.705533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:22:59.705489    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz" podStartSLOduration=1.404590007 podStartE2EDuration="1.705475708s" totalImagesPullingTime="300.885701ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:22:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:22:59.704100413 +0000 UTC m=+606.804994561" watchObservedRunningTime="2026-09-08 15:22:59.705475708 +0000 UTC m=+606.806369818"
Sep 08 15:23:08.826901 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:23:08.826863    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:23:08.827290 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:23:08.826924    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:23:08.839053 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:23:08.839026    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:23:09.738564 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:23:09.738538    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz"
Sep 08 15:24:55.868403 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.868319    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"]
Sep 08 15:24:55.871571 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.871545    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.873808 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.873772    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-60b543-openshift-default-dockercfg-nstd9\""
Sep 08 15:24:55.885824 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.885791    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"]
Sep 08 15:24:55.956692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956631    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-credential-socket\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.956692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956695    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qk2wt\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-kube-api-access-qk2wt\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.956897 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956725    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-socket\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.956897 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956756    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-podinfo\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.956897 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956777    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-token\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.956897 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956809    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-envoy\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.956897 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956843    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-data\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.957106 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956933    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-certs\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:55.957106 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:55.956957    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istiod-ca-cert\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057496 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057468    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-credential-socket\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057496 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057498    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qk2wt\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-kube-api-access-qk2wt\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057751 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057519    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-socket\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057751 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-podinfo\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057751 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057559    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-token\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057751 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057715    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-envoy\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057773    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-data\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057857    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-certs\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.057957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057882    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istiod-ca-cert\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.058099 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.057969    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-socket\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.058099 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.058003    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-credential-socket\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.058194 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.058172    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-data\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.058194 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.058177    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-certs\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.058468 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.058449    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istiod-ca-cert\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.060051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.060026    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-envoy\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.060165 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.060149    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-podinfo\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.065688 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.065645    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-token\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.065972 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.065938    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qk2wt\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-kube-api-access-qk2wt\") pod \"e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") " pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.181152 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.181098    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:56.471957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.471933    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"]
Sep 08 15:24:56.473992 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:24:56.473962    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91a35c98_c7ad_4a0f_bbd0_4488a70b4ed6.slice/crio-be32e516dd2001d2f73f4293a1bcc493a97f1c1741af997495b77d004891d4f9 WatchSource:0}: Error finding container be32e516dd2001d2f73f4293a1bcc493a97f1c1741af997495b77d004891d4f9: Status 404 returned error can't find the container with id be32e516dd2001d2f73f4293a1bcc493a97f1c1741af997495b77d004891d4f9
Sep 08 15:24:56.476159 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.476114    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:24:56.476267 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.476207    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:24:56.476311 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:56.476284    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:24:57.164833 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:57.164791    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" event={"ID":"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6","Type":"ContainerStarted","Data":"7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723"}
Sep 08 15:24:57.165186 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:57.164891    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" event={"ID":"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6","Type":"ContainerStarted","Data":"be32e516dd2001d2f73f4293a1bcc493a97f1c1741af997495b77d004891d4f9"}
Sep 08 15:24:57.181684 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:57.181640    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:57.186428 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:57.186407    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:57.191514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:57.191468    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" podStartSLOduration=2.191453822 podStartE2EDuration="2.191453822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:24:57.189942428 +0000 UTC m=+724.290836539" watchObservedRunningTime="2026-09-08 15:24:57.191453822 +0000 UTC m=+724.292347933"
Sep 08 15:24:58.169988 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:58.169962    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:24:58.170920 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:24:58.170903    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:25:01.054309 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.054276    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"]
Sep 08 15:25:01.057400 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.057381    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:01.063746 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.063724    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-60b543-dockercfg-wfr9d\""
Sep 08 15:25:01.063894 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.063722    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-60b543\""
Sep 08 15:25:01.074985 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.074950    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"]
Sep 08 15:25:01.084228 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.084190    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"]
Sep 08 15:25:01.087522 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.087504    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:01.104850 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.104825    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"]
Sep 08 15:25:01.198835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.198804    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdc63c64-e6f4-4560-ba1d-348b24de361f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg\" (UID: \"cdc63c64-e6f4-4560-ba1d-348b24de361f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:01.198998 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.198852    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlpfg\" (UniqueName: \"kubernetes.io/projected/cdc63c64-e6f4-4560-ba1d-348b24de361f-kube-api-access-wlpfg\") pod \"payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg\" (UID: \"cdc63c64-e6f4-4560-ba1d-348b24de361f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:01.198998 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.198890    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595a2423-19fb-4176-81b3-5962194ef8a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7\" (UID: \"595a2423-19fb-4176-81b3-5962194ef8a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:01.198998 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.198908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t75j5\" (UniqueName: \"kubernetes.io/projected/595a2423-19fb-4176-81b3-5962194ef8a8-kube-api-access-t75j5\") pod \"payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7\" (UID: \"595a2423-19fb-4176-81b3-5962194ef8a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:01.299741 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.299704    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlpfg\" (UniqueName: \"kubernetes.io/projected/cdc63c64-e6f4-4560-ba1d-348b24de361f-kube-api-access-wlpfg\") pod \"payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg\" (UID: \"cdc63c64-e6f4-4560-ba1d-348b24de361f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:01.299890 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.299752    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595a2423-19fb-4176-81b3-5962194ef8a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7\" (UID: \"595a2423-19fb-4176-81b3-5962194ef8a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:01.299890 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.299866    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t75j5\" (UniqueName: \"kubernetes.io/projected/595a2423-19fb-4176-81b3-5962194ef8a8-kube-api-access-t75j5\") pod \"payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7\" (UID: \"595a2423-19fb-4176-81b3-5962194ef8a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:01.300003 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.299986    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdc63c64-e6f4-4560-ba1d-348b24de361f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg\" (UID: \"cdc63c64-e6f4-4560-ba1d-348b24de361f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:01.300427 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.300411    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595a2423-19fb-4176-81b3-5962194ef8a8-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7\" (UID: \"595a2423-19fb-4176-81b3-5962194ef8a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:01.300610 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.300594    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdc63c64-e6f4-4560-ba1d-348b24de361f-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg\" (UID: \"cdc63c64-e6f4-4560-ba1d-348b24de361f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:01.307982 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.307926    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t75j5\" (UniqueName: \"kubernetes.io/projected/595a2423-19fb-4176-81b3-5962194ef8a8-kube-api-access-t75j5\") pod \"payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7\" (UID: \"595a2423-19fb-4176-81b3-5962194ef8a8\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:01.308325 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.308310    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlpfg\" (UniqueName: \"kubernetes.io/projected/cdc63c64-e6f4-4560-ba1d-348b24de361f-kube-api-access-wlpfg\") pod \"payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg\" (UID: \"cdc63c64-e6f4-4560-ba1d-348b24de361f\") " pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:01.367459 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.367433    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:01.397301 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.397275    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:01.639575 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.639550    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"]
Sep 08 15:25:01.642035 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:01.642009    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod595a2423_19fb_4176_81b3_5962194ef8a8.slice/crio-22ee94711d4a361a5223b981234dd298f758b9db084187183add2dbd9d3c950c WatchSource:0}: Error finding container 22ee94711d4a361a5223b981234dd298f758b9db084187183add2dbd9d3c950c: Status 404 returned error can't find the container with id 22ee94711d4a361a5223b981234dd298f758b9db084187183add2dbd9d3c950c
Sep 08 15:25:01.678705 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:01.678660    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"]
Sep 08 15:25:01.681066 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:01.681036    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdc63c64_e6f4_4560_ba1d_348b24de361f.slice/crio-38800b7f7e3a27b74c62e1b55e13876efe36f4cbc751cdb9d7e510476ee2dee9 WatchSource:0}: Error finding container 38800b7f7e3a27b74c62e1b55e13876efe36f4cbc751cdb9d7e510476ee2dee9: Status 404 returned error can't find the container with id 38800b7f7e3a27b74c62e1b55e13876efe36f4cbc751cdb9d7e510476ee2dee9
Sep 08 15:25:02.188687 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:02.188628    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7" event={"ID":"595a2423-19fb-4176-81b3-5962194ef8a8","Type":"ContainerStarted","Data":"b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea"}
Sep 08 15:25:02.189176 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:02.188717    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7" event={"ID":"595a2423-19fb-4176-81b3-5962194ef8a8","Type":"ContainerStarted","Data":"22ee94711d4a361a5223b981234dd298f758b9db084187183add2dbd9d3c950c"}
Sep 08 15:25:02.189176 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:02.188751    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:02.190212 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:02.190181    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg" event={"ID":"cdc63c64-e6f4-4560-ba1d-348b24de361f","Type":"ContainerStarted","Data":"e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a"}
Sep 08 15:25:02.190322 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:02.190238    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:02.190322 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:02.190260    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg" event={"ID":"cdc63c64-e6f4-4560-ba1d-348b24de361f","Type":"ContainerStarted","Data":"38800b7f7e3a27b74c62e1b55e13876efe36f4cbc751cdb9d7e510476ee2dee9"}
Sep 08 15:25:02.206390 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:02.206342    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7" podStartSLOduration=1.206323321 podStartE2EDuration="1.206323321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:02.205824054 +0000 UTC m=+729.306718166" watchObservedRunningTime="2026-09-08 15:25:02.206323321 +0000 UTC m=+729.307217431"
Sep 08 15:25:02.222149 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:02.222105    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg" podStartSLOduration=1.222090855 podStartE2EDuration="1.222090855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:02.221040654 +0000 UTC m=+729.321934762" watchObservedRunningTime="2026-09-08 15:25:02.222090855 +0000 UTC m=+729.322984965"
Sep 08 15:25:08.777154 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.777124    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"]
Sep 08 15:25:08.780580 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.780564    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:08.782759 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.782731    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-eed32982\""
Sep 08 15:25:08.782860 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.782836    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-eed32982-dockercfg-5fb2p\""
Sep 08 15:25:08.788980 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.788957    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"]
Sep 08 15:25:08.807302 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.807280    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"]
Sep 08 15:25:08.810290 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.810276    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:08.819601 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.819576    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"]
Sep 08 15:25:08.874163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.874126    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t\" (UID: \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:08.874328 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.874175    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdk4q\" (UniqueName: \"kubernetes.io/projected/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-kube-api-access-gdk4q\") pod \"payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t\" (UID: \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:08.975343 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.975305    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a627e0-e85e-424b-8314-042649f6db41-plugins-config-volume\") pod \"payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6\" (UID: \"63a627e0-e85e-424b-8314-042649f6db41\") " pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:08.975501 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.975356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdk4q\" (UniqueName: \"kubernetes.io/projected/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-kube-api-access-gdk4q\") pod \"payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t\" (UID: \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:08.975501 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.975475    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twmgb\" (UniqueName: \"kubernetes.io/projected/63a627e0-e85e-424b-8314-042649f6db41-kube-api-access-twmgb\") pod \"payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6\" (UID: \"63a627e0-e85e-424b-8314-042649f6db41\") " pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:08.975576 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.975525    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t\" (UID: \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:08.976223 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.976190    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t\" (UID: \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:08.982707 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:08.982661    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdk4q\" (UniqueName: \"kubernetes.io/projected/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-kube-api-access-gdk4q\") pod \"payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t\" (UID: \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:09.076864 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:09.076839    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twmgb\" (UniqueName: \"kubernetes.io/projected/63a627e0-e85e-424b-8314-042649f6db41-kube-api-access-twmgb\") pod \"payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6\" (UID: \"63a627e0-e85e-424b-8314-042649f6db41\") " pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:09.076996 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:09.076885    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a627e0-e85e-424b-8314-042649f6db41-plugins-config-volume\") pod \"payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6\" (UID: \"63a627e0-e85e-424b-8314-042649f6db41\") " pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:09.077506 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:09.077488    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a627e0-e85e-424b-8314-042649f6db41-plugins-config-volume\") pod \"payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6\" (UID: \"63a627e0-e85e-424b-8314-042649f6db41\") " pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:09.086445 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:09.086419    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-twmgb\" (UniqueName: \"kubernetes.io/projected/63a627e0-e85e-424b-8314-042649f6db41-kube-api-access-twmgb\") pod \"payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6\" (UID: \"63a627e0-e85e-424b-8314-042649f6db41\") " pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:09.092151 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:09.092130    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:09.122451 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:09.122426    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:09.386633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:09.386609    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"]
Sep 08 15:25:09.389012 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:09.388990    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11199ba_e3bf_4336_836f_ab2bbdd2bc5c.slice/crio-1c3f6fed4771e434cfecd2f4b18cc90df5831f19dcf584e9c2d8fda73f2b08ea WatchSource:0}: Error finding container 1c3f6fed4771e434cfecd2f4b18cc90df5831f19dcf584e9c2d8fda73f2b08ea: Status 404 returned error can't find the container with id 1c3f6fed4771e434cfecd2f4b18cc90df5831f19dcf584e9c2d8fda73f2b08ea
Sep 08 15:25:09.430605 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:09.430586    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"]
Sep 08 15:25:09.438619 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:09.438593    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63a627e0_e85e_424b_8314_042649f6db41.slice/crio-5c69102ce93e33433064a8cc183a6c1882506ffd1c07b5cb376e71d3b1ce9ff1 WatchSource:0}: Error finding container 5c69102ce93e33433064a8cc183a6c1882506ffd1c07b5cb376e71d3b1ce9ff1: Status 404 returned error can't find the container with id 5c69102ce93e33433064a8cc183a6c1882506ffd1c07b5cb376e71d3b1ce9ff1
Sep 08 15:25:10.228236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:10.228200    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6" event={"ID":"63a627e0-e85e-424b-8314-042649f6db41","Type":"ContainerStarted","Data":"3d1109d30d949631fb712a9cbf1883163c29f3a83e024259ac1bfd16ee71c9ed"}
Sep 08 15:25:10.228686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:10.228258    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6" event={"ID":"63a627e0-e85e-424b-8314-042649f6db41","Type":"ContainerStarted","Data":"5c69102ce93e33433064a8cc183a6c1882506ffd1c07b5cb376e71d3b1ce9ff1"}
Sep 08 15:25:10.228686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:10.228284    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:10.229725 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:10.229699    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t" event={"ID":"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c","Type":"ContainerStarted","Data":"d3c6ca5210fb50be4f6f36091bf1e8cd5b7f86bcdc1e4f0b7cc78c932c1f0db7"}
Sep 08 15:25:10.229837 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:10.229748    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t" event={"ID":"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c","Type":"ContainerStarted","Data":"1c3f6fed4771e434cfecd2f4b18cc90df5831f19dcf584e9c2d8fda73f2b08ea"}
Sep 08 15:25:10.229837 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:10.229777    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:10.246323 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:10.246272    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6" podStartSLOduration=2.246255709 podStartE2EDuration="2.246255709s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:10.244540232 +0000 UTC m=+737.345434346" watchObservedRunningTime="2026-09-08 15:25:10.246255709 +0000 UTC m=+737.347149819"
Sep 08 15:25:10.280206 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:10.280096    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t" podStartSLOduration=2.280079367 podStartE2EDuration="2.280079367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:10.278531778 +0000 UTC m=+737.379425894" watchObservedRunningTime="2026-09-08 15:25:10.280079367 +0000 UTC m=+737.380973477"
Sep 08 15:25:13.157634 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.157593    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"]
Sep 08 15:25:13.161067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.161045    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:13.163526 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.163501    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-98d03a-dockercfg-szbmz\""
Sep 08 15:25:13.163889 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.163872    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-98d03a\""
Sep 08 15:25:13.178112 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.178088    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"]
Sep 08 15:25:13.196253 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.196220    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:25:13.196388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.196332    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:25:13.198557 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.198531    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"]
Sep 08 15:25:13.201921 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.201904    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:13.214707 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.214248    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"]
Sep 08 15:25:13.312639 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.312603    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b6n9q\" (UniqueName: \"kubernetes.io/projected/a6df8a95-badb-48d7-bef6-3482ea602579-kube-api-access-b6n9q\") pod \"payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw\" (UID: \"a6df8a95-badb-48d7-bef6-3482ea602579\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:13.312863 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.312704    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xclwj\" (UniqueName: \"kubernetes.io/projected/870855e0-341d-42d1-8fee-0b14b28f9824-kube-api-access-xclwj\") pod \"payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r\" (UID: \"870855e0-341d-42d1-8fee-0b14b28f9824\") " pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:13.312943 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.312908    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6df8a95-badb-48d7-bef6-3482ea602579-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw\" (UID: \"a6df8a95-badb-48d7-bef6-3482ea602579\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:13.313002 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.312949    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870855e0-341d-42d1-8fee-0b14b28f9824-plugins-config-volume\") pod \"payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r\" (UID: \"870855e0-341d-42d1-8fee-0b14b28f9824\") " pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:13.413615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.413523    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6df8a95-badb-48d7-bef6-3482ea602579-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw\" (UID: \"a6df8a95-badb-48d7-bef6-3482ea602579\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:13.413615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.413562    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870855e0-341d-42d1-8fee-0b14b28f9824-plugins-config-volume\") pod \"payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r\" (UID: \"870855e0-341d-42d1-8fee-0b14b28f9824\") " pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:13.413615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.413585    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b6n9q\" (UniqueName: \"kubernetes.io/projected/a6df8a95-badb-48d7-bef6-3482ea602579-kube-api-access-b6n9q\") pod \"payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw\" (UID: \"a6df8a95-badb-48d7-bef6-3482ea602579\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:13.413615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.413616    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xclwj\" (UniqueName: \"kubernetes.io/projected/870855e0-341d-42d1-8fee-0b14b28f9824-kube-api-access-xclwj\") pod \"payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r\" (UID: \"870855e0-341d-42d1-8fee-0b14b28f9824\") " pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:13.414352 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.414324    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6df8a95-badb-48d7-bef6-3482ea602579-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw\" (UID: \"a6df8a95-badb-48d7-bef6-3482ea602579\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:13.414436 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.414352    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870855e0-341d-42d1-8fee-0b14b28f9824-plugins-config-volume\") pod \"payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r\" (UID: \"870855e0-341d-42d1-8fee-0b14b28f9824\") " pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:13.421494 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.421466    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b6n9q\" (UniqueName: \"kubernetes.io/projected/a6df8a95-badb-48d7-bef6-3482ea602579-kube-api-access-b6n9q\") pod \"payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw\" (UID: \"a6df8a95-badb-48d7-bef6-3482ea602579\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:13.421679 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.421648    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xclwj\" (UniqueName: \"kubernetes.io/projected/870855e0-341d-42d1-8fee-0b14b28f9824-kube-api-access-xclwj\") pod \"payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r\" (UID: \"870855e0-341d-42d1-8fee-0b14b28f9824\") " pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:13.472255 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.472215    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:13.513071 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.513041    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:13.747448 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.747426    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"]
Sep 08 15:25:13.750156 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:13.750124    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6df8a95_badb_48d7_bef6_3482ea602579.slice/crio-6ee843953b8c36f5a53771784b5df2b17fc7c5aa2f1ce083d9d435acf75ec496 WatchSource:0}: Error finding container 6ee843953b8c36f5a53771784b5df2b17fc7c5aa2f1ce083d9d435acf75ec496: Status 404 returned error can't find the container with id 6ee843953b8c36f5a53771784b5df2b17fc7c5aa2f1ce083d9d435acf75ec496
Sep 08 15:25:13.800730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:13.800701    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"]
Sep 08 15:25:13.804393 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:13.804359    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod870855e0_341d_42d1_8fee_0b14b28f9824.slice/crio-10b86caa0e68944454b441545d42c7ddbe8a0bfd0d0d6b73dd6114786149a862 WatchSource:0}: Error finding container 10b86caa0e68944454b441545d42c7ddbe8a0bfd0d0d6b73dd6114786149a862: Status 404 returned error can't find the container with id 10b86caa0e68944454b441545d42c7ddbe8a0bfd0d0d6b73dd6114786149a862
Sep 08 15:25:14.211865 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.211816    2556 patch_prober.go:28] interesting pod/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:25:14.212348 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.211885    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:25:14.260017 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.259977    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw" event={"ID":"a6df8a95-badb-48d7-bef6-3482ea602579","Type":"ContainerStarted","Data":"634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0"}
Sep 08 15:25:14.260196 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.260038    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw" event={"ID":"a6df8a95-badb-48d7-bef6-3482ea602579","Type":"ContainerStarted","Data":"6ee843953b8c36f5a53771784b5df2b17fc7c5aa2f1ce083d9d435acf75ec496"}
Sep 08 15:25:14.260196 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.260104    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:14.261920 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.261895    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r" event={"ID":"870855e0-341d-42d1-8fee-0b14b28f9824","Type":"ContainerStarted","Data":"60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd"}
Sep 08 15:25:14.262045 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.261942    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r" event={"ID":"870855e0-341d-42d1-8fee-0b14b28f9824","Type":"ContainerStarted","Data":"10b86caa0e68944454b441545d42c7ddbe8a0bfd0d0d6b73dd6114786149a862"}
Sep 08 15:25:14.262045 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.261990    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:14.275898 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.275843    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw" podStartSLOduration=1.275825354 podStartE2EDuration="1.275825354s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:14.274070186 +0000 UTC m=+741.374964293" watchObservedRunningTime="2026-09-08 15:25:14.275825354 +0000 UTC m=+741.376719465"
Sep 08 15:25:14.289716 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:14.289664    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r" podStartSLOduration=1.289650302 podStartE2EDuration="1.289650302s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:14.288330585 +0000 UTC m=+741.389224723" watchObservedRunningTime="2026-09-08 15:25:14.289650302 +0000 UTC m=+741.390544413"
Sep 08 15:25:16.273134 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:16.273100    2556 generic.go:356] "Generic (PLEG): container finished" podID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerID="7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723" exitCode=0
Sep 08 15:25:16.273617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:16.273168    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" event={"ID":"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6","Type":"ContainerDied","Data":"7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723"}
Sep 08 15:25:16.273617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:16.273546    2556 scope.go:117] "RemoveContainer" containerID="7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723"
Sep 08 15:25:16.274782 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:16.274753    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:25:16.274849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:16.274822    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:25:16.274885 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:16.274855    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:25:17.279744 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:17.279708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" event={"ID":"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6","Type":"ContainerStarted","Data":"1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c"}
Sep 08 15:25:18.181912 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:18.181875    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:25:18.182189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:18.182170    2556 patch_prober.go:28] interesting pod/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 08 15:25:18.182235 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:18.182215    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 08 15:25:19.182204 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:19.182168    2556 patch_prober.go:28] interesting pod/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 08 15:25:19.182594 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:19.182226    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 08 15:25:20.181564 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:20.181525    2556 patch_prober.go:28] interesting pod/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 08 15:25:20.181768 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:20.181583    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 08 15:25:21.181504 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:21.181465    2556 patch_prober.go:28] interesting pod/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 08 15:25:21.181941 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:21.181520    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 08 15:25:21.237084 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:21.237042    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:21.237275 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:21.237122    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:22.182202 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:22.182163    2556 patch_prober.go:28] interesting pod/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused" start-of-body=
Sep 08 15:25:22.182596 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:22.182221    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.29:15021/healthz/ready\": dial tcp 10.133.0.29:15021: connect: connection refused"
Sep 08 15:25:23.186237 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:23.186208    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:25:23.186624 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:23.186593    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:25:23.187216 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:23.187198    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:25:25.268562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:25.268533    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:25:25.268953 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:25.268616    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:25:29.629400 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.629365    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"]
Sep 08 15:25:29.631822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.631801    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:29.634367 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.634346    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-b75273-dockercfg-x5dwd\""
Sep 08 15:25:29.634461 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.634356    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-b75273\""
Sep 08 15:25:29.641843 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.641821    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"]
Sep 08 15:25:29.669511 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.669481    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbxsg\" (UniqueName: \"kubernetes.io/projected/ba804955-a016-43e9-89ca-59a0d64240c0-kube-api-access-kbxsg\") pod \"payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw\" (UID: \"ba804955-a016-43e9-89ca-59a0d64240c0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:29.669656 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.669539    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba804955-a016-43e9-89ca-59a0d64240c0-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw\" (UID: \"ba804955-a016-43e9-89ca-59a0d64240c0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:29.770827 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.770791    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbxsg\" (UniqueName: \"kubernetes.io/projected/ba804955-a016-43e9-89ca-59a0d64240c0-kube-api-access-kbxsg\") pod \"payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw\" (UID: \"ba804955-a016-43e9-89ca-59a0d64240c0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:29.771027 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.770869    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba804955-a016-43e9-89ca-59a0d64240c0-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw\" (UID: \"ba804955-a016-43e9-89ca-59a0d64240c0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:29.771590 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.771565    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba804955-a016-43e9-89ca-59a0d64240c0-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw\" (UID: \"ba804955-a016-43e9-89ca-59a0d64240c0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:29.779078 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.779056    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbxsg\" (UniqueName: \"kubernetes.io/projected/ba804955-a016-43e9-89ca-59a0d64240c0-kube-api-access-kbxsg\") pod \"payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw\" (UID: \"ba804955-a016-43e9-89ca-59a0d64240c0\") " pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:29.943589 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:29.943501    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:30.211812 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:30.211782    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"]
Sep 08 15:25:30.213698 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:30.213659    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba804955_a016_43e9_89ca_59a0d64240c0.slice/crio-758dba2c0ce2a9969b5f1ff18272aef35f9ffdc543f94a6061d9dd04fe41efbd WatchSource:0}: Error finding container 758dba2c0ce2a9969b5f1ff18272aef35f9ffdc543f94a6061d9dd04fe41efbd: Status 404 returned error can't find the container with id 758dba2c0ce2a9969b5f1ff18272aef35f9ffdc543f94a6061d9dd04fe41efbd
Sep 08 15:25:30.354822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:30.354782    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw" event={"ID":"ba804955-a016-43e9-89ca-59a0d64240c0","Type":"ContainerStarted","Data":"ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864"}
Sep 08 15:25:30.354968 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:30.354840    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw" event={"ID":"ba804955-a016-43e9-89ca-59a0d64240c0","Type":"ContainerStarted","Data":"758dba2c0ce2a9969b5f1ff18272aef35f9ffdc543f94a6061d9dd04fe41efbd"}
Sep 08 15:25:30.354968 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:30.354884    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:30.372234 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:30.372174    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw" podStartSLOduration=1.372156321 podStartE2EDuration="1.372156321s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:30.371449108 +0000 UTC m=+757.472343218" watchObservedRunningTime="2026-09-08 15:25:30.372156321 +0000 UTC m=+757.473050432"
Sep 08 15:25:32.356571 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.356535    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"]
Sep 08 15:25:32.359419 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.359399    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"
Sep 08 15:25:32.361888 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.361864    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:25:32.362001 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.361886    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:25:32.367163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.367131    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"]
Sep 08 15:25:32.397510 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.397472    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90fa9710-2310-45f7-81f2-28daaf8a8059-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eed32982-cjqvd\" (UID: \"90fa9710-2310-45f7-81f2-28daaf8a8059\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"
Sep 08 15:25:32.499537 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.499490    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90fa9710-2310-45f7-81f2-28daaf8a8059-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eed32982-cjqvd\" (UID: \"90fa9710-2310-45f7-81f2-28daaf8a8059\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"
Sep 08 15:25:32.500427 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.500399    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90fa9710-2310-45f7-81f2-28daaf8a8059-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-eed32982-cjqvd\" (UID: \"90fa9710-2310-45f7-81f2-28daaf8a8059\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"
Sep 08 15:25:32.672567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.672464    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"
Sep 08 15:25:32.951131 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.951080    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"]
Sep 08 15:25:32.953259 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:32.953230    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90fa9710_2310_45f7_81f2_28daaf8a8059.slice/crio-9df200cde28607e1ca1733c09b4e6c0c72961879d9fb82703f38536e8b2c097d WatchSource:0}: Error finding container 9df200cde28607e1ca1733c09b4e6c0c72961879d9fb82703f38536e8b2c097d: Status 404 returned error can't find the container with id 9df200cde28607e1ca1733c09b4e6c0c72961879d9fb82703f38536e8b2c097d
Sep 08 15:25:32.955304 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:32.955284    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:25:33.376112 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:33.376077    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd" event={"ID":"90fa9710-2310-45f7-81f2-28daaf8a8059","Type":"ContainerStarted","Data":"9df200cde28607e1ca1733c09b4e6c0c72961879d9fb82703f38536e8b2c097d"}
Sep 08 15:25:36.392769 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:36.392732    2556 generic.go:356] "Generic (PLEG): container finished" podID="90fa9710-2310-45f7-81f2-28daaf8a8059" containerID="1b3dd79bedab70a5f0c01f5d4e87cc6f0f3d6190f4511ce6fa0022839f76211e" exitCode=0
Sep 08 15:25:36.392769 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:36.392773    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd" event={"ID":"90fa9710-2310-45f7-81f2-28daaf8a8059","Type":"ContainerDied","Data":"1b3dd79bedab70a5f0c01f5d4e87cc6f0f3d6190f4511ce6fa0022839f76211e"}
Sep 08 15:25:37.531333 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:37.531303    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"
Sep 08 15:25:37.652569 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:37.652481    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90fa9710-2310-45f7-81f2-28daaf8a8059-maas-api-service-ca\") pod \"90fa9710-2310-45f7-81f2-28daaf8a8059\" (UID: \"90fa9710-2310-45f7-81f2-28daaf8a8059\") "
Sep 08 15:25:37.652863 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:37.652837    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90fa9710-2310-45f7-81f2-28daaf8a8059-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "90fa9710-2310-45f7-81f2-28daaf8a8059" (UID: "90fa9710-2310-45f7-81f2-28daaf8a8059"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:25:37.754124 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:37.754092    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/90fa9710-2310-45f7-81f2-28daaf8a8059-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:25:38.403330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:38.403304    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"
Sep 08 15:25:38.403500 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:38.403332    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd" event={"ID":"90fa9710-2310-45f7-81f2-28daaf8a8059","Type":"ContainerDied","Data":"9df200cde28607e1ca1733c09b4e6c0c72961879d9fb82703f38536e8b2c097d"}
Sep 08 15:25:38.403500 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:38.403377    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9df200cde28607e1ca1733c09b4e6c0c72961879d9fb82703f38536e8b2c097d"
Sep 08 15:25:41.365969 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:41.365937    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:25:49.174407 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.174366    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"]
Sep 08 15:25:49.174898 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.174649    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6" podUID="63a627e0-e85e-424b-8314-042649f6db41" containerName="payload-processing" containerID="cri-o://3d1109d30d949631fb712a9cbf1883163c29f3a83e024259ac1bfd16ee71c9ed" gracePeriod=30
Sep 08 15:25:49.180030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.180004    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"]
Sep 08 15:25:49.180415 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.180372    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t" podUID="d11199ba-e3bf-4336-836f-ab2bbdd2bc5c" containerName="payload-pre-processing" containerID="cri-o://d3c6ca5210fb50be4f6f36091bf1e8cd5b7f86bcdc1e4f0b7cc78c932c1f0db7" gracePeriod=30
Sep 08 15:25:49.335923 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.335890    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"]
Sep 08 15:25:49.345949 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.341410    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-eed32982-cjqvd"]
Sep 08 15:25:49.354498 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.354247    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90fa9710-2310-45f7-81f2-28daaf8a8059" path="/var/lib/kubelet/pods/90fa9710-2310-45f7-81f2-28daaf8a8059/volumes"
Sep 08 15:25:49.460092 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.459989    2556 generic.go:356] "Generic (PLEG): container finished" podID="63a627e0-e85e-424b-8314-042649f6db41" containerID="3d1109d30d949631fb712a9cbf1883163c29f3a83e024259ac1bfd16ee71c9ed" exitCode=0
Sep 08 15:25:49.460092 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.460078    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6" event={"ID":"63a627e0-e85e-424b-8314-042649f6db41","Type":"ContainerDied","Data":"3d1109d30d949631fb712a9cbf1883163c29f3a83e024259ac1bfd16ee71c9ed"}
Sep 08 15:25:49.462791 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.462764    2556 generic.go:356] "Generic (PLEG): container finished" podID="d11199ba-e3bf-4336-836f-ab2bbdd2bc5c" containerID="d3c6ca5210fb50be4f6f36091bf1e8cd5b7f86bcdc1e4f0b7cc78c932c1f0db7" exitCode=0
Sep 08 15:25:49.462945 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.462835    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t" event={"ID":"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c","Type":"ContainerDied","Data":"d3c6ca5210fb50be4f6f36091bf1e8cd5b7f86bcdc1e4f0b7cc78c932c1f0db7"}
Sep 08 15:25:49.483381 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.483354    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:49.485737 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.485716    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:49.551719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.551687    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-twmgb\" (UniqueName: \"kubernetes.io/projected/63a627e0-e85e-424b-8314-042649f6db41-kube-api-access-twmgb\") pod \"63a627e0-e85e-424b-8314-042649f6db41\" (UID: \"63a627e0-e85e-424b-8314-042649f6db41\") "
Sep 08 15:25:49.551866 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.551772    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a627e0-e85e-424b-8314-042649f6db41-plugins-config-volume\") pod \"63a627e0-e85e-424b-8314-042649f6db41\" (UID: \"63a627e0-e85e-424b-8314-042649f6db41\") "
Sep 08 15:25:49.551866 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.551794    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-plugins-config-volume\") pod \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\" (UID: \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\") "
Sep 08 15:25:49.551866 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.551810    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gdk4q\" (UniqueName: \"kubernetes.io/projected/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-kube-api-access-gdk4q\") pod \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\" (UID: \"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c\") "
Sep 08 15:25:49.552179 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.552155    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d11199ba-e3bf-4336-836f-ab2bbdd2bc5c" (UID: "d11199ba-e3bf-4336-836f-ab2bbdd2bc5c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:25:49.552179 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.552165    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63a627e0-e85e-424b-8314-042649f6db41-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "63a627e0-e85e-424b-8314-042649f6db41" (UID: "63a627e0-e85e-424b-8314-042649f6db41"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:25:49.553856 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.553831    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-kube-api-access-gdk4q" (OuterVolumeSpecName: "kube-api-access-gdk4q") pod "d11199ba-e3bf-4336-836f-ab2bbdd2bc5c" (UID: "d11199ba-e3bf-4336-836f-ab2bbdd2bc5c"). InnerVolumeSpecName "kube-api-access-gdk4q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:25:49.553856 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.553844    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63a627e0-e85e-424b-8314-042649f6db41-kube-api-access-twmgb" (OuterVolumeSpecName: "kube-api-access-twmgb") pod "63a627e0-e85e-424b-8314-042649f6db41" (UID: "63a627e0-e85e-424b-8314-042649f6db41"). InnerVolumeSpecName "kube-api-access-twmgb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:25:49.652997 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.652963    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/63a627e0-e85e-424b-8314-042649f6db41-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:25:49.652997 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.652990    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:25:49.652997 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.652999    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gdk4q\" (UniqueName: \"kubernetes.io/projected/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c-kube-api-access-gdk4q\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:25:49.653208 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:49.653008    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-twmgb\" (UniqueName: \"kubernetes.io/projected/63a627e0-e85e-424b-8314-042649f6db41-kube-api-access-twmgb\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:25:50.469151 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.469124    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"
Sep 08 15:25:50.469604 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.469151    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6" event={"ID":"63a627e0-e85e-424b-8314-042649f6db41","Type":"ContainerDied","Data":"5c69102ce93e33433064a8cc183a6c1882506ffd1c07b5cb376e71d3b1ce9ff1"}
Sep 08 15:25:50.469604 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.469232    2556 scope.go:117] "RemoveContainer" containerID="3d1109d30d949631fb712a9cbf1883163c29f3a83e024259ac1bfd16ee71c9ed"
Sep 08 15:25:50.471284 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.471264    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"
Sep 08 15:25:50.471284 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.471260    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t" event={"ID":"d11199ba-e3bf-4336-836f-ab2bbdd2bc5c","Type":"ContainerDied","Data":"1c3f6fed4771e434cfecd2f4b18cc90df5831f19dcf584e9c2d8fda73f2b08ea"}
Sep 08 15:25:50.478856 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.478840    2556 scope.go:117] "RemoveContainer" containerID="d3c6ca5210fb50be4f6f36091bf1e8cd5b7f86bcdc1e4f0b7cc78c932c1f0db7"
Sep 08 15:25:50.498923 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.498896    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"]
Sep 08 15:25:50.503123 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.503101    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-eed32982-6475d6c54b-5rv9t"]
Sep 08 15:25:50.514375 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.514346    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"]
Sep 08 15:25:50.518974 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:50.518940    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-eed32982-b6bb5c56c-ghzv6"]
Sep 08 15:25:51.355000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:51.354969    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63a627e0-e85e-424b-8314-042649f6db41" path="/var/lib/kubelet/pods/63a627e0-e85e-424b-8314-042649f6db41/volumes"
Sep 08 15:25:51.355346 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:51.355333    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d11199ba-e3bf-4336-836f-ab2bbdd2bc5c" path="/var/lib/kubelet/pods/d11199ba-e3bf-4336-836f-ab2bbdd2bc5c/volumes"
Sep 08 15:25:54.286434 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286394    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"]
Sep 08 15:25:54.286829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286763    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d11199ba-e3bf-4336-836f-ab2bbdd2bc5c" containerName="payload-pre-processing"
Sep 08 15:25:54.286829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286776    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d11199ba-e3bf-4336-836f-ab2bbdd2bc5c" containerName="payload-pre-processing"
Sep 08 15:25:54.286829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286785    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90fa9710-2310-45f7-81f2-28daaf8a8059" containerName="revoke-keys"
Sep 08 15:25:54.286829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286791    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="90fa9710-2310-45f7-81f2-28daaf8a8059" containerName="revoke-keys"
Sep 08 15:25:54.286829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286801    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63a627e0-e85e-424b-8314-042649f6db41" containerName="payload-processing"
Sep 08 15:25:54.286829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286807    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="63a627e0-e85e-424b-8314-042649f6db41" containerName="payload-processing"
Sep 08 15:25:54.287021 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286881    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="90fa9710-2310-45f7-81f2-28daaf8a8059" containerName="revoke-keys"
Sep 08 15:25:54.287021 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286890    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="63a627e0-e85e-424b-8314-042649f6db41" containerName="payload-processing"
Sep 08 15:25:54.287021 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.286896    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d11199ba-e3bf-4336-836f-ab2bbdd2bc5c" containerName="payload-pre-processing"
Sep 08 15:25:54.289944 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.289927    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:54.292388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.292360    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-c69c6364-dockercfg-8xqm7\""
Sep 08 15:25:54.292504 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.292410    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-c69c6364\""
Sep 08 15:25:54.300748 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.300726    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"]
Sep 08 15:25:54.318259 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.318227    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"]
Sep 08 15:25:54.321132 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.321115    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:54.330783 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.330754    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"]
Sep 08 15:25:54.398527 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.398465    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99lpq\" (UniqueName: \"kubernetes.io/projected/c075f197-623b-43c3-9628-8b8aa551f137-kube-api-access-99lpq\") pod \"payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll\" (UID: \"c075f197-623b-43c3-9628-8b8aa551f137\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:54.398527 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.398519    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c075f197-623b-43c3-9628-8b8aa551f137-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll\" (UID: \"c075f197-623b-43c3-9628-8b8aa551f137\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:54.398814 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.398571    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5547eb64-cd95-451d-9649-bf0d6164f2d8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk\" (UID: \"5547eb64-cd95-451d-9649-bf0d6164f2d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:54.398814 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.398651    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szn5v\" (UniqueName: \"kubernetes.io/projected/5547eb64-cd95-451d-9649-bf0d6164f2d8-kube-api-access-szn5v\") pod \"payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk\" (UID: \"5547eb64-cd95-451d-9649-bf0d6164f2d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:54.499594 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.499561    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99lpq\" (UniqueName: \"kubernetes.io/projected/c075f197-623b-43c3-9628-8b8aa551f137-kube-api-access-99lpq\") pod \"payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll\" (UID: \"c075f197-623b-43c3-9628-8b8aa551f137\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:54.499594 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.499599    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c075f197-623b-43c3-9628-8b8aa551f137-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll\" (UID: \"c075f197-623b-43c3-9628-8b8aa551f137\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:54.499869 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.499631    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5547eb64-cd95-451d-9649-bf0d6164f2d8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk\" (UID: \"5547eb64-cd95-451d-9649-bf0d6164f2d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:54.499869 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.499654    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szn5v\" (UniqueName: \"kubernetes.io/projected/5547eb64-cd95-451d-9649-bf0d6164f2d8-kube-api-access-szn5v\") pod \"payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk\" (UID: \"5547eb64-cd95-451d-9649-bf0d6164f2d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:54.500408 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.500383    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c075f197-623b-43c3-9628-8b8aa551f137-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll\" (UID: \"c075f197-623b-43c3-9628-8b8aa551f137\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:54.500408 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.500400    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5547eb64-cd95-451d-9649-bf0d6164f2d8-plugins-config-volume\") pod \"payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk\" (UID: \"5547eb64-cd95-451d-9649-bf0d6164f2d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:54.508154 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.508131    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szn5v\" (UniqueName: \"kubernetes.io/projected/5547eb64-cd95-451d-9649-bf0d6164f2d8-kube-api-access-szn5v\") pod \"payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk\" (UID: \"5547eb64-cd95-451d-9649-bf0d6164f2d8\") " pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:54.508239 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.508170    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-99lpq\" (UniqueName: \"kubernetes.io/projected/c075f197-623b-43c3-9628-8b8aa551f137-kube-api-access-99lpq\") pod \"payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll\" (UID: \"c075f197-623b-43c3-9628-8b8aa551f137\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:54.601532 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.601495    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:54.631720 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.631688    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:54.881014 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.880977    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"]
Sep 08 15:25:54.881983 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:54.881957    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc075f197_623b_43c3_9628_8b8aa551f137.slice/crio-fdbc6a6b8b6d14364b68f2029eeb59663cf59897026d4eac77f5e26c9a1f7fca WatchSource:0}: Error finding container fdbc6a6b8b6d14364b68f2029eeb59663cf59897026d4eac77f5e26c9a1f7fca: Status 404 returned error can't find the container with id fdbc6a6b8b6d14364b68f2029eeb59663cf59897026d4eac77f5e26c9a1f7fca
Sep 08 15:25:54.914164 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:54.914139    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"]
Sep 08 15:25:54.917312 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:25:54.917279    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5547eb64_cd95_451d_9649_bf0d6164f2d8.slice/crio-f847647cd4495a6800b2634a01ad17e059f134c45b5d55fd4124847836977e4e WatchSource:0}: Error finding container f847647cd4495a6800b2634a01ad17e059f134c45b5d55fd4124847836977e4e: Status 404 returned error can't find the container with id f847647cd4495a6800b2634a01ad17e059f134c45b5d55fd4124847836977e4e
Sep 08 15:25:55.498477 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:55.498430    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll" event={"ID":"c075f197-623b-43c3-9628-8b8aa551f137","Type":"ContainerStarted","Data":"7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7"}
Sep 08 15:25:55.498959 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:55.498501    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll" event={"ID":"c075f197-623b-43c3-9628-8b8aa551f137","Type":"ContainerStarted","Data":"fdbc6a6b8b6d14364b68f2029eeb59663cf59897026d4eac77f5e26c9a1f7fca"}
Sep 08 15:25:55.498959 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:55.498533    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:25:55.500100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:55.500079    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk" event={"ID":"5547eb64-cd95-451d-9649-bf0d6164f2d8","Type":"ContainerStarted","Data":"6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203"}
Sep 08 15:25:55.500205 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:55.500124    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk" event={"ID":"5547eb64-cd95-451d-9649-bf0d6164f2d8","Type":"ContainerStarted","Data":"f847647cd4495a6800b2634a01ad17e059f134c45b5d55fd4124847836977e4e"}
Sep 08 15:25:55.500205 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:55.500194    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:25:55.517411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:55.517359    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll" podStartSLOduration=1.5173390759999998 podStartE2EDuration="1.517339076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:55.512972908 +0000 UTC m=+782.613867020" watchObservedRunningTime="2026-09-08 15:25:55.517339076 +0000 UTC m=+782.618233188"
Sep 08 15:25:55.530711 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:25:55.530639    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk" podStartSLOduration=1.530625214 podStartE2EDuration="1.530625214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:25:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:25:55.529457052 +0000 UTC m=+782.630351165" watchObservedRunningTime="2026-09-08 15:25:55.530625214 +0000 UTC m=+782.631519326"
Sep 08 15:26:06.506774 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:06.506742    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:26:06.507300 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:06.506809    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:26:18.222881 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.222803    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"]
Sep 08 15:26:18.229811 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.229782    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"
Sep 08 15:26:18.232433 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.232407    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:26:18.232560 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.232406    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:26:18.233608 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.233578    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"]
Sep 08 15:26:18.309496 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.309454    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7f70-62e4-4b52-93b1-6880011a6400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l\" (UID: \"d56e7f70-62e4-4b52-93b1-6880011a6400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"
Sep 08 15:26:18.410535 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.410490    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7f70-62e4-4b52-93b1-6880011a6400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l\" (UID: \"d56e7f70-62e4-4b52-93b1-6880011a6400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"
Sep 08 15:26:18.411233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.411213    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7f70-62e4-4b52-93b1-6880011a6400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l\" (UID: \"d56e7f70-62e4-4b52-93b1-6880011a6400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"
Sep 08 15:26:18.543058 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.542952    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"
Sep 08 15:26:18.811051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:18.810999    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"]
Sep 08 15:26:18.813248 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:26:18.813221    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd56e7f70_62e4_4b52_93b1_6880011a6400.slice/crio-50f4ab2059b451afc1eea876068f033e818f22fba7f83deb4570aae80fd517a3 WatchSource:0}: Error finding container 50f4ab2059b451afc1eea876068f033e818f22fba7f83deb4570aae80fd517a3: Status 404 returned error can't find the container with id 50f4ab2059b451afc1eea876068f033e818f22fba7f83deb4570aae80fd517a3
Sep 08 15:26:19.629530 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:19.629495    2556 generic.go:356] "Generic (PLEG): container finished" podID="d56e7f70-62e4-4b52-93b1-6880011a6400" containerID="4e4fb9622c39b8de9187b50b3c17a65019f4f5948e73d23babd7483ecc2faf79" exitCode=0
Sep 08 15:26:19.629903 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:19.629581    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l" event={"ID":"d56e7f70-62e4-4b52-93b1-6880011a6400","Type":"ContainerDied","Data":"4e4fb9622c39b8de9187b50b3c17a65019f4f5948e73d23babd7483ecc2faf79"}
Sep 08 15:26:19.629903 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:19.629637    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l" event={"ID":"d56e7f70-62e4-4b52-93b1-6880011a6400","Type":"ContainerStarted","Data":"50f4ab2059b451afc1eea876068f033e818f22fba7f83deb4570aae80fd517a3"}
Sep 08 15:26:20.764622 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:20.764599    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"
Sep 08 15:26:20.830904 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:20.830876    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7f70-62e4-4b52-93b1-6880011a6400-maas-api-service-ca\") pod \"d56e7f70-62e4-4b52-93b1-6880011a6400\" (UID: \"d56e7f70-62e4-4b52-93b1-6880011a6400\") "
Sep 08 15:26:20.831230 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:20.831209    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d56e7f70-62e4-4b52-93b1-6880011a6400-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d56e7f70-62e4-4b52-93b1-6880011a6400" (UID: "d56e7f70-62e4-4b52-93b1-6880011a6400"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:20.932492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:20.932405    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d56e7f70-62e4-4b52-93b1-6880011a6400-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:21.640815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:21.640727    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"
Sep 08 15:26:21.640815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:21.640761    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l" event={"ID":"d56e7f70-62e4-4b52-93b1-6880011a6400","Type":"ContainerDied","Data":"50f4ab2059b451afc1eea876068f033e818f22fba7f83deb4570aae80fd517a3"}
Sep 08 15:26:21.640815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:21.640810    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="50f4ab2059b451afc1eea876068f033e818f22fba7f83deb4570aae80fd517a3"
Sep 08 15:26:24.817008 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:24.816977    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"]
Sep 08 15:26:24.817382 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:24.817232    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk" podUID="5547eb64-cd95-451d-9649-bf0d6164f2d8" containerName="payload-processing" containerID="cri-o://6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203" gracePeriod=30
Sep 08 15:26:24.826936 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:24.826179    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"]
Sep 08 15:26:24.826936 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:24.826466    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll" podUID="c075f197-623b-43c3-9628-8b8aa551f137" containerName="payload-pre-processing" containerID="cri-o://7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7" gracePeriod=30
Sep 08 15:26:24.961607 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:24.961569    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"]
Sep 08 15:26:24.966558 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:24.966520    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-c69c6364-bmb6l"]
Sep 08 15:26:25.111564 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.111537    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:26:25.149268 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.149235    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:26:25.164004 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.163973    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5547eb64-cd95-451d-9649-bf0d6164f2d8-plugins-config-volume\") pod \"5547eb64-cd95-451d-9649-bf0d6164f2d8\" (UID: \"5547eb64-cd95-451d-9649-bf0d6164f2d8\") "
Sep 08 15:26:25.164171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.164020    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szn5v\" (UniqueName: \"kubernetes.io/projected/5547eb64-cd95-451d-9649-bf0d6164f2d8-kube-api-access-szn5v\") pod \"5547eb64-cd95-451d-9649-bf0d6164f2d8\" (UID: \"5547eb64-cd95-451d-9649-bf0d6164f2d8\") "
Sep 08 15:26:25.164458 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.164427    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5547eb64-cd95-451d-9649-bf0d6164f2d8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5547eb64-cd95-451d-9649-bf0d6164f2d8" (UID: "5547eb64-cd95-451d-9649-bf0d6164f2d8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:25.166097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.166072    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5547eb64-cd95-451d-9649-bf0d6164f2d8-kube-api-access-szn5v" (OuterVolumeSpecName: "kube-api-access-szn5v") pod "5547eb64-cd95-451d-9649-bf0d6164f2d8" (UID: "5547eb64-cd95-451d-9649-bf0d6164f2d8"). InnerVolumeSpecName "kube-api-access-szn5v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:26:25.264600 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.264551    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c075f197-623b-43c3-9628-8b8aa551f137-plugins-config-volume\") pod \"c075f197-623b-43c3-9628-8b8aa551f137\" (UID: \"c075f197-623b-43c3-9628-8b8aa551f137\") "
Sep 08 15:26:25.264813 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.264627    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99lpq\" (UniqueName: \"kubernetes.io/projected/c075f197-623b-43c3-9628-8b8aa551f137-kube-api-access-99lpq\") pod \"c075f197-623b-43c3-9628-8b8aa551f137\" (UID: \"c075f197-623b-43c3-9628-8b8aa551f137\") "
Sep 08 15:26:25.264959 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.264939    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5547eb64-cd95-451d-9649-bf0d6164f2d8-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:25.264959 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.264957    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szn5v\" (UniqueName: \"kubernetes.io/projected/5547eb64-cd95-451d-9649-bf0d6164f2d8-kube-api-access-szn5v\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:25.265112 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.264983    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c075f197-623b-43c3-9628-8b8aa551f137-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c075f197-623b-43c3-9628-8b8aa551f137" (UID: "c075f197-623b-43c3-9628-8b8aa551f137"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:25.266887 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.266853    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c075f197-623b-43c3-9628-8b8aa551f137-kube-api-access-99lpq" (OuterVolumeSpecName: "kube-api-access-99lpq") pod "c075f197-623b-43c3-9628-8b8aa551f137" (UID: "c075f197-623b-43c3-9628-8b8aa551f137"). InnerVolumeSpecName "kube-api-access-99lpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:26:25.355337 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.355238    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d56e7f70-62e4-4b52-93b1-6880011a6400" path="/var/lib/kubelet/pods/d56e7f70-62e4-4b52-93b1-6880011a6400/volumes"
Sep 08 15:26:25.365719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.365570    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c075f197-623b-43c3-9628-8b8aa551f137-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:25.365719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.365592    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99lpq\" (UniqueName: \"kubernetes.io/projected/c075f197-623b-43c3-9628-8b8aa551f137-kube-api-access-99lpq\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:25.661841 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.661742    2556 generic.go:356] "Generic (PLEG): container finished" podID="c075f197-623b-43c3-9628-8b8aa551f137" containerID="7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7" exitCode=0
Sep 08 15:26:25.661841 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.661777    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"
Sep 08 15:26:25.661841 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.661817    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll" event={"ID":"c075f197-623b-43c3-9628-8b8aa551f137","Type":"ContainerDied","Data":"7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7"}
Sep 08 15:26:25.662125 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.661870    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll" event={"ID":"c075f197-623b-43c3-9628-8b8aa551f137","Type":"ContainerDied","Data":"fdbc6a6b8b6d14364b68f2029eeb59663cf59897026d4eac77f5e26c9a1f7fca"}
Sep 08 15:26:25.662125 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.661889    2556 scope.go:117] "RemoveContainer" containerID="7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7"
Sep 08 15:26:25.663566 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.663535    2556 generic.go:356] "Generic (PLEG): container finished" podID="5547eb64-cd95-451d-9649-bf0d6164f2d8" containerID="6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203" exitCode=0
Sep 08 15:26:25.663566 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.663595    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"
Sep 08 15:26:25.663566 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.663599    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk" event={"ID":"5547eb64-cd95-451d-9649-bf0d6164f2d8","Type":"ContainerDied","Data":"6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203"}
Sep 08 15:26:25.663566 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.663651    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk" event={"ID":"5547eb64-cd95-451d-9649-bf0d6164f2d8","Type":"ContainerDied","Data":"f847647cd4495a6800b2634a01ad17e059f134c45b5d55fd4124847836977e4e"}
Sep 08 15:26:25.670886 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.670866    2556 scope.go:117] "RemoveContainer" containerID="7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7"
Sep 08 15:26:25.671166 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:26:25.671146    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7\": container with ID starting with 7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7 not found: ID does not exist" containerID="7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7"
Sep 08 15:26:25.671238 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.671172    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7"} err="failed to get container status \"7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7\": rpc error: code = NotFound desc = could not find container \"7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7\": container with ID starting with 7f4f710a41f999728fc83312100a1ccb5361bd25cc0b775772f18a87723902f7 not found: ID does not exist"
Sep 08 15:26:25.671238 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.671186    2556 scope.go:117] "RemoveContainer" containerID="6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203"
Sep 08 15:26:25.678640 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.678618    2556 scope.go:117] "RemoveContainer" containerID="6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203"
Sep 08 15:26:25.679013 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:26:25.678958    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203\": container with ID starting with 6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203 not found: ID does not exist" containerID="6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203"
Sep 08 15:26:25.679095 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.679019    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203"} err="failed to get container status \"6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203\": rpc error: code = NotFound desc = could not find container \"6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203\": container with ID starting with 6cafeaac76fcba45822a7cd34e552f122f38046b7b07a0623e833cbb08200203 not found: ID does not exist"
Sep 08 15:26:25.681442 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.681417    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"]
Sep 08 15:26:25.683891 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.683869    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-c69c6364-7fccdbb854-8c6zk"]
Sep 08 15:26:25.695986 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.695957    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"]
Sep 08 15:26:25.705514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:25.705487    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-c69c6364-6bc4c6b978-d85ll"]
Sep 08 15:26:27.354280 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:27.354247    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5547eb64-cd95-451d-9649-bf0d6164f2d8" path="/var/lib/kubelet/pods/5547eb64-cd95-451d-9649-bf0d6164f2d8/volumes"
Sep 08 15:26:27.354812 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:27.354792    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c075f197-623b-43c3-9628-8b8aa551f137" path="/var/lib/kubelet/pods/c075f197-623b-43c3-9628-8b8aa551f137/volumes"
Sep 08 15:26:30.232060 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232028    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"]
Sep 08 15:26:30.232434 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232395    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c075f197-623b-43c3-9628-8b8aa551f137" containerName="payload-pre-processing"
Sep 08 15:26:30.232434 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232408    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c075f197-623b-43c3-9628-8b8aa551f137" containerName="payload-pre-processing"
Sep 08 15:26:30.232434 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232420    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5547eb64-cd95-451d-9649-bf0d6164f2d8" containerName="payload-processing"
Sep 08 15:26:30.232434 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232426    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5547eb64-cd95-451d-9649-bf0d6164f2d8" containerName="payload-processing"
Sep 08 15:26:30.232434 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232435    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d56e7f70-62e4-4b52-93b1-6880011a6400" containerName="revoke-keys"
Sep 08 15:26:30.232609 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232440    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d56e7f70-62e4-4b52-93b1-6880011a6400" containerName="revoke-keys"
Sep 08 15:26:30.232609 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232504    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c075f197-623b-43c3-9628-8b8aa551f137" containerName="payload-pre-processing"
Sep 08 15:26:30.232609 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232511    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5547eb64-cd95-451d-9649-bf0d6164f2d8" containerName="payload-processing"
Sep 08 15:26:30.232609 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.232520    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d56e7f70-62e4-4b52-93b1-6880011a6400" containerName="revoke-keys"
Sep 08 15:26:30.237059 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.237042    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:30.252044 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.252021    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ecef8168-dockercfg-6lr92\""
Sep 08 15:26:30.252162 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.252047    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ecef8168\""
Sep 08 15:26:30.253365 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.253342    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"]
Sep 08 15:26:30.271063 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.271041    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"]
Sep 08 15:26:30.275077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.275054    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:30.282272 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.282253    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"]
Sep 08 15:26:30.310181 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.310159    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55c8b572-17ed-45bd-aec5-dca52fac7712-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5\" (UID: \"55c8b572-17ed-45bd-aec5-dca52fac7712\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:30.310293 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.310219    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q52mq\" (UniqueName: \"kubernetes.io/projected/55c8b572-17ed-45bd-aec5-dca52fac7712-kube-api-access-q52mq\") pod \"payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5\" (UID: \"55c8b572-17ed-45bd-aec5-dca52fac7712\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:30.411644 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.411608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba481cb8-d5ab-425c-b0e2-3ca074275573-plugins-config-volume\") pod \"payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb\" (UID: \"ba481cb8-d5ab-425c-b0e2-3ca074275573\") " pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:30.411830 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.411651    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55c8b572-17ed-45bd-aec5-dca52fac7712-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5\" (UID: \"55c8b572-17ed-45bd-aec5-dca52fac7712\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:30.411830 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.411789    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bblxv\" (UniqueName: \"kubernetes.io/projected/ba481cb8-d5ab-425c-b0e2-3ca074275573-kube-api-access-bblxv\") pod \"payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb\" (UID: \"ba481cb8-d5ab-425c-b0e2-3ca074275573\") " pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:30.411830 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.411825    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q52mq\" (UniqueName: \"kubernetes.io/projected/55c8b572-17ed-45bd-aec5-dca52fac7712-kube-api-access-q52mq\") pod \"payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5\" (UID: \"55c8b572-17ed-45bd-aec5-dca52fac7712\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:30.412388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.412364    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55c8b572-17ed-45bd-aec5-dca52fac7712-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5\" (UID: \"55c8b572-17ed-45bd-aec5-dca52fac7712\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:30.419125 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.419101    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q52mq\" (UniqueName: \"kubernetes.io/projected/55c8b572-17ed-45bd-aec5-dca52fac7712-kube-api-access-q52mq\") pod \"payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5\" (UID: \"55c8b572-17ed-45bd-aec5-dca52fac7712\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:30.512517 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.512433    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba481cb8-d5ab-425c-b0e2-3ca074275573-plugins-config-volume\") pod \"payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb\" (UID: \"ba481cb8-d5ab-425c-b0e2-3ca074275573\") " pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:30.512638 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.512539    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bblxv\" (UniqueName: \"kubernetes.io/projected/ba481cb8-d5ab-425c-b0e2-3ca074275573-kube-api-access-bblxv\") pod \"payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb\" (UID: \"ba481cb8-d5ab-425c-b0e2-3ca074275573\") " pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:30.513135 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.513114    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba481cb8-d5ab-425c-b0e2-3ca074275573-plugins-config-volume\") pod \"payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb\" (UID: \"ba481cb8-d5ab-425c-b0e2-3ca074275573\") " pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:30.519932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.519907    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bblxv\" (UniqueName: \"kubernetes.io/projected/ba481cb8-d5ab-425c-b0e2-3ca074275573-kube-api-access-bblxv\") pod \"payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb\" (UID: \"ba481cb8-d5ab-425c-b0e2-3ca074275573\") " pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:30.549646 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.549623    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:30.587254 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.587219    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:30.829852 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.829736    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"]
Sep 08 15:26:30.832549 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:26:30.832522    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55c8b572_17ed_45bd_aec5_dca52fac7712.slice/crio-52f101b0ce5edcd19cd519dba813937eea4efb953c2c313b5b74a38d4387ebf0 WatchSource:0}: Error finding container 52f101b0ce5edcd19cd519dba813937eea4efb953c2c313b5b74a38d4387ebf0: Status 404 returned error can't find the container with id 52f101b0ce5edcd19cd519dba813937eea4efb953c2c313b5b74a38d4387ebf0
Sep 08 15:26:30.867646 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:30.867622    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"]
Sep 08 15:26:30.869321 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:26:30.869289    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba481cb8_d5ab_425c_b0e2_3ca074275573.slice/crio-e2b974377535c8c776b5021bcb1a9fa9e2a34999a5bbc0a0cc2b50aacc7bfd00 WatchSource:0}: Error finding container e2b974377535c8c776b5021bcb1a9fa9e2a34999a5bbc0a0cc2b50aacc7bfd00: Status 404 returned error can't find the container with id e2b974377535c8c776b5021bcb1a9fa9e2a34999a5bbc0a0cc2b50aacc7bfd00
Sep 08 15:26:31.702019 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:31.701982    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5" event={"ID":"55c8b572-17ed-45bd-aec5-dca52fac7712","Type":"ContainerStarted","Data":"2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4"}
Sep 08 15:26:31.702472 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:31.702075    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5" event={"ID":"55c8b572-17ed-45bd-aec5-dca52fac7712","Type":"ContainerStarted","Data":"52f101b0ce5edcd19cd519dba813937eea4efb953c2c313b5b74a38d4387ebf0"}
Sep 08 15:26:31.702472 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:31.702106    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:31.703733 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:31.703703    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb" event={"ID":"ba481cb8-d5ab-425c-b0e2-3ca074275573","Type":"ContainerStarted","Data":"1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a"}
Sep 08 15:26:31.703895 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:31.703748    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb" event={"ID":"ba481cb8-d5ab-425c-b0e2-3ca074275573","Type":"ContainerStarted","Data":"e2b974377535c8c776b5021bcb1a9fa9e2a34999a5bbc0a0cc2b50aacc7bfd00"}
Sep 08 15:26:31.703895 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:31.703795    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:31.718498 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:31.718454    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5" podStartSLOduration=1.7184424950000001 podStartE2EDuration="1.718442495s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:31.717128736 +0000 UTC m=+818.818022847" watchObservedRunningTime="2026-09-08 15:26:31.718442495 +0000 UTC m=+818.819336606"
Sep 08 15:26:31.732250 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:31.732211    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb" podStartSLOduration=1.732199295 podStartE2EDuration="1.732199295s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:31.731754309 +0000 UTC m=+818.832648421" watchObservedRunningTime="2026-09-08 15:26:31.732199295 +0000 UTC m=+818.833093445"
Sep 08 15:26:42.710805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:42.710771    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:26:42.711218 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:42.710853    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:26:43.792306 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:43.792272    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"]
Sep 08 15:26:43.795826 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:43.795809    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"
Sep 08 15:26:43.797981 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:43.797957    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:26:43.798097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:43.798027    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:26:43.802271 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:43.802245    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"]
Sep 08 15:26:43.928965 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:43.928928    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367c222f-9ac3-4494-887f-c3a61935f150-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-98d03a-vjs76\" (UID: \"367c222f-9ac3-4494-887f-c3a61935f150\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"
Sep 08 15:26:44.030488 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:44.030441    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367c222f-9ac3-4494-887f-c3a61935f150-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-98d03a-vjs76\" (UID: \"367c222f-9ac3-4494-887f-c3a61935f150\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"
Sep 08 15:26:44.031138 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:44.031111    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367c222f-9ac3-4494-887f-c3a61935f150-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-98d03a-vjs76\" (UID: \"367c222f-9ac3-4494-887f-c3a61935f150\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"
Sep 08 15:26:44.108322 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:44.108297    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"
Sep 08 15:26:44.379043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:44.379020    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"]
Sep 08 15:26:44.381306 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:26:44.381282    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod367c222f_9ac3_4494_887f_c3a61935f150.slice/crio-794b2bba1e030d59d9a5fd82eaf88800efb2ad0781cf460c9f8a136e874508a2 WatchSource:0}: Error finding container 794b2bba1e030d59d9a5fd82eaf88800efb2ad0781cf460c9f8a136e874508a2: Status 404 returned error can't find the container with id 794b2bba1e030d59d9a5fd82eaf88800efb2ad0781cf460c9f8a136e874508a2
Sep 08 15:26:44.770731 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:44.770632    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76" event={"ID":"367c222f-9ac3-4494-887f-c3a61935f150","Type":"ContainerStarted","Data":"7f3b0c11ebcc8431a66969d694a9d2a47750a2278d5135a0179a54ab2415a3b0"}
Sep 08 15:26:44.770731 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:44.770701    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76" event={"ID":"367c222f-9ac3-4494-887f-c3a61935f150","Type":"ContainerStarted","Data":"794b2bba1e030d59d9a5fd82eaf88800efb2ad0781cf460c9f8a136e874508a2"}
Sep 08 15:26:44.786070 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:44.786019    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76" podStartSLOduration=1.786003293 podStartE2EDuration="1.786003293s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:26:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:26:44.784499982 +0000 UTC m=+831.885394093" watchObservedRunningTime="2026-09-08 15:26:44.786003293 +0000 UTC m=+831.886897404"
Sep 08 15:26:45.777435 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:45.777401    2556 generic.go:356] "Generic (PLEG): container finished" podID="367c222f-9ac3-4494-887f-c3a61935f150" containerID="7f3b0c11ebcc8431a66969d694a9d2a47750a2278d5135a0179a54ab2415a3b0" exitCode=0
Sep 08 15:26:45.777802 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:45.777440    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76" event={"ID":"367c222f-9ac3-4494-887f-c3a61935f150","Type":"ContainerDied","Data":"7f3b0c11ebcc8431a66969d694a9d2a47750a2278d5135a0179a54ab2415a3b0"}
Sep 08 15:26:46.915128 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:46.915103    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"
Sep 08 15:26:47.059050 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:47.058956    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367c222f-9ac3-4494-887f-c3a61935f150-maas-api-service-ca\") pod \"367c222f-9ac3-4494-887f-c3a61935f150\" (UID: \"367c222f-9ac3-4494-887f-c3a61935f150\") "
Sep 08 15:26:47.059335 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:47.059315    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/367c222f-9ac3-4494-887f-c3a61935f150-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "367c222f-9ac3-4494-887f-c3a61935f150" (UID: "367c222f-9ac3-4494-887f-c3a61935f150"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:47.160517 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:47.160486    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/367c222f-9ac3-4494-887f-c3a61935f150-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:47.788288 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:47.788210    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"
Sep 08 15:26:47.788425 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:47.788210    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76" event={"ID":"367c222f-9ac3-4494-887f-c3a61935f150","Type":"ContainerDied","Data":"794b2bba1e030d59d9a5fd82eaf88800efb2ad0781cf460c9f8a136e874508a2"}
Sep 08 15:26:47.788425 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:47.788337    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="794b2bba1e030d59d9a5fd82eaf88800efb2ad0781cf460c9f8a136e874508a2"
Sep 08 15:26:54.026805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.024043    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"]
Sep 08 15:26:54.026805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.024943    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="367c222f-9ac3-4494-887f-c3a61935f150" containerName="revoke-keys"
Sep 08 15:26:54.026805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.024964    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="367c222f-9ac3-4494-887f-c3a61935f150" containerName="revoke-keys"
Sep 08 15:26:54.026805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.025155    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="367c222f-9ac3-4494-887f-c3a61935f150" containerName="revoke-keys"
Sep 08 15:26:54.030468 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.030441    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"
Sep 08 15:26:54.032428 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.032400    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"]
Sep 08 15:26:54.033126 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.033105    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:26:54.033247 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.033151    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:26:54.119936 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.119895    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d55d8-eb12-4852-a463-44e2cb273d3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ecef8168-44zjs\" (UID: \"7b5d55d8-eb12-4852-a463-44e2cb273d3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"
Sep 08 15:26:54.220466 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.220431    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d55d8-eb12-4852-a463-44e2cb273d3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ecef8168-44zjs\" (UID: \"7b5d55d8-eb12-4852-a463-44e2cb273d3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"
Sep 08 15:26:54.221093 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.221072    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d55d8-eb12-4852-a463-44e2cb273d3f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ecef8168-44zjs\" (UID: \"7b5d55d8-eb12-4852-a463-44e2cb273d3f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"
Sep 08 15:26:54.343964 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.343926    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"
Sep 08 15:26:54.628695 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.628607    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"]
Sep 08 15:26:54.631685 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:26:54.631646    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5d55d8_eb12_4852_a463_44e2cb273d3f.slice/crio-a097dc5b379b9f03606df444116ca14295021a492963f4a23c2877045f1e34f8 WatchSource:0}: Error finding container a097dc5b379b9f03606df444116ca14295021a492963f4a23c2877045f1e34f8: Status 404 returned error can't find the container with id a097dc5b379b9f03606df444116ca14295021a492963f4a23c2877045f1e34f8
Sep 08 15:26:54.823529 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:54.823495    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs" event={"ID":"7b5d55d8-eb12-4852-a463-44e2cb273d3f","Type":"ContainerStarted","Data":"a097dc5b379b9f03606df444116ca14295021a492963f4a23c2877045f1e34f8"}
Sep 08 15:26:55.539477 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.539439    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"]
Sep 08 15:26:55.539941 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.539725    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r" podUID="870855e0-341d-42d1-8fee-0b14b28f9824" containerName="payload-processing" containerID="cri-o://60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd" gracePeriod=30
Sep 08 15:26:55.547932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.547900    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"]
Sep 08 15:26:55.548162 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.548135    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw" podUID="a6df8a95-badb-48d7-bef6-3482ea602579" containerName="payload-pre-processing" containerID="cri-o://634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0" gracePeriod=30
Sep 08 15:26:55.689924 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.689825    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"]
Sep 08 15:26:55.693070 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.692219    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-98d03a-vjs76"]
Sep 08 15:26:55.799509 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.799479    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:26:55.820421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.820399    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:26:55.830760 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.830726    2556 generic.go:356] "Generic (PLEG): container finished" podID="a6df8a95-badb-48d7-bef6-3482ea602579" containerID="634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0" exitCode=0
Sep 08 15:26:55.830907 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.830766    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"
Sep 08 15:26:55.830907 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.830813    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw" event={"ID":"a6df8a95-badb-48d7-bef6-3482ea602579","Type":"ContainerDied","Data":"634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0"}
Sep 08 15:26:55.830907 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.830873    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw" event={"ID":"a6df8a95-badb-48d7-bef6-3482ea602579","Type":"ContainerDied","Data":"6ee843953b8c36f5a53771784b5df2b17fc7c5aa2f1ce083d9d435acf75ec496"}
Sep 08 15:26:55.830907 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.830903    2556 scope.go:117] "RemoveContainer" containerID="634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0"
Sep 08 15:26:55.832200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.832180    2556 generic.go:356] "Generic (PLEG): container finished" podID="870855e0-341d-42d1-8fee-0b14b28f9824" containerID="60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd" exitCode=0
Sep 08 15:26:55.832286 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.832273    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"
Sep 08 15:26:55.832382 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.832364    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r" event={"ID":"870855e0-341d-42d1-8fee-0b14b28f9824","Type":"ContainerDied","Data":"60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd"}
Sep 08 15:26:55.832438 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.832403    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r" event={"ID":"870855e0-341d-42d1-8fee-0b14b28f9824","Type":"ContainerDied","Data":"10b86caa0e68944454b441545d42c7ddbe8a0bfd0d0d6b73dd6114786149a862"}
Sep 08 15:26:55.834058 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.834036    2556 generic.go:356] "Generic (PLEG): container finished" podID="7b5d55d8-eb12-4852-a463-44e2cb273d3f" containerID="01d701b851aaa1a789a11eb477e0d8806393bcfb8834f0e691056c65a1169d9e" exitCode=0
Sep 08 15:26:55.834172 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.834109    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs" event={"ID":"7b5d55d8-eb12-4852-a463-44e2cb273d3f","Type":"ContainerDied","Data":"01d701b851aaa1a789a11eb477e0d8806393bcfb8834f0e691056c65a1169d9e"}
Sep 08 15:26:55.841781 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.841759    2556 scope.go:117] "RemoveContainer" containerID="634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0"
Sep 08 15:26:55.842221 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:26:55.842180    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0\": container with ID starting with 634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0 not found: ID does not exist" containerID="634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0"
Sep 08 15:26:55.842347 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.842216    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0"} err="failed to get container status \"634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0\": rpc error: code = NotFound desc = could not find container \"634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0\": container with ID starting with 634f690de196cf07e771e541cda973215c4d7980e1160ebf170a2a08bfe29ac0 not found: ID does not exist"
Sep 08 15:26:55.842347 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.842242    2556 scope.go:117] "RemoveContainer" containerID="60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd"
Sep 08 15:26:55.851623 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.851600    2556 scope.go:117] "RemoveContainer" containerID="60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd"
Sep 08 15:26:55.851964 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:26:55.851926    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd\": container with ID starting with 60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd not found: ID does not exist" containerID="60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd"
Sep 08 15:26:55.852033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.851977    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd"} err="failed to get container status \"60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd\": rpc error: code = NotFound desc = could not find container \"60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd\": container with ID starting with 60f9a00930057105bf8a369071d7516b4d0839ab69d5e42ffde3f12479c3e5fd not found: ID does not exist"
Sep 08 15:26:55.937183 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.937152    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b6n9q\" (UniqueName: \"kubernetes.io/projected/a6df8a95-badb-48d7-bef6-3482ea602579-kube-api-access-b6n9q\") pod \"a6df8a95-badb-48d7-bef6-3482ea602579\" (UID: \"a6df8a95-badb-48d7-bef6-3482ea602579\") "
Sep 08 15:26:55.937183 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.937186    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870855e0-341d-42d1-8fee-0b14b28f9824-plugins-config-volume\") pod \"870855e0-341d-42d1-8fee-0b14b28f9824\" (UID: \"870855e0-341d-42d1-8fee-0b14b28f9824\") "
Sep 08 15:26:55.937420 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.937255    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xclwj\" (UniqueName: \"kubernetes.io/projected/870855e0-341d-42d1-8fee-0b14b28f9824-kube-api-access-xclwj\") pod \"870855e0-341d-42d1-8fee-0b14b28f9824\" (UID: \"870855e0-341d-42d1-8fee-0b14b28f9824\") "
Sep 08 15:26:55.937420 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.937282    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6df8a95-badb-48d7-bef6-3482ea602579-plugins-config-volume\") pod \"a6df8a95-badb-48d7-bef6-3482ea602579\" (UID: \"a6df8a95-badb-48d7-bef6-3482ea602579\") "
Sep 08 15:26:55.937685 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.937631    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/870855e0-341d-42d1-8fee-0b14b28f9824-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "870855e0-341d-42d1-8fee-0b14b28f9824" (UID: "870855e0-341d-42d1-8fee-0b14b28f9824"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:55.937685 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.937650    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6df8a95-badb-48d7-bef6-3482ea602579-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a6df8a95-badb-48d7-bef6-3482ea602579" (UID: "a6df8a95-badb-48d7-bef6-3482ea602579"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:55.939297 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.939269    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6df8a95-badb-48d7-bef6-3482ea602579-kube-api-access-b6n9q" (OuterVolumeSpecName: "kube-api-access-b6n9q") pod "a6df8a95-badb-48d7-bef6-3482ea602579" (UID: "a6df8a95-badb-48d7-bef6-3482ea602579"). InnerVolumeSpecName "kube-api-access-b6n9q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:26:55.939467 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:55.939451    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/870855e0-341d-42d1-8fee-0b14b28f9824-kube-api-access-xclwj" (OuterVolumeSpecName: "kube-api-access-xclwj") pod "870855e0-341d-42d1-8fee-0b14b28f9824" (UID: "870855e0-341d-42d1-8fee-0b14b28f9824"). InnerVolumeSpecName "kube-api-access-xclwj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:26:56.038290 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.038203    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a6df8a95-badb-48d7-bef6-3482ea602579-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:56.038290 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.038233    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b6n9q\" (UniqueName: \"kubernetes.io/projected/a6df8a95-badb-48d7-bef6-3482ea602579-kube-api-access-b6n9q\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:56.038290 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.038243    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/870855e0-341d-42d1-8fee-0b14b28f9824-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:56.038290 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.038253    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xclwj\" (UniqueName: \"kubernetes.io/projected/870855e0-341d-42d1-8fee-0b14b28f9824-kube-api-access-xclwj\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:56.154105 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.154072    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"]
Sep 08 15:26:56.160097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.160070    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-98d03a-6c76d88d79-f4d4r"]
Sep 08 15:26:56.169031 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.169007    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"]
Sep 08 15:26:56.172747 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.172725    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-98d03a-9b9b49c5d-hrvnw"]
Sep 08 15:26:56.975271 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:56.975238    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"
Sep 08 15:26:57.149480 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.149392    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d55d8-eb12-4852-a463-44e2cb273d3f-maas-api-service-ca\") pod \"7b5d55d8-eb12-4852-a463-44e2cb273d3f\" (UID: \"7b5d55d8-eb12-4852-a463-44e2cb273d3f\") "
Sep 08 15:26:57.149744 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.149720    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b5d55d8-eb12-4852-a463-44e2cb273d3f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7b5d55d8-eb12-4852-a463-44e2cb273d3f" (UID: "7b5d55d8-eb12-4852-a463-44e2cb273d3f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:26:57.250459 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.250417    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b5d55d8-eb12-4852-a463-44e2cb273d3f-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:26:57.354042 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.354008    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="367c222f-9ac3-4494-887f-c3a61935f150" path="/var/lib/kubelet/pods/367c222f-9ac3-4494-887f-c3a61935f150/volumes"
Sep 08 15:26:57.354348 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.354334    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="870855e0-341d-42d1-8fee-0b14b28f9824" path="/var/lib/kubelet/pods/870855e0-341d-42d1-8fee-0b14b28f9824/volumes"
Sep 08 15:26:57.354646 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.354634    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6df8a95-badb-48d7-bef6-3482ea602579" path="/var/lib/kubelet/pods/a6df8a95-badb-48d7-bef6-3482ea602579/volumes"
Sep 08 15:26:57.852474 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.852439    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"
Sep 08 15:26:57.852474 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.852463    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs" event={"ID":"7b5d55d8-eb12-4852-a463-44e2cb273d3f","Type":"ContainerDied","Data":"a097dc5b379b9f03606df444116ca14295021a492963f4a23c2877045f1e34f8"}
Sep 08 15:26:57.852817 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:26:57.852507    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a097dc5b379b9f03606df444116ca14295021a492963f4a23c2877045f1e34f8"
Sep 08 15:27:00.213505 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.213475    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"]
Sep 08 15:27:00.213960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.213743    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb" podUID="ba481cb8-d5ab-425c-b0e2-3ca074275573" containerName="payload-processing" containerID="cri-o://1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a" gracePeriod=30
Sep 08 15:27:00.222622 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.222410    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"]
Sep 08 15:27:00.222752 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.222613    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5" podUID="55c8b572-17ed-45bd-aec5-dca52fac7712" containerName="payload-pre-processing" containerID="cri-o://2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4" gracePeriod=30
Sep 08 15:27:00.369573 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.369538    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"]
Sep 08 15:27:00.374151 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.374124    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ecef8168-44zjs"]
Sep 08 15:27:00.502663 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.502640    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:27:00.515562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.515543    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:27:00.578456 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.578428    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q52mq\" (UniqueName: \"kubernetes.io/projected/55c8b572-17ed-45bd-aec5-dca52fac7712-kube-api-access-q52mq\") pod \"55c8b572-17ed-45bd-aec5-dca52fac7712\" (UID: \"55c8b572-17ed-45bd-aec5-dca52fac7712\") "
Sep 08 15:27:00.578642 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.578466    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55c8b572-17ed-45bd-aec5-dca52fac7712-plugins-config-volume\") pod \"55c8b572-17ed-45bd-aec5-dca52fac7712\" (UID: \"55c8b572-17ed-45bd-aec5-dca52fac7712\") "
Sep 08 15:27:00.578642 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.578495    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bblxv\" (UniqueName: \"kubernetes.io/projected/ba481cb8-d5ab-425c-b0e2-3ca074275573-kube-api-access-bblxv\") pod \"ba481cb8-d5ab-425c-b0e2-3ca074275573\" (UID: \"ba481cb8-d5ab-425c-b0e2-3ca074275573\") "
Sep 08 15:27:00.578642 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.578543    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba481cb8-d5ab-425c-b0e2-3ca074275573-plugins-config-volume\") pod \"ba481cb8-d5ab-425c-b0e2-3ca074275573\" (UID: \"ba481cb8-d5ab-425c-b0e2-3ca074275573\") "
Sep 08 15:27:00.578959 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.578921    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55c8b572-17ed-45bd-aec5-dca52fac7712-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "55c8b572-17ed-45bd-aec5-dca52fac7712" (UID: "55c8b572-17ed-45bd-aec5-dca52fac7712"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:00.579046 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.578999    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba481cb8-d5ab-425c-b0e2-3ca074275573-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba481cb8-d5ab-425c-b0e2-3ca074275573" (UID: "ba481cb8-d5ab-425c-b0e2-3ca074275573"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:00.580537 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.580518    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55c8b572-17ed-45bd-aec5-dca52fac7712-kube-api-access-q52mq" (OuterVolumeSpecName: "kube-api-access-q52mq") pod "55c8b572-17ed-45bd-aec5-dca52fac7712" (UID: "55c8b572-17ed-45bd-aec5-dca52fac7712"). InnerVolumeSpecName "kube-api-access-q52mq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:00.580705 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.580680    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba481cb8-d5ab-425c-b0e2-3ca074275573-kube-api-access-bblxv" (OuterVolumeSpecName: "kube-api-access-bblxv") pod "ba481cb8-d5ab-425c-b0e2-3ca074275573" (UID: "ba481cb8-d5ab-425c-b0e2-3ca074275573"). InnerVolumeSpecName "kube-api-access-bblxv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:00.679107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.679080    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q52mq\" (UniqueName: \"kubernetes.io/projected/55c8b572-17ed-45bd-aec5-dca52fac7712-kube-api-access-q52mq\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:00.679107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.679101    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/55c8b572-17ed-45bd-aec5-dca52fac7712-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:00.679107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.679111    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bblxv\" (UniqueName: \"kubernetes.io/projected/ba481cb8-d5ab-425c-b0e2-3ca074275573-kube-api-access-bblxv\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:00.679309 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.679122    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba481cb8-d5ab-425c-b0e2-3ca074275573-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:00.868900 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.868861    2556 generic.go:356] "Generic (PLEG): container finished" podID="ba481cb8-d5ab-425c-b0e2-3ca074275573" containerID="1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a" exitCode=0
Sep 08 15:27:00.869068 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.868908    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"
Sep 08 15:27:00.869068 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.868939    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb" event={"ID":"ba481cb8-d5ab-425c-b0e2-3ca074275573","Type":"ContainerDied","Data":"1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a"}
Sep 08 15:27:00.869068 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.869000    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb" event={"ID":"ba481cb8-d5ab-425c-b0e2-3ca074275573","Type":"ContainerDied","Data":"e2b974377535c8c776b5021bcb1a9fa9e2a34999a5bbc0a0cc2b50aacc7bfd00"}
Sep 08 15:27:00.869068 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.869031    2556 scope.go:117] "RemoveContainer" containerID="1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a"
Sep 08 15:27:00.870453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.870427    2556 generic.go:356] "Generic (PLEG): container finished" podID="55c8b572-17ed-45bd-aec5-dca52fac7712" containerID="2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4" exitCode=0
Sep 08 15:27:00.870586 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.870457    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5" event={"ID":"55c8b572-17ed-45bd-aec5-dca52fac7712","Type":"ContainerDied","Data":"2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4"}
Sep 08 15:27:00.870586 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.870482    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"
Sep 08 15:27:00.870586 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.870488    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5" event={"ID":"55c8b572-17ed-45bd-aec5-dca52fac7712","Type":"ContainerDied","Data":"52f101b0ce5edcd19cd519dba813937eea4efb953c2c313b5b74a38d4387ebf0"}
Sep 08 15:27:00.878144 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.878114    2556 scope.go:117] "RemoveContainer" containerID="1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a"
Sep 08 15:27:00.878559 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:27:00.878411    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a\": container with ID starting with 1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a not found: ID does not exist" containerID="1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a"
Sep 08 15:27:00.878559 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.878447    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a"} err="failed to get container status \"1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a\": rpc error: code = NotFound desc = could not find container \"1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a\": container with ID starting with 1ba0b864560e74fb5e339f59bc34f34d62e72b9bccee421daec0fe5e38f95b6a not found: ID does not exist"
Sep 08 15:27:00.878559 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.878469    2556 scope.go:117] "RemoveContainer" containerID="2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4"
Sep 08 15:27:00.887274 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.887260    2556 scope.go:117] "RemoveContainer" containerID="2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4"
Sep 08 15:27:00.887527 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:27:00.887512    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4\": container with ID starting with 2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4 not found: ID does not exist" containerID="2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4"
Sep 08 15:27:00.887579 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.887532    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4"} err="failed to get container status \"2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4\": rpc error: code = NotFound desc = could not find container \"2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4\": container with ID starting with 2949638ec5c4070e5ef1e97216d7d118f9fef533667126dc96c85dc3e42c2bb4 not found: ID does not exist"
Sep 08 15:27:00.903948 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.903927    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"]
Sep 08 15:27:00.924568 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.924537    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-ecef8168-65fb4cc54-jlsn5"]
Sep 08 15:27:00.943267 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.943241    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"]
Sep 08 15:27:00.954919 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:00.954899    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ecef8168-85ccc57df5-qn8zb"]
Sep 08 15:27:01.354503 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:01.354465    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55c8b572-17ed-45bd-aec5-dca52fac7712" path="/var/lib/kubelet/pods/55c8b572-17ed-45bd-aec5-dca52fac7712/volumes"
Sep 08 15:27:01.354848 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:01.354821    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5d55d8-eb12-4852-a463-44e2cb273d3f" path="/var/lib/kubelet/pods/7b5d55d8-eb12-4852-a463-44e2cb273d3f/volumes"
Sep 08 15:27:01.355143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:01.355129    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba481cb8-d5ab-425c-b0e2-3ca074275573" path="/var/lib/kubelet/pods/ba481cb8-d5ab-425c-b0e2-3ca074275573/volumes"
Sep 08 15:27:02.171485 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171442    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"]
Sep 08 15:27:02.171922 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171895    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="870855e0-341d-42d1-8fee-0b14b28f9824" containerName="payload-processing"
Sep 08 15:27:02.171922 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171920    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="870855e0-341d-42d1-8fee-0b14b28f9824" containerName="payload-processing"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171955    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6df8a95-badb-48d7-bef6-3482ea602579" containerName="payload-pre-processing"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171962    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6df8a95-badb-48d7-bef6-3482ea602579" containerName="payload-pre-processing"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171969    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5d55d8-eb12-4852-a463-44e2cb273d3f" containerName="revoke-keys"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171975    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5d55d8-eb12-4852-a463-44e2cb273d3f" containerName="revoke-keys"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171982    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55c8b572-17ed-45bd-aec5-dca52fac7712" containerName="payload-pre-processing"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171989    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="55c8b572-17ed-45bd-aec5-dca52fac7712" containerName="payload-pre-processing"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.171995    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba481cb8-d5ab-425c-b0e2-3ca074275573" containerName="payload-processing"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.172000    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba481cb8-d5ab-425c-b0e2-3ca074275573" containerName="payload-processing"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.172072    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a6df8a95-badb-48d7-bef6-3482ea602579" containerName="payload-pre-processing"
Sep 08 15:27:02.172077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.172080    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="870855e0-341d-42d1-8fee-0b14b28f9824" containerName="payload-processing"
Sep 08 15:27:02.172423 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.172088    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="55c8b572-17ed-45bd-aec5-dca52fac7712" containerName="payload-pre-processing"
Sep 08 15:27:02.172423 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.172094    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba481cb8-d5ab-425c-b0e2-3ca074275573" containerName="payload-processing"
Sep 08 15:27:02.172423 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.172100    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5d55d8-eb12-4852-a463-44e2cb273d3f" containerName="revoke-keys"
Sep 08 15:27:02.176401 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.176377    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.178731 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.178712    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b5aeacc1-openshift-default-dockercfg-n7qgn\""
Sep 08 15:27:02.186318 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.186294    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"]
Sep 08 15:27:02.187537 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.187513    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-data\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.187634 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.187565    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-podinfo\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.187634 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.187600    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-token\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.187634 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.187622    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b7b9df3-7c6a-49ce-8923-19d85199d659-istiod-ca-cert\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.187883 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.187861    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-certs\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.187947 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.187920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-credential-socket\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.188004 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.187944    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-envoy\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.188057 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.188015    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g88hx\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-kube-api-access-g88hx\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.188111 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.188073    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-socket\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.288628 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288583    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-data\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.288797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288643    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-podinfo\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.288797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288690    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-token\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.288797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288707    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b7b9df3-7c6a-49ce-8923-19d85199d659-istiod-ca-cert\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.288797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288739    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-certs\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.288797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-credential-socket\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.289051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-envoy\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.289051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288849    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g88hx\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-kube-api-access-g88hx\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.289051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.288893    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-socket\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.289214 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.289042    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-data\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.289214 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.289182    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-certs\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.289318 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.289249    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-credential-socket\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.289432 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.289416    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-socket\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.289477 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.289424    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b7b9df3-7c6a-49ce-8923-19d85199d659-istiod-ca-cert\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.291167 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.291149    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-envoy\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.291227 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.291190    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-podinfo\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.299000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.298969    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g88hx\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-kube-api-access-g88hx\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.299088 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.299020    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-token\") pod \"e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") " pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.487903 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.487822    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:02.762171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.762133    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"]
Sep 08 15:27:02.764420 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:27:02.764394    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b7b9df3_7c6a_49ce_8923_19d85199d659.slice/crio-61cbbca77e1c17bb67791e71d6d33c54dffd73c3ed5c136059e9cfa9f66688ec WatchSource:0}: Error finding container 61cbbca77e1c17bb67791e71d6d33c54dffd73c3ed5c136059e9cfa9f66688ec: Status 404 returned error can't find the container with id 61cbbca77e1c17bb67791e71d6d33c54dffd73c3ed5c136059e9cfa9f66688ec
Sep 08 15:27:02.766792 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.766758    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:27:02.766883 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.766822    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:27:02.766883 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.766849    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:27:02.885146 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.885113    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" event={"ID":"0b7b9df3-7c6a-49ce-8923-19d85199d659","Type":"ContainerStarted","Data":"cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21"}
Sep 08 15:27:02.885318 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.885171    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" event={"ID":"0b7b9df3-7c6a-49ce-8923-19d85199d659","Type":"ContainerStarted","Data":"61cbbca77e1c17bb67791e71d6d33c54dffd73c3ed5c136059e9cfa9f66688ec"}
Sep 08 15:27:02.903706 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:02.903627    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" podStartSLOduration=0.903611527 podStartE2EDuration="903.611527ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:02.901895051 +0000 UTC m=+850.002789175" watchObservedRunningTime="2026-09-08 15:27:02.903611527 +0000 UTC m=+850.004505690"
Sep 08 15:27:03.488023 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:03.487981    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:03.493015 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:03.492989    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:03.890283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:03.890254    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:03.891176 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:03.891155    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:06.165271 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.165235    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"]
Sep 08 15:27:06.168550 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.168533    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.172233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.172212    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-b5aeacc1-dockercfg-clhk7\""
Sep 08 15:27:06.172455 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.172442    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-b5aeacc1\""
Sep 08 15:27:06.186082 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.186062    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"]
Sep 08 15:27:06.221476 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.221447    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg2m5\" (UniqueName: \"kubernetes.io/projected/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-kube-api-access-jg2m5\") pod \"payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl\" (UID: \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\") " pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.221573 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.221502    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-plugins-config-volume\") pod \"payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl\" (UID: \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\") " pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.322818 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.322783    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg2m5\" (UniqueName: \"kubernetes.io/projected/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-kube-api-access-jg2m5\") pod \"payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl\" (UID: \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\") " pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.322979 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.322844    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-plugins-config-volume\") pod \"payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl\" (UID: \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\") " pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.323526 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.323505    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-plugins-config-volume\") pod \"payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl\" (UID: \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\") " pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.330219 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.330194    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg2m5\" (UniqueName: \"kubernetes.io/projected/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-kube-api-access-jg2m5\") pod \"payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl\" (UID: \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\") " pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.478752 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.478676    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.749834 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.749805    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"]
Sep 08 15:27:06.752268 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:27:06.752235    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaf4dfb0_4202_4a48_bc9f_fcc604a0e334.slice/crio-6efaee5c79176ce54a1933589bbc831722935f0c0a82a0590bc1bea616530435 WatchSource:0}: Error finding container 6efaee5c79176ce54a1933589bbc831722935f0c0a82a0590bc1bea616530435: Status 404 returned error can't find the container with id 6efaee5c79176ce54a1933589bbc831722935f0c0a82a0590bc1bea616530435
Sep 08 15:27:06.907679 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.907621    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl" event={"ID":"daf4dfb0-4202-4a48-bc9f-fcc604a0e334","Type":"ContainerStarted","Data":"b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4"}
Sep 08 15:27:06.907832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.907700    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl" event={"ID":"daf4dfb0-4202-4a48-bc9f-fcc604a0e334","Type":"ContainerStarted","Data":"6efaee5c79176ce54a1933589bbc831722935f0c0a82a0590bc1bea616530435"}
Sep 08 15:27:06.907832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.907762    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:06.927301 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:06.927255    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl" podStartSLOduration=0.927239689 podStartE2EDuration="927.239689ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:06.925380764 +0000 UTC m=+854.026274877" watchObservedRunningTime="2026-09-08 15:27:06.927239689 +0000 UTC m=+854.028133801"
Sep 08 15:27:17.914269 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:17.914237    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:25.011787 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:25.011753    2556 generic.go:356] "Generic (PLEG): container finished" podID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerID="cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21" exitCode=0
Sep 08 15:27:25.012234 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:25.011812    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" event={"ID":"0b7b9df3-7c6a-49ce-8923-19d85199d659","Type":"ContainerDied","Data":"cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21"}
Sep 08 15:27:25.012234 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:25.012192    2556 scope.go:117] "RemoveContainer" containerID="cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21"
Sep 08 15:27:25.013280 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:25.013247    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:27:25.013354 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:25.013337    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:27:25.013393 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:25.013376    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:27:26.019169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:26.019136    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" event={"ID":"0b7b9df3-7c6a-49ce-8923-19d85199d659","Type":"ContainerStarted","Data":"9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b"}
Sep 08 15:27:26.488466 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:26.488428    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:26.488641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:26.488610    2556 patch_prober.go:28] interesting pod/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 15:27:26.488714 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:26.488660    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 15:27:27.489072 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:27.489039    2556 patch_prober.go:28] interesting pod/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 15:27:27.489437 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:27.489091    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 15:27:28.489008 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:28.488970    2556 patch_prober.go:28] interesting pod/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 15:27:28.489178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:28.489040    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 15:27:29.030821 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.030786    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"]
Sep 08 15:27:29.033094 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.033071    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"
Sep 08 15:27:29.035593 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.035572    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:27:29.035718 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.035572    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:27:29.042021 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.042001    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"]
Sep 08 15:27:29.116597 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.116565    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c41371-ef75-4109-b064-ba5ebc072587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd\" (UID: \"b5c41371-ef75-4109-b064-ba5ebc072587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"
Sep 08 15:27:29.217196 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.217162    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c41371-ef75-4109-b064-ba5ebc072587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd\" (UID: \"b5c41371-ef75-4109-b064-ba5ebc072587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"
Sep 08 15:27:29.217754 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.217736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c41371-ef75-4109-b064-ba5ebc072587-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd\" (UID: \"b5c41371-ef75-4109-b064-ba5ebc072587\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"
Sep 08 15:27:29.346279 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.346247    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"
Sep 08 15:27:29.488487 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.488450    2556 patch_prober.go:28] interesting pod/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 15:27:29.488633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.488496    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 15:27:29.625719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:29.625646    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"]
Sep 08 15:27:29.628075 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:27:29.628052    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5c41371_ef75_4109_b064_ba5ebc072587.slice/crio-1028ecc2d6612545695cb534efb46216e6bee1d1e2bcacc35286a9b6ad77c929 WatchSource:0}: Error finding container 1028ecc2d6612545695cb534efb46216e6bee1d1e2bcacc35286a9b6ad77c929: Status 404 returned error can't find the container with id 1028ecc2d6612545695cb534efb46216e6bee1d1e2bcacc35286a9b6ad77c929
Sep 08 15:27:30.045077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:30.044313    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd" event={"ID":"b5c41371-ef75-4109-b064-ba5ebc072587","Type":"ContainerStarted","Data":"d0c7c5446ccf46e7b690faed9293ed78d4243a08eba40e64fd2cefdcf1affb62"}
Sep 08 15:27:30.045077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:30.044376    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd" event={"ID":"b5c41371-ef75-4109-b064-ba5ebc072587","Type":"ContainerStarted","Data":"1028ecc2d6612545695cb534efb46216e6bee1d1e2bcacc35286a9b6ad77c929"}
Sep 08 15:27:30.488992 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:30.488962    2556 patch_prober.go:28] interesting pod/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused" start-of-body=
Sep 08 15:27:30.489184 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:30.489016    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.45:15021/healthz/ready\": dial tcp 10.133.0.45:15021: connect: connection refused"
Sep 08 15:27:31.051869 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:31.051831    2556 generic.go:356] "Generic (PLEG): container finished" podID="b5c41371-ef75-4109-b064-ba5ebc072587" containerID="d0c7c5446ccf46e7b690faed9293ed78d4243a08eba40e64fd2cefdcf1affb62" exitCode=0
Sep 08 15:27:31.052273 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:31.051890    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd" event={"ID":"b5c41371-ef75-4109-b064-ba5ebc072587","Type":"ContainerDied","Data":"d0c7c5446ccf46e7b690faed9293ed78d4243a08eba40e64fd2cefdcf1affb62"}
Sep 08 15:27:31.492191 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:31.492159    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:31.492560 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:31.492534    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:31.493246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:31.493227    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:32.181832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:32.181811    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"
Sep 08 15:27:32.243950 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:32.243918    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c41371-ef75-4109-b064-ba5ebc072587-maas-api-service-ca\") pod \"b5c41371-ef75-4109-b064-ba5ebc072587\" (UID: \"b5c41371-ef75-4109-b064-ba5ebc072587\") "
Sep 08 15:27:32.244256 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:32.244234    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5c41371-ef75-4109-b064-ba5ebc072587-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b5c41371-ef75-4109-b064-ba5ebc072587" (UID: "b5c41371-ef75-4109-b064-ba5ebc072587"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:32.345218 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:32.345197    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b5c41371-ef75-4109-b064-ba5ebc072587-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:33.063072 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:33.063035    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd" event={"ID":"b5c41371-ef75-4109-b064-ba5ebc072587","Type":"ContainerDied","Data":"1028ecc2d6612545695cb534efb46216e6bee1d1e2bcacc35286a9b6ad77c929"}
Sep 08 15:27:33.063072 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:33.063059    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"
Sep 08 15:27:33.063273 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:33.063110    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1028ecc2d6612545695cb534efb46216e6bee1d1e2bcacc35286a9b6ad77c929"
Sep 08 15:27:35.980744 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:35.980706    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"]
Sep 08 15:27:35.981233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:35.980986    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl" podUID="daf4dfb0-4202-4a48-bc9f-fcc604a0e334" containerName="payload-processing" containerID="cri-o://b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4" gracePeriod=30
Sep 08 15:27:36.133207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.133164    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"]
Sep 08 15:27:36.135646 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.135618    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-b5aeacc1-wvgqd"]
Sep 08 15:27:36.239130 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.239060    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:36.276158 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.276126    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"]
Sep 08 15:27:36.276338 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.276317    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy" containerID="cri-o://9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b" gracePeriod=30
Sep 08 15:27:36.379526 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.379495    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg2m5\" (UniqueName: \"kubernetes.io/projected/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-kube-api-access-jg2m5\") pod \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\" (UID: \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\") "
Sep 08 15:27:36.379709 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.379608    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-plugins-config-volume\") pod \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\" (UID: \"daf4dfb0-4202-4a48-bc9f-fcc604a0e334\") "
Sep 08 15:27:36.380011 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.379982    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "daf4dfb0-4202-4a48-bc9f-fcc604a0e334" (UID: "daf4dfb0-4202-4a48-bc9f-fcc604a0e334"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:36.381603 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.381577    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-kube-api-access-jg2m5" (OuterVolumeSpecName: "kube-api-access-jg2m5") pod "daf4dfb0-4202-4a48-bc9f-fcc604a0e334" (UID: "daf4dfb0-4202-4a48-bc9f-fcc604a0e334"). InnerVolumeSpecName "kube-api-access-jg2m5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:36.481000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.480967    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:36.481000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:36.480993    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg2m5\" (UniqueName: \"kubernetes.io/projected/daf4dfb0-4202-4a48-bc9f-fcc604a0e334-kube-api-access-jg2m5\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:37.083558 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.083525    2556 generic.go:356] "Generic (PLEG): container finished" podID="daf4dfb0-4202-4a48-bc9f-fcc604a0e334" containerID="b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4" exitCode=0
Sep 08 15:27:37.084003 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.083574    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"
Sep 08 15:27:37.084003 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.083600    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl" event={"ID":"daf4dfb0-4202-4a48-bc9f-fcc604a0e334","Type":"ContainerDied","Data":"b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4"}
Sep 08 15:27:37.084003 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.083649    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl" event={"ID":"daf4dfb0-4202-4a48-bc9f-fcc604a0e334","Type":"ContainerDied","Data":"6efaee5c79176ce54a1933589bbc831722935f0c0a82a0590bc1bea616530435"}
Sep 08 15:27:37.084003 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.083705    2556 scope.go:117] "RemoveContainer" containerID="b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4"
Sep 08 15:27:37.091935 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.091916    2556 scope.go:117] "RemoveContainer" containerID="b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4"
Sep 08 15:27:37.092192 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:27:37.092169    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4\": container with ID starting with b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4 not found: ID does not exist" containerID="b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4"
Sep 08 15:27:37.092249 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.092202    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4"} err="failed to get container status \"b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4\": rpc error: code = NotFound desc = could not find container \"b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4\": container with ID starting with b69685a8d175c4d5db99c5717ac72a297701b3c13d55c075098f8b400f95e6b4 not found: ID does not exist"
Sep 08 15:27:37.106925 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.106903    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"]
Sep 08 15:27:37.116249 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.116231    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-b5aeacc1-6c44f5994f-8s8nl"]
Sep 08 15:27:37.353818 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.353736    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5c41371-ef75-4109-b064-ba5ebc072587" path="/var/lib/kubelet/pods/b5c41371-ef75-4109-b064-ba5ebc072587/volumes"
Sep 08 15:27:37.354117 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:37.354104    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daf4dfb0-4202-4a48-bc9f-fcc604a0e334" path="/var/lib/kubelet/pods/daf4dfb0-4202-4a48-bc9f-fcc604a0e334/volumes"
Sep 08 15:27:41.527257 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.527233    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:41.621664 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621636    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-token\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.621853 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621689    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g88hx\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-kube-api-access-g88hx\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.621853 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621743    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-certs\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.621853 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621792    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-credential-socket\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.621853 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621809    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-socket\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.621853 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621832    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-envoy\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.622126 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621858    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-data\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.622126 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621897    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-podinfo\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.622126 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.621939    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b7b9df3-7c6a-49ce-8923-19d85199d659-istiod-ca-cert\") pod \"0b7b9df3-7c6a-49ce-8923-19d85199d659\" (UID: \"0b7b9df3-7c6a-49ce-8923-19d85199d659\") "
Sep 08 15:27:41.622126 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.622106    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:41.622126 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.622121    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:41.622355 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.622132    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:41.622355 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.622286    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:41.622355 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.622291    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-data" (OuterVolumeSpecName: "istio-data") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:41.622355 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.622305    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:41.622355 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.622320    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:41.622589 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.622440    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0b7b9df3-7c6a-49ce-8923-19d85199d659-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:27:41.623913 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.623890    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-token" (OuterVolumeSpecName: "istio-token") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:41.624035 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.623944    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-kube-api-access-g88hx" (OuterVolumeSpecName: "kube-api-access-g88hx") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "kube-api-access-g88hx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:27:41.624035 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.624005    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:27:41.624113 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.624069    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0b7b9df3-7c6a-49ce-8923-19d85199d659" (UID: "0b7b9df3-7c6a-49ce-8923-19d85199d659"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:27:41.723388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.723365    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0b7b9df3-7c6a-49ce-8923-19d85199d659-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:41.723388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.723385    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:41.723521 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.723394    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g88hx\" (UniqueName: \"kubernetes.io/projected/0b7b9df3-7c6a-49ce-8923-19d85199d659-kube-api-access-g88hx\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:41.723521 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.723403    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:41.723521 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.723412    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:41.723521 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:41.723419    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0b7b9df3-7c6a-49ce-8923-19d85199d659-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:27:42.112106 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.112074    2556 generic.go:356] "Generic (PLEG): container finished" podID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerID="9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b" exitCode=0
Sep 08 15:27:42.112249 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.112127    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"
Sep 08 15:27:42.112249 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.112156    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" event={"ID":"0b7b9df3-7c6a-49ce-8923-19d85199d659","Type":"ContainerDied","Data":"9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b"}
Sep 08 15:27:42.112249 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.112211    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26" event={"ID":"0b7b9df3-7c6a-49ce-8923-19d85199d659","Type":"ContainerDied","Data":"61cbbca77e1c17bb67791e71d6d33c54dffd73c3ed5c136059e9cfa9f66688ec"}
Sep 08 15:27:42.112249 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.112234    2556 scope.go:117] "RemoveContainer" containerID="9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b"
Sep 08 15:27:42.121501 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.121483    2556 scope.go:117] "RemoveContainer" containerID="cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21"
Sep 08 15:27:42.129190 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.129175    2556 scope.go:117] "RemoveContainer" containerID="9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b"
Sep 08 15:27:42.129430 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:27:42.129414    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b\": container with ID starting with 9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b not found: ID does not exist" containerID="9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b"
Sep 08 15:27:42.129482 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.129438    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b"} err="failed to get container status \"9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b\": rpc error: code = NotFound desc = could not find container \"9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b\": container with ID starting with 9eda0e5d333d2e1d73bb42cfbd37de80549954e4b0fc4cc454d77e1d7e28555b not found: ID does not exist"
Sep 08 15:27:42.129482 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.129452    2556 scope.go:117] "RemoveContainer" containerID="cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21"
Sep 08 15:27:42.129737 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:27:42.129713    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21\": container with ID starting with cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21 not found: ID does not exist" containerID="cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21"
Sep 08 15:27:42.129804 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.129740    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21"} err="failed to get container status \"cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21\": rpc error: code = NotFound desc = could not find container \"cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21\": container with ID starting with cd7a696a0ff670ba4e472613abe7f37ae8bc4ca2c2e2b26dbf55eb28d6771f21 not found: ID does not exist"
Sep 08 15:27:42.137129 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.137106    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"]
Sep 08 15:27:42.149290 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:42.143402    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b5aeacc1-openshift-default-6f5b4fb6dd-qdh26"]
Sep 08 15:27:43.354644 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:43.354604    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" path="/var/lib/kubelet/pods/0b7b9df3-7c6a-49ce-8923-19d85199d659/volumes"
Sep 08 15:27:44.222784 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.222751    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"]
Sep 08 15:27:44.223143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223129    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5c41371-ef75-4109-b064-ba5ebc072587" containerName="revoke-keys"
Sep 08 15:27:44.223189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223146    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5c41371-ef75-4109-b064-ba5ebc072587" containerName="revoke-keys"
Sep 08 15:27:44.223189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223159    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy"
Sep 08 15:27:44.223189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223165    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy"
Sep 08 15:27:44.223189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223187    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daf4dfb0-4202-4a48-bc9f-fcc604a0e334" containerName="payload-processing"
Sep 08 15:27:44.223304 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223194    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="daf4dfb0-4202-4a48-bc9f-fcc604a0e334" containerName="payload-processing"
Sep 08 15:27:44.223304 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223246    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="daf4dfb0-4202-4a48-bc9f-fcc604a0e334" containerName="payload-processing"
Sep 08 15:27:44.223304 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223257    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy"
Sep 08 15:27:44.223304 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.223265    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5c41371-ef75-4109-b064-ba5ebc072587" containerName="revoke-keys"
Sep 08 15:27:44.226078 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.226063    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:44.228344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.228317    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-0c2253\""
Sep 08 15:27:44.237058 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.237036    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"]
Sep 08 15:27:44.274613 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.274581    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"]
Sep 08 15:27:44.274957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.274938    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy"
Sep 08 15:27:44.274957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.274958    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy"
Sep 08 15:27:44.275061 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.275024    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0b7b9df3-7c6a-49ce-8923-19d85199d659" containerName="istio-proxy"
Sep 08 15:27:44.276746 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.276731    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:44.279239 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.279216    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-0c2253-dockercfg-dwct7\""
Sep 08 15:27:44.289385 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.289360    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"]
Sep 08 15:27:44.343786 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.343754    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b872060-5479-4255-a48b-4da099dcf4db-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g\" (UID: \"4b872060-5479-4255-a48b-4da099dcf4db\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:44.343975 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.343839    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbjp\" (UniqueName: \"kubernetes.io/projected/4b872060-5479-4255-a48b-4da099dcf4db-kube-api-access-wbbjp\") pod \"payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g\" (UID: \"4b872060-5479-4255-a48b-4da099dcf4db\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:44.445024 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.444987    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbjp\" (UniqueName: \"kubernetes.io/projected/4b872060-5479-4255-a48b-4da099dcf4db-kube-api-access-wbbjp\") pod \"payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g\" (UID: \"4b872060-5479-4255-a48b-4da099dcf4db\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:44.445458 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.445039    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b872060-5479-4255-a48b-4da099dcf4db-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g\" (UID: \"4b872060-5479-4255-a48b-4da099dcf4db\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:44.445458 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.445070    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qpzfx\" (UniqueName: \"kubernetes.io/projected/bc41ac2c-f55f-4170-bb01-6c984fa58b26-kube-api-access-qpzfx\") pod \"payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7\" (UID: \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\") " pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:44.445458 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.445096    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc41ac2c-f55f-4170-bb01-6c984fa58b26-plugins-config-volume\") pod \"payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7\" (UID: \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\") " pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:44.445806 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.445785    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b872060-5479-4255-a48b-4da099dcf4db-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g\" (UID: \"4b872060-5479-4255-a48b-4da099dcf4db\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:44.452923 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.452905    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbjp\" (UniqueName: \"kubernetes.io/projected/4b872060-5479-4255-a48b-4da099dcf4db-kube-api-access-wbbjp\") pod \"payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g\" (UID: \"4b872060-5479-4255-a48b-4da099dcf4db\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:44.536951 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.536865    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:44.545956 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.545926    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc41ac2c-f55f-4170-bb01-6c984fa58b26-plugins-config-volume\") pod \"payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7\" (UID: \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\") " pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:44.546077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.546061    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qpzfx\" (UniqueName: \"kubernetes.io/projected/bc41ac2c-f55f-4170-bb01-6c984fa58b26-kube-api-access-qpzfx\") pod \"payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7\" (UID: \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\") " pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:44.546640 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.546614    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc41ac2c-f55f-4170-bb01-6c984fa58b26-plugins-config-volume\") pod \"payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7\" (UID: \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\") " pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:44.554319 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.554280    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qpzfx\" (UniqueName: \"kubernetes.io/projected/bc41ac2c-f55f-4170-bb01-6c984fa58b26-kube-api-access-qpzfx\") pod \"payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7\" (UID: \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\") " pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:44.587054 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.586986    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:44.806810 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.806737    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"]
Sep 08 15:27:44.810024 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:27:44.809994    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b872060_5479_4255_a48b_4da099dcf4db.slice/crio-2b70318bc75f56c3f1372f28f6a60ac9cbeb6c15bb025223e1b45d8beef0d76b WatchSource:0}: Error finding container 2b70318bc75f56c3f1372f28f6a60ac9cbeb6c15bb025223e1b45d8beef0d76b: Status 404 returned error can't find the container with id 2b70318bc75f56c3f1372f28f6a60ac9cbeb6c15bb025223e1b45d8beef0d76b
Sep 08 15:27:44.861684 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:44.861650    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"]
Sep 08 15:27:44.864074 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:27:44.864051    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc41ac2c_f55f_4170_bb01_6c984fa58b26.slice/crio-dbcd1bcccd6d29e69c96d82973c1e26f0539842062d12a068e0d648739717dfc WatchSource:0}: Error finding container dbcd1bcccd6d29e69c96d82973c1e26f0539842062d12a068e0d648739717dfc: Status 404 returned error can't find the container with id dbcd1bcccd6d29e69c96d82973c1e26f0539842062d12a068e0d648739717dfc
Sep 08 15:27:45.130914 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:45.130873    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g" event={"ID":"4b872060-5479-4255-a48b-4da099dcf4db","Type":"ContainerStarted","Data":"72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7"}
Sep 08 15:27:45.131093 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:45.130955    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:27:45.131093 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:45.130986    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g" event={"ID":"4b872060-5479-4255-a48b-4da099dcf4db","Type":"ContainerStarted","Data":"2b70318bc75f56c3f1372f28f6a60ac9cbeb6c15bb025223e1b45d8beef0d76b"}
Sep 08 15:27:45.132583 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:45.132558    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7" event={"ID":"bc41ac2c-f55f-4170-bb01-6c984fa58b26","Type":"ContainerStarted","Data":"8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b"}
Sep 08 15:27:45.132747 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:45.132595    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7" event={"ID":"bc41ac2c-f55f-4170-bb01-6c984fa58b26","Type":"ContainerStarted","Data":"dbcd1bcccd6d29e69c96d82973c1e26f0539842062d12a068e0d648739717dfc"}
Sep 08 15:27:45.132747 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:45.132664    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:45.147859 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:45.147801    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g" podStartSLOduration=1.147780245 podStartE2EDuration="1.147780245s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:45.146165376 +0000 UTC m=+892.247059490" watchObservedRunningTime="2026-09-08 15:27:45.147780245 +0000 UTC m=+892.248674359"
Sep 08 15:27:45.163732 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:45.163685    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7" podStartSLOduration=1.163653331 podStartE2EDuration="1.163653331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:27:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:27:45.162413436 +0000 UTC m=+892.263307548" watchObservedRunningTime="2026-09-08 15:27:45.163653331 +0000 UTC m=+892.264547441"
Sep 08 15:27:56.139852 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:56.139817    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:27:56.140260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:27:56.139901    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:28:29.330261 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.330227    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"]
Sep 08 15:28:29.332923 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.332902    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"
Sep 08 15:28:29.335255 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.335234    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:28:29.335342 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.335235    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:28:29.342996 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.342952    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"]
Sep 08 15:28:29.404025 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.403995    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28e68134-bb3d-44ae-a91c-82c359a30c35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0c2253-v68vl\" (UID: \"28e68134-bb3d-44ae-a91c-82c359a30c35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"
Sep 08 15:28:29.504958 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.504923    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28e68134-bb3d-44ae-a91c-82c359a30c35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0c2253-v68vl\" (UID: \"28e68134-bb3d-44ae-a91c-82c359a30c35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"
Sep 08 15:28:29.505515 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.505497    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28e68134-bb3d-44ae-a91c-82c359a30c35-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-0c2253-v68vl\" (UID: \"28e68134-bb3d-44ae-a91c-82c359a30c35\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"
Sep 08 15:28:29.645373 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.645297    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"
Sep 08 15:28:29.928331 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:29.928303    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"]
Sep 08 15:28:29.930013 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:28:29.929985    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28e68134_bb3d_44ae_a91c_82c359a30c35.slice/crio-f50c9e6fca471ee77c4c7e4ea0a96d8d669787db225123551cab03f1119b232b WatchSource:0}: Error finding container f50c9e6fca471ee77c4c7e4ea0a96d8d669787db225123551cab03f1119b232b: Status 404 returned error can't find the container with id f50c9e6fca471ee77c4c7e4ea0a96d8d669787db225123551cab03f1119b232b
Sep 08 15:28:30.361233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:30.361197    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl" event={"ID":"28e68134-bb3d-44ae-a91c-82c359a30c35","Type":"ContainerStarted","Data":"9b5cb4cbfbd4949f9367c73315c75e5ce0ea0d0ce6046016eb49ead21083ae96"}
Sep 08 15:28:30.361575 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:30.361255    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl" event={"ID":"28e68134-bb3d-44ae-a91c-82c359a30c35","Type":"ContainerStarted","Data":"f50c9e6fca471ee77c4c7e4ea0a96d8d669787db225123551cab03f1119b232b"}
Sep 08 15:28:30.376830 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:30.376767    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl" podStartSLOduration=1.376748836 podStartE2EDuration="1.376748836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:28:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:28:30.376427364 +0000 UTC m=+937.477321474" watchObservedRunningTime="2026-09-08 15:28:30.376748836 +0000 UTC m=+937.477642944"
Sep 08 15:28:31.367449 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:31.367411    2556 generic.go:356] "Generic (PLEG): container finished" podID="28e68134-bb3d-44ae-a91c-82c359a30c35" containerID="9b5cb4cbfbd4949f9367c73315c75e5ce0ea0d0ce6046016eb49ead21083ae96" exitCode=0
Sep 08 15:28:31.367829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:31.367481    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl" event={"ID":"28e68134-bb3d-44ae-a91c-82c359a30c35","Type":"ContainerDied","Data":"9b5cb4cbfbd4949f9367c73315c75e5ce0ea0d0ce6046016eb49ead21083ae96"}
Sep 08 15:28:32.496094 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:32.496069    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"
Sep 08 15:28:32.632502 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:32.632421    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28e68134-bb3d-44ae-a91c-82c359a30c35-maas-api-service-ca\") pod \"28e68134-bb3d-44ae-a91c-82c359a30c35\" (UID: \"28e68134-bb3d-44ae-a91c-82c359a30c35\") "
Sep 08 15:28:32.632822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:32.632795    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28e68134-bb3d-44ae-a91c-82c359a30c35-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "28e68134-bb3d-44ae-a91c-82c359a30c35" (UID: "28e68134-bb3d-44ae-a91c-82c359a30c35"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:28:32.733210 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:32.733178    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/28e68134-bb3d-44ae-a91c-82c359a30c35-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:28:33.378358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:33.378337    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"
Sep 08 15:28:33.378470 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:33.378350    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl" event={"ID":"28e68134-bb3d-44ae-a91c-82c359a30c35","Type":"ContainerDied","Data":"f50c9e6fca471ee77c4c7e4ea0a96d8d669787db225123551cab03f1119b232b"}
Sep 08 15:28:33.378470 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:33.378392    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f50c9e6fca471ee77c4c7e4ea0a96d8d669787db225123551cab03f1119b232b"
Sep 08 15:28:40.061807 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.061774    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"]
Sep 08 15:28:40.062336 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.062032    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7" podUID="bc41ac2c-f55f-4170-bb01-6c984fa58b26" containerName="payload-processing" containerID="cri-o://8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b" gracePeriod=30
Sep 08 15:28:40.074796 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.074769    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"]
Sep 08 15:28:40.075064 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.075039    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g" podUID="4b872060-5479-4255-a48b-4da099dcf4db" containerName="payload-pre-processing" containerID="cri-o://72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7" gracePeriod=30
Sep 08 15:28:40.268521 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.268491    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"]
Sep 08 15:28:40.271325 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.271301    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-0c2253-v68vl"]
Sep 08 15:28:40.363514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.363491    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:28:40.365779 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.365764    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:28:40.413113 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.413084    2556 generic.go:356] "Generic (PLEG): container finished" podID="4b872060-5479-4255-a48b-4da099dcf4db" containerID="72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7" exitCode=0
Sep 08 15:28:40.413246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.413124    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"
Sep 08 15:28:40.413246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.413163    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g" event={"ID":"4b872060-5479-4255-a48b-4da099dcf4db","Type":"ContainerDied","Data":"72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7"}
Sep 08 15:28:40.413246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.413211    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g" event={"ID":"4b872060-5479-4255-a48b-4da099dcf4db","Type":"ContainerDied","Data":"2b70318bc75f56c3f1372f28f6a60ac9cbeb6c15bb025223e1b45d8beef0d76b"}
Sep 08 15:28:40.413246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.413228    2556 scope.go:117] "RemoveContainer" containerID="72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7"
Sep 08 15:28:40.418132 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.418108    2556 generic.go:356] "Generic (PLEG): container finished" podID="bc41ac2c-f55f-4170-bb01-6c984fa58b26" containerID="8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b" exitCode=0
Sep 08 15:28:40.418236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.418142    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7" event={"ID":"bc41ac2c-f55f-4170-bb01-6c984fa58b26","Type":"ContainerDied","Data":"8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b"}
Sep 08 15:28:40.418236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.418180    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7" event={"ID":"bc41ac2c-f55f-4170-bb01-6c984fa58b26","Type":"ContainerDied","Data":"dbcd1bcccd6d29e69c96d82973c1e26f0539842062d12a068e0d648739717dfc"}
Sep 08 15:28:40.418236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.418191    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"
Sep 08 15:28:40.425111 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.425094    2556 scope.go:117] "RemoveContainer" containerID="72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7"
Sep 08 15:28:40.425381 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:28:40.425364    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7\": container with ID starting with 72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7 not found: ID does not exist" containerID="72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7"
Sep 08 15:28:40.425446 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.425392    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7"} err="failed to get container status \"72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7\": rpc error: code = NotFound desc = could not find container \"72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7\": container with ID starting with 72971ee7438ae06ce6dbc387e716feb12e3695a3b4bdb1f986cfbb2a58bf10c7 not found: ID does not exist"
Sep 08 15:28:40.425446 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.425414    2556 scope.go:117] "RemoveContainer" containerID="8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b"
Sep 08 15:28:40.432454 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.432439    2556 scope.go:117] "RemoveContainer" containerID="8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b"
Sep 08 15:28:40.432739 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:28:40.432715    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b\": container with ID starting with 8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b not found: ID does not exist" containerID="8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b"
Sep 08 15:28:40.432844 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.432745    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b"} err="failed to get container status \"8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b\": rpc error: code = NotFound desc = could not find container \"8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b\": container with ID starting with 8ef24f2f13685993f5cd316d47e75d88e58543f1c5c117f369e4adc1802c3e0b not found: ID does not exist"
Sep 08 15:28:40.499976 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.499955    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc41ac2c-f55f-4170-bb01-6c984fa58b26-plugins-config-volume\") pod \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\" (UID: \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\") "
Sep 08 15:28:40.500098 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.500017    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b872060-5479-4255-a48b-4da099dcf4db-plugins-config-volume\") pod \"4b872060-5479-4255-a48b-4da099dcf4db\" (UID: \"4b872060-5479-4255-a48b-4da099dcf4db\") "
Sep 08 15:28:40.500098 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.500092    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qpzfx\" (UniqueName: \"kubernetes.io/projected/bc41ac2c-f55f-4170-bb01-6c984fa58b26-kube-api-access-qpzfx\") pod \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\" (UID: \"bc41ac2c-f55f-4170-bb01-6c984fa58b26\") "
Sep 08 15:28:40.500214 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.500132    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbbjp\" (UniqueName: \"kubernetes.io/projected/4b872060-5479-4255-a48b-4da099dcf4db-kube-api-access-wbbjp\") pod \"4b872060-5479-4255-a48b-4da099dcf4db\" (UID: \"4b872060-5479-4255-a48b-4da099dcf4db\") "
Sep 08 15:28:40.500378 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.500352    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc41ac2c-f55f-4170-bb01-6c984fa58b26-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc41ac2c-f55f-4170-bb01-6c984fa58b26" (UID: "bc41ac2c-f55f-4170-bb01-6c984fa58b26"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:28:40.500421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.500371    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b872060-5479-4255-a48b-4da099dcf4db-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b872060-5479-4255-a48b-4da099dcf4db" (UID: "4b872060-5479-4255-a48b-4da099dcf4db"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:28:40.501882 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.501858    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc41ac2c-f55f-4170-bb01-6c984fa58b26-kube-api-access-qpzfx" (OuterVolumeSpecName: "kube-api-access-qpzfx") pod "bc41ac2c-f55f-4170-bb01-6c984fa58b26" (UID: "bc41ac2c-f55f-4170-bb01-6c984fa58b26"). InnerVolumeSpecName "kube-api-access-qpzfx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:28:40.501987 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.501968    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b872060-5479-4255-a48b-4da099dcf4db-kube-api-access-wbbjp" (OuterVolumeSpecName: "kube-api-access-wbbjp") pod "4b872060-5479-4255-a48b-4da099dcf4db" (UID: "4b872060-5479-4255-a48b-4da099dcf4db"). InnerVolumeSpecName "kube-api-access-wbbjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:28:40.601411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.601350    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b872060-5479-4255-a48b-4da099dcf4db-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:28:40.601411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.601374    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qpzfx\" (UniqueName: \"kubernetes.io/projected/bc41ac2c-f55f-4170-bb01-6c984fa58b26-kube-api-access-qpzfx\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:28:40.601411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.601384    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbbjp\" (UniqueName: \"kubernetes.io/projected/4b872060-5479-4255-a48b-4da099dcf4db-kube-api-access-wbbjp\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:28:40.601411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.601392    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc41ac2c-f55f-4170-bb01-6c984fa58b26-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:28:40.734763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.734739    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"]
Sep 08 15:28:40.743929 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.743905    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-0c2253-6896c76dc4-46q8g"]
Sep 08 15:28:40.753978 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.753955    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"]
Sep 08 15:28:40.757876 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:40.757855    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-0c2253-d4d7cdd6f-84jb7"]
Sep 08 15:28:41.355104 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:41.355032    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28e68134-bb3d-44ae-a91c-82c359a30c35" path="/var/lib/kubelet/pods/28e68134-bb3d-44ae-a91c-82c359a30c35/volumes"
Sep 08 15:28:41.355428 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:41.355361    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b872060-5479-4255-a48b-4da099dcf4db" path="/var/lib/kubelet/pods/4b872060-5479-4255-a48b-4da099dcf4db/volumes"
Sep 08 15:28:41.355664 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:41.355651    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc41ac2c-f55f-4170-bb01-6c984fa58b26" path="/var/lib/kubelet/pods/bc41ac2c-f55f-4170-bb01-6c984fa58b26/volumes"
Sep 08 15:28:47.752912 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.752878    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"]
Sep 08 15:28:47.753831 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.753806    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28e68134-bb3d-44ae-a91c-82c359a30c35" containerName="revoke-keys"
Sep 08 15:28:47.753831 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.753833    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="28e68134-bb3d-44ae-a91c-82c359a30c35" containerName="revoke-keys"
Sep 08 15:28:47.753984 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.753855    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b872060-5479-4255-a48b-4da099dcf4db" containerName="payload-pre-processing"
Sep 08 15:28:47.753984 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.753863    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b872060-5479-4255-a48b-4da099dcf4db" containerName="payload-pre-processing"
Sep 08 15:28:47.753984 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.753890    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc41ac2c-f55f-4170-bb01-6c984fa58b26" containerName="payload-processing"
Sep 08 15:28:47.753984 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.753898    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc41ac2c-f55f-4170-bb01-6c984fa58b26" containerName="payload-processing"
Sep 08 15:28:47.753984 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.753982    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="28e68134-bb3d-44ae-a91c-82c359a30c35" containerName="revoke-keys"
Sep 08 15:28:47.754212 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.753995    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b872060-5479-4255-a48b-4da099dcf4db" containerName="payload-pre-processing"
Sep 08 15:28:47.754212 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.754003    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc41ac2c-f55f-4170-bb01-6c984fa58b26" containerName="payload-processing"
Sep 08 15:28:47.758416 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.758394    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.761879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.761857    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-e8425d-openshift-default-dockercfg-mgk8l\""
Sep 08 15:28:47.768069 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.768046    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"]
Sep 08 15:28:47.857889 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.857854    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-data\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.858142 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.857920    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-envoy\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.858142 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.857955    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-podinfo\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.858142 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.857983    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-credential-socket\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.858142 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.858000    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-token\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.858142 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.858028    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpb4f\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-kube-api-access-fpb4f\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.858142 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.858077    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-socket\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.858142 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.858092    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-certs\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.858597 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.858182    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b6966e-3a42-4c90-9e46-dd2baab405c3-istiod-ca-cert\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959383 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959342    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-envoy\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959383 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959392    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-podinfo\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959654 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959420    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-credential-socket\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959654 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959436    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-token\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959654 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959453    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpb4f\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-kube-api-access-fpb4f\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959654 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959524    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-socket\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959654 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959560    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-certs\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959654 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959598    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b6966e-3a42-4c90-9e46-dd2baab405c3-istiod-ca-cert\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.959654 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959629    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-data\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.960208 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959907    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-credential-socket\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.960208 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.959963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-data\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.960208 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.960018    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-socket\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.960316 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.960215    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-certs\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.961651 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.961601    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-envoy\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.961867 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.961839    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-podinfo\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.963686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.963650    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b6966e-3a42-4c90-9e46-dd2baab405c3-istiod-ca-cert\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.971269 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.971247    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-token\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:47.971368 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:47.971321    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpb4f\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-kube-api-access-fpb4f\") pod \"e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") " pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:48.069796 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:48.069765    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:48.344851 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:48.344754    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"]
Sep 08 15:28:48.349253 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:28:48.349226    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55b6966e_3a42_4c90_9e46_dd2baab405c3.slice/crio-7cdf667a7317cc8c310dd5db11bb433c12ce923b1cd5a0b3351422eeecefb2c5 WatchSource:0}: Error finding container 7cdf667a7317cc8c310dd5db11bb433c12ce923b1cd5a0b3351422eeecefb2c5: Status 404 returned error can't find the container with id 7cdf667a7317cc8c310dd5db11bb433c12ce923b1cd5a0b3351422eeecefb2c5
Sep 08 15:28:48.351363 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:48.351327    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:28:48.351447 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:48.351407    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:28:48.351447 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:48.351440    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:28:48.460337 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:48.460299    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck" event={"ID":"55b6966e-3a42-4c90-9e46-dd2baab405c3","Type":"ContainerStarted","Data":"5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a"}
Sep 08 15:28:48.460521 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:48.460366    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck" event={"ID":"55b6966e-3a42-4c90-9e46-dd2baab405c3","Type":"ContainerStarted","Data":"7cdf667a7317cc8c310dd5db11bb433c12ce923b1cd5a0b3351422eeecefb2c5"}
Sep 08 15:28:48.478944 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:48.478887    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck" podStartSLOduration=1.478870612 podStartE2EDuration="1.478870612s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:28:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:28:48.478078575 +0000 UTC m=+955.578972684" watchObservedRunningTime="2026-09-08 15:28:48.478870612 +0000 UTC m=+955.579764721"
Sep 08 15:28:49.070109 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:49.070068    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:49.075021 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:49.074997    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:49.465163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:49.465089    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:28:49.466159 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:28:49.466138    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:29:08.613707 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:08.613661    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"]
Sep 08 15:29:08.614189 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:08.613879    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck" podUID="55b6966e-3a42-4c90-9e46-dd2baab405c3" containerName="istio-proxy" containerID="cri-o://5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a" gracePeriod=30
Sep 08 15:29:13.863861 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.863833    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:29:13.969981 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.969902    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-data\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.969981 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.969973    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b6966e-3a42-4c90-9e46-dd2baab405c3-istiod-ca-cert\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.970180 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970025    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-credential-socket\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.970180 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970054    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-token\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.970180 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970091    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-certs\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.970180 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970118    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-envoy\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.970180 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970143    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-socket\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.970424 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970184    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpb4f\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-kube-api-access-fpb4f\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.970424 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970212    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-podinfo\") pod \"55b6966e-3a42-4c90-9e46-dd2baab405c3\" (UID: \"55b6966e-3a42-4c90-9e46-dd2baab405c3\") "
Sep 08 15:29:13.970424 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970212    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:13.970424 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970315    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:13.970631 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970458    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:13.970631 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970492    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/55b6966e-3a42-4c90-9e46-dd2baab405c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:13.970631 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970512    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:13.970631 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970545    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:13.970852 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.970738    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:13.972525 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.972494    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-kube-api-access-fpb4f" (OuterVolumeSpecName: "kube-api-access-fpb4f") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "kube-api-access-fpb4f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:13.972525 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.972514    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:29:13.972937 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.972910    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:13.973022 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:13.972929    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "55b6966e-3a42-4c90-9e46-dd2baab405c3" (UID: "55b6966e-3a42-4c90-9e46-dd2baab405c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:14.071205 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.071177    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:14.071205 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.071202    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:14.071205 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.071210    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:14.071411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.071219    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/55b6966e-3a42-4c90-9e46-dd2baab405c3-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:14.071411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.071227    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpb4f\" (UniqueName: \"kubernetes.io/projected/55b6966e-3a42-4c90-9e46-dd2baab405c3-kube-api-access-fpb4f\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:14.071411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.071237    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/55b6966e-3a42-4c90-9e46-dd2baab405c3-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:14.071411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.071245    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/55b6966e-3a42-4c90-9e46-dd2baab405c3-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:14.585264 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.585230    2556 generic.go:356] "Generic (PLEG): container finished" podID="55b6966e-3a42-4c90-9e46-dd2baab405c3" containerID="5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a" exitCode=0
Sep 08 15:29:14.585440 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.585271    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"
Sep 08 15:29:14.585440 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.585311    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck" event={"ID":"55b6966e-3a42-4c90-9e46-dd2baab405c3","Type":"ContainerDied","Data":"5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a"}
Sep 08 15:29:14.585440 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.585364    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck" event={"ID":"55b6966e-3a42-4c90-9e46-dd2baab405c3","Type":"ContainerDied","Data":"7cdf667a7317cc8c310dd5db11bb433c12ce923b1cd5a0b3351422eeecefb2c5"}
Sep 08 15:29:14.585440 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.585386    2556 scope.go:117] "RemoveContainer" containerID="5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a"
Sep 08 15:29:14.596608 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.596574    2556 scope.go:117] "RemoveContainer" containerID="5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a"
Sep 08 15:29:14.596984 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:29:14.596959    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a\": container with ID starting with 5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a not found: ID does not exist" containerID="5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a"
Sep 08 15:29:14.597068 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.596994    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a"} err="failed to get container status \"5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a\": rpc error: code = NotFound desc = could not find container \"5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a\": container with ID starting with 5049291c93fbdb5c27434ee31b24418d64b366b5a2908e4727c2a9a9939b198a not found: ID does not exist"
Sep 08 15:29:14.608374 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.608354    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"]
Sep 08 15:29:14.612559 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:14.612539    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-e8425d-openshift-default-8d67b9ddd-z5lck"]
Sep 08 15:29:15.354543 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:15.354513    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="55b6966e-3a42-4c90-9e46-dd2baab405c3" path="/var/lib/kubelet/pods/55b6966e-3a42-4c90-9e46-dd2baab405c3/volumes"
Sep 08 15:29:16.884797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.884764    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"]
Sep 08 15:29:16.885153 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.885085    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="55b6966e-3a42-4c90-9e46-dd2baab405c3" containerName="istio-proxy"
Sep 08 15:29:16.885153 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.885096    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="55b6966e-3a42-4c90-9e46-dd2baab405c3" containerName="istio-proxy"
Sep 08 15:29:16.885153 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.885149    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="55b6966e-3a42-4c90-9e46-dd2baab405c3" containerName="istio-proxy"
Sep 08 15:29:16.889231 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.889213    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:16.891718 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.891695    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-8acdf03d\""
Sep 08 15:29:16.900200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.900166    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"]
Sep 08 15:29:16.931619 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.931593    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"]
Sep 08 15:29:16.934602 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.934587    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:16.939353 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.939329    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-8acdf03d-dockercfg-jlfg9\""
Sep 08 15:29:16.957660 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.957637    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"]
Sep 08 15:29:16.995037 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.995009    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rv7n6\" (UniqueName: \"kubernetes.io/projected/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-kube-api-access-rv7n6\") pod \"payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg\" (UID: \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:16.995037 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.995038    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg\" (UID: \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:16.995202 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.995075    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0670cba0-2d4e-4e9a-9912-dedc0715338b-plugins-config-volume\") pod \"payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7\" (UID: \"0670cba0-2d4e-4e9a-9912-dedc0715338b\") " pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:16.995202 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:16.995158    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxx6h\" (UniqueName: \"kubernetes.io/projected/0670cba0-2d4e-4e9a-9912-dedc0715338b-kube-api-access-wxx6h\") pod \"payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7\" (UID: \"0670cba0-2d4e-4e9a-9912-dedc0715338b\") " pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:17.095949 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.095911    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rv7n6\" (UniqueName: \"kubernetes.io/projected/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-kube-api-access-rv7n6\") pod \"payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg\" (UID: \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:17.095949 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.095954    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg\" (UID: \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:17.096199 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.096003    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0670cba0-2d4e-4e9a-9912-dedc0715338b-plugins-config-volume\") pod \"payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7\" (UID: \"0670cba0-2d4e-4e9a-9912-dedc0715338b\") " pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:17.096199 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.096050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxx6h\" (UniqueName: \"kubernetes.io/projected/0670cba0-2d4e-4e9a-9912-dedc0715338b-kube-api-access-wxx6h\") pod \"payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7\" (UID: \"0670cba0-2d4e-4e9a-9912-dedc0715338b\") " pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:17.096807 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.096782    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg\" (UID: \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:17.096899 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.096843    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0670cba0-2d4e-4e9a-9912-dedc0715338b-plugins-config-volume\") pod \"payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7\" (UID: \"0670cba0-2d4e-4e9a-9912-dedc0715338b\") " pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:17.104605 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.104582    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rv7n6\" (UniqueName: \"kubernetes.io/projected/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-kube-api-access-rv7n6\") pod \"payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg\" (UID: \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:17.104891 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.104872    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxx6h\" (UniqueName: \"kubernetes.io/projected/0670cba0-2d4e-4e9a-9912-dedc0715338b-kube-api-access-wxx6h\") pod \"payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7\" (UID: \"0670cba0-2d4e-4e9a-9912-dedc0715338b\") " pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:17.199107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.199048    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:17.243815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.243789    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:17.473079 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.473005    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"]
Sep 08 15:29:17.476054 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:29:17.476024    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836ea6d8_eba3_4b4b_b092_6ccd60f2805e.slice/crio-7a3f50e2ab70f8004c4c701b786ad9e840e9d1b2106f7d3eb71b6ffa08c10658 WatchSource:0}: Error finding container 7a3f50e2ab70f8004c4c701b786ad9e840e9d1b2106f7d3eb71b6ffa08c10658: Status 404 returned error can't find the container with id 7a3f50e2ab70f8004c4c701b786ad9e840e9d1b2106f7d3eb71b6ffa08c10658
Sep 08 15:29:17.547998 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.547962    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"]
Sep 08 15:29:17.551247 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:29:17.551212    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0670cba0_2d4e_4e9a_9912_dedc0715338b.slice/crio-38ade93251eb6f6a147c07e979b4a98dcbe1b8cc784a7785c86854baa9304019 WatchSource:0}: Error finding container 38ade93251eb6f6a147c07e979b4a98dcbe1b8cc784a7785c86854baa9304019: Status 404 returned error can't find the container with id 38ade93251eb6f6a147c07e979b4a98dcbe1b8cc784a7785c86854baa9304019
Sep 08 15:29:17.601450 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.601417    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7" event={"ID":"0670cba0-2d4e-4e9a-9912-dedc0715338b","Type":"ContainerStarted","Data":"38ade93251eb6f6a147c07e979b4a98dcbe1b8cc784a7785c86854baa9304019"}
Sep 08 15:29:17.603051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.603028    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg" event={"ID":"836ea6d8-eba3-4b4b-b092-6ccd60f2805e","Type":"ContainerStarted","Data":"22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f"}
Sep 08 15:29:17.603144 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.603069    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg" event={"ID":"836ea6d8-eba3-4b4b-b092-6ccd60f2805e","Type":"ContainerStarted","Data":"7a3f50e2ab70f8004c4c701b786ad9e840e9d1b2106f7d3eb71b6ffa08c10658"}
Sep 08 15:29:17.603193 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.603167    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:17.627747 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:17.626005    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg" podStartSLOduration=1.625986137 podStartE2EDuration="1.625986137s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:29:17.621528754 +0000 UTC m=+984.722422866" watchObservedRunningTime="2026-09-08 15:29:17.625986137 +0000 UTC m=+984.726880247"
Sep 08 15:29:18.610034 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:18.609992    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7" event={"ID":"0670cba0-2d4e-4e9a-9912-dedc0715338b","Type":"ContainerStarted","Data":"05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6"}
Sep 08 15:29:18.610548 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:18.610108    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:18.631277 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:18.631231    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7" podStartSLOduration=2.631216156 podStartE2EDuration="2.631216156s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:29:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:29:18.630081198 +0000 UTC m=+985.730975309" watchObservedRunningTime="2026-09-08 15:29:18.631216156 +0000 UTC m=+985.732110267"
Sep 08 15:29:25.770436 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:25.770397    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"]
Sep 08 15:29:25.773705 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:25.773662    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"
Sep 08 15:29:25.776400 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:25.776372    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:29:25.776400 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:25.776379    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:29:25.782040 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:25.782015    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"]
Sep 08 15:29:25.876447 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:25.876418    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac2f8f1a-ec0a-4f47-8310-537be133812d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-60b543-g97r8\" (UID: \"ac2f8f1a-ec0a-4f47-8310-537be133812d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"
Sep 08 15:29:25.977218 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:25.977187    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac2f8f1a-ec0a-4f47-8310-537be133812d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-60b543-g97r8\" (UID: \"ac2f8f1a-ec0a-4f47-8310-537be133812d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"
Sep 08 15:29:25.977822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:25.977801    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac2f8f1a-ec0a-4f47-8310-537be133812d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-60b543-g97r8\" (UID: \"ac2f8f1a-ec0a-4f47-8310-537be133812d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"
Sep 08 15:29:26.084409 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:26.084379    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"
Sep 08 15:29:26.361847 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:26.361822    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"]
Sep 08 15:29:26.364214 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:29:26.364149    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac2f8f1a_ec0a_4f47_8310_537be133812d.slice/crio-60ec658a54cd6302527d37c77147afe3170f565171e8e54e9fb72a46ecf986f8 WatchSource:0}: Error finding container 60ec658a54cd6302527d37c77147afe3170f565171e8e54e9fb72a46ecf986f8: Status 404 returned error can't find the container with id 60ec658a54cd6302527d37c77147afe3170f565171e8e54e9fb72a46ecf986f8
Sep 08 15:29:26.652867 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:26.652777    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8" event={"ID":"ac2f8f1a-ec0a-4f47-8310-537be133812d","Type":"ContainerStarted","Data":"3507635df9f6d2378b8891f9e8d1e0af759dc37fcd0ac7c6218ba9082fea81b8"}
Sep 08 15:29:26.652867 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:26.652829    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8" event={"ID":"ac2f8f1a-ec0a-4f47-8310-537be133812d","Type":"ContainerStarted","Data":"60ec658a54cd6302527d37c77147afe3170f565171e8e54e9fb72a46ecf986f8"}
Sep 08 15:29:26.669568 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:26.669514    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8" podStartSLOduration=1.669498624 podStartE2EDuration="1.669498624s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:29:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:29:26.667524752 +0000 UTC m=+993.768418864" watchObservedRunningTime="2026-09-08 15:29:26.669498624 +0000 UTC m=+993.770392736"
Sep 08 15:29:27.660034 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:27.659996    2556 generic.go:356] "Generic (PLEG): container finished" podID="ac2f8f1a-ec0a-4f47-8310-537be133812d" containerID="3507635df9f6d2378b8891f9e8d1e0af759dc37fcd0ac7c6218ba9082fea81b8" exitCode=0
Sep 08 15:29:27.660397 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:27.660060    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8" event={"ID":"ac2f8f1a-ec0a-4f47-8310-537be133812d","Type":"ContainerDied","Data":"3507635df9f6d2378b8891f9e8d1e0af759dc37fcd0ac7c6218ba9082fea81b8"}
Sep 08 15:29:28.611845 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:28.611808    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:28.794636 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:28.794614    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"
Sep 08 15:29:28.902785 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:28.902687    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac2f8f1a-ec0a-4f47-8310-537be133812d-maas-api-service-ca\") pod \"ac2f8f1a-ec0a-4f47-8310-537be133812d\" (UID: \"ac2f8f1a-ec0a-4f47-8310-537be133812d\") "
Sep 08 15:29:28.903115 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:28.903082    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac2f8f1a-ec0a-4f47-8310-537be133812d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ac2f8f1a-ec0a-4f47-8310-537be133812d" (UID: "ac2f8f1a-ec0a-4f47-8310-537be133812d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:29.004186 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:29.004150    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ac2f8f1a-ec0a-4f47-8310-537be133812d-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:29.617896 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:29.617814    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:29.671308 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:29.671275    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8" event={"ID":"ac2f8f1a-ec0a-4f47-8310-537be133812d","Type":"ContainerDied","Data":"60ec658a54cd6302527d37c77147afe3170f565171e8e54e9fb72a46ecf986f8"}
Sep 08 15:29:29.671308 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:29.671304    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"
Sep 08 15:29:29.671569 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:29.671322    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="60ec658a54cd6302527d37c77147afe3170f565171e8e54e9fb72a46ecf986f8"
Sep 08 15:29:36.372431 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.372393    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"]
Sep 08 15:29:36.373205 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.373169    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg" podUID="cdc63c64-e6f4-4560-ba1d-348b24de361f" containerName="payload-processing" containerID="cri-o://e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a" gracePeriod=30
Sep 08 15:29:36.384057 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.384033    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"]
Sep 08 15:29:36.384270 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.384247    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7" podUID="595a2423-19fb-4176-81b3-5962194ef8a8" containerName="payload-pre-processing" containerID="cri-o://b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea" gracePeriod=30
Sep 08 15:29:36.573775 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.573728    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"]
Sep 08 15:29:36.574682 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.574645    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-60b543-g97r8"]
Sep 08 15:29:36.643442 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.643365    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:29:36.665140 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.665113    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:29:36.705958 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.705926    2556 generic.go:356] "Generic (PLEG): container finished" podID="595a2423-19fb-4176-81b3-5962194ef8a8" containerID="b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea" exitCode=0
Sep 08 15:29:36.706107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.705969    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"
Sep 08 15:29:36.706107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.706004    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7" event={"ID":"595a2423-19fb-4176-81b3-5962194ef8a8","Type":"ContainerDied","Data":"b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea"}
Sep 08 15:29:36.706107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.706059    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7" event={"ID":"595a2423-19fb-4176-81b3-5962194ef8a8","Type":"ContainerDied","Data":"22ee94711d4a361a5223b981234dd298f758b9db084187183add2dbd9d3c950c"}
Sep 08 15:29:36.706107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.706084    2556 scope.go:117] "RemoveContainer" containerID="b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea"
Sep 08 15:29:36.707603 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.707581    2556 generic.go:356] "Generic (PLEG): container finished" podID="cdc63c64-e6f4-4560-ba1d-348b24de361f" containerID="e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a" exitCode=0
Sep 08 15:29:36.707730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.707627    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"
Sep 08 15:29:36.707730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.707656    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg" event={"ID":"cdc63c64-e6f4-4560-ba1d-348b24de361f","Type":"ContainerDied","Data":"e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a"}
Sep 08 15:29:36.707730 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.707712    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg" event={"ID":"cdc63c64-e6f4-4560-ba1d-348b24de361f","Type":"ContainerDied","Data":"38800b7f7e3a27b74c62e1b55e13876efe36f4cbc751cdb9d7e510476ee2dee9"}
Sep 08 15:29:36.714718 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.714702    2556 scope.go:117] "RemoveContainer" containerID="b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea"
Sep 08 15:29:36.715004 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:29:36.714987    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea\": container with ID starting with b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea not found: ID does not exist" containerID="b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea"
Sep 08 15:29:36.715045 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.715013    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea"} err="failed to get container status \"b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea\": rpc error: code = NotFound desc = could not find container \"b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea\": container with ID starting with b1ce12e458e4e4dca18b59b9a24aa27efa179ddf9e863de90ea0767e52599dea not found: ID does not exist"
Sep 08 15:29:36.715045 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.715029    2556 scope.go:117] "RemoveContainer" containerID="e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a"
Sep 08 15:29:36.726132 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.726106    2556 scope.go:117] "RemoveContainer" containerID="e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a"
Sep 08 15:29:36.726473 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:29:36.726454    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a\": container with ID starting with e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a not found: ID does not exist" containerID="e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a"
Sep 08 15:29:36.726542 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.726483    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a"} err="failed to get container status \"e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a\": rpc error: code = NotFound desc = could not find container \"e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a\": container with ID starting with e8d3fe87b8911bc76c115ed89121e2742ef38c2f5ce1333c1f1bccdefe90452a not found: ID does not exist"
Sep 08 15:29:36.769377 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.769347    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdc63c64-e6f4-4560-ba1d-348b24de361f-plugins-config-volume\") pod \"cdc63c64-e6f4-4560-ba1d-348b24de361f\" (UID: \"cdc63c64-e6f4-4560-ba1d-348b24de361f\") "
Sep 08 15:29:36.769580 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.769399    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595a2423-19fb-4176-81b3-5962194ef8a8-plugins-config-volume\") pod \"595a2423-19fb-4176-81b3-5962194ef8a8\" (UID: \"595a2423-19fb-4176-81b3-5962194ef8a8\") "
Sep 08 15:29:36.769580 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.769460    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t75j5\" (UniqueName: \"kubernetes.io/projected/595a2423-19fb-4176-81b3-5962194ef8a8-kube-api-access-t75j5\") pod \"595a2423-19fb-4176-81b3-5962194ef8a8\" (UID: \"595a2423-19fb-4176-81b3-5962194ef8a8\") "
Sep 08 15:29:36.769580 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.769485    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlpfg\" (UniqueName: \"kubernetes.io/projected/cdc63c64-e6f4-4560-ba1d-348b24de361f-kube-api-access-wlpfg\") pod \"cdc63c64-e6f4-4560-ba1d-348b24de361f\" (UID: \"cdc63c64-e6f4-4560-ba1d-348b24de361f\") "
Sep 08 15:29:36.769829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.769799    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdc63c64-e6f4-4560-ba1d-348b24de361f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "cdc63c64-e6f4-4560-ba1d-348b24de361f" (UID: "cdc63c64-e6f4-4560-ba1d-348b24de361f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:36.769953 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.769858    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/595a2423-19fb-4176-81b3-5962194ef8a8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "595a2423-19fb-4176-81b3-5962194ef8a8" (UID: "595a2423-19fb-4176-81b3-5962194ef8a8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:36.771607 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.771580    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/595a2423-19fb-4176-81b3-5962194ef8a8-kube-api-access-t75j5" (OuterVolumeSpecName: "kube-api-access-t75j5") pod "595a2423-19fb-4176-81b3-5962194ef8a8" (UID: "595a2423-19fb-4176-81b3-5962194ef8a8"). InnerVolumeSpecName "kube-api-access-t75j5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:36.771698 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.771584    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdc63c64-e6f4-4560-ba1d-348b24de361f-kube-api-access-wlpfg" (OuterVolumeSpecName: "kube-api-access-wlpfg") pod "cdc63c64-e6f4-4560-ba1d-348b24de361f" (UID: "cdc63c64-e6f4-4560-ba1d-348b24de361f"). InnerVolumeSpecName "kube-api-access-wlpfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:36.870857 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.870820    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/595a2423-19fb-4176-81b3-5962194ef8a8-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:36.870857 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.870852    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t75j5\" (UniqueName: \"kubernetes.io/projected/595a2423-19fb-4176-81b3-5962194ef8a8-kube-api-access-t75j5\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:36.870857 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.870866    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlpfg\" (UniqueName: \"kubernetes.io/projected/cdc63c64-e6f4-4560-ba1d-348b24de361f-kube-api-access-wlpfg\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:36.871099 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:36.870878    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/cdc63c64-e6f4-4560-ba1d-348b24de361f-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:37.029773 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:37.029743    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"]
Sep 08 15:29:37.033463 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:37.033438    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-60b543-5f64f4dc4b-f55c7"]
Sep 08 15:29:37.045093 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:37.045063    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"]
Sep 08 15:29:37.049091 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:37.049064    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-60b543-7fcb5db85-8wmlg"]
Sep 08 15:29:37.355341 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:37.355308    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="595a2423-19fb-4176-81b3-5962194ef8a8" path="/var/lib/kubelet/pods/595a2423-19fb-4176-81b3-5962194ef8a8/volumes"
Sep 08 15:29:37.355641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:37.355624    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac2f8f1a-ec0a-4f47-8310-537be133812d" path="/var/lib/kubelet/pods/ac2f8f1a-ec0a-4f47-8310-537be133812d/volumes"
Sep 08 15:29:37.355971 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:37.355957    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdc63c64-e6f4-4560-ba1d-348b24de361f" path="/var/lib/kubelet/pods/cdc63c64-e6f4-4560-ba1d-348b24de361f/volumes"
Sep 08 15:29:42.763326 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:42.763285    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"]
Sep 08 15:29:42.763812 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:42.763540    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy" containerID="cri-o://1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c" gracePeriod=30
Sep 08 15:29:43.114690 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.114640    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"]
Sep 08 15:29:43.114994 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.114981    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdc63c64-e6f4-4560-ba1d-348b24de361f" containerName="payload-processing"
Sep 08 15:29:43.115036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.114996    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdc63c64-e6f4-4560-ba1d-348b24de361f" containerName="payload-processing"
Sep 08 15:29:43.115036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.115004    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac2f8f1a-ec0a-4f47-8310-537be133812d" containerName="revoke-keys"
Sep 08 15:29:43.115036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.115009    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac2f8f1a-ec0a-4f47-8310-537be133812d" containerName="revoke-keys"
Sep 08 15:29:43.115036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.115023    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="595a2423-19fb-4176-81b3-5962194ef8a8" containerName="payload-pre-processing"
Sep 08 15:29:43.115036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.115028    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="595a2423-19fb-4176-81b3-5962194ef8a8" containerName="payload-pre-processing"
Sep 08 15:29:43.115194 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.115085    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdc63c64-e6f4-4560-ba1d-348b24de361f" containerName="payload-processing"
Sep 08 15:29:43.115194 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.115093    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="595a2423-19fb-4176-81b3-5962194ef8a8" containerName="payload-pre-processing"
Sep 08 15:29:43.115194 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.115099    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac2f8f1a-ec0a-4f47-8310-537be133812d" containerName="revoke-keys"
Sep 08 15:29:43.119354 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.119331    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"
Sep 08 15:29:43.121810 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.121791    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:29:43.121810 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.121806    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:29:43.125246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.125224    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"]
Sep 08 15:29:43.224101 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.224067    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98825148-f5d4-44dc-99f9-28894ffe878b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4\" (UID: \"98825148-f5d4-44dc-99f9-28894ffe878b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"
Sep 08 15:29:43.325334 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.325286    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98825148-f5d4-44dc-99f9-28894ffe878b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4\" (UID: \"98825148-f5d4-44dc-99f9-28894ffe878b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"
Sep 08 15:29:43.325945 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.325923    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98825148-f5d4-44dc-99f9-28894ffe878b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4\" (UID: \"98825148-f5d4-44dc-99f9-28894ffe878b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"
Sep 08 15:29:43.431083 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.430999    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"
Sep 08 15:29:43.699881 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.699805    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"]
Sep 08 15:29:43.702102 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:29:43.702068    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod98825148_f5d4_44dc_99f9_28894ffe878b.slice/crio-3f048521e88071c6dbc4d75faf413fa370b91b916b067d8e9e995c8d85f2ffe1 WatchSource:0}: Error finding container 3f048521e88071c6dbc4d75faf413fa370b91b916b067d8e9e995c8d85f2ffe1: Status 404 returned error can't find the container with id 3f048521e88071c6dbc4d75faf413fa370b91b916b067d8e9e995c8d85f2ffe1
Sep 08 15:29:43.744683 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:43.744639    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4" event={"ID":"98825148-f5d4-44dc-99f9-28894ffe878b","Type":"ContainerStarted","Data":"3f048521e88071c6dbc4d75faf413fa370b91b916b067d8e9e995c8d85f2ffe1"}
Sep 08 15:29:44.758777 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:44.758687    2556 generic.go:356] "Generic (PLEG): container finished" podID="98825148-f5d4-44dc-99f9-28894ffe878b" containerID="ad5353b3c19adb09fb009e0d9656643f70c0b5b2ffe5ed615e7490818737b248" exitCode=0
Sep 08 15:29:44.758777 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:44.758743    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4" event={"ID":"98825148-f5d4-44dc-99f9-28894ffe878b","Type":"ContainerDied","Data":"ad5353b3c19adb09fb009e0d9656643f70c0b5b2ffe5ed615e7490818737b248"}
Sep 08 15:29:45.901801 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:45.901779    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"
Sep 08 15:29:46.048114 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:46.048022    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98825148-f5d4-44dc-99f9-28894ffe878b-maas-api-service-ca\") pod \"98825148-f5d4-44dc-99f9-28894ffe878b\" (UID: \"98825148-f5d4-44dc-99f9-28894ffe878b\") "
Sep 08 15:29:46.048422 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:46.048400    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/98825148-f5d4-44dc-99f9-28894ffe878b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "98825148-f5d4-44dc-99f9-28894ffe878b" (UID: "98825148-f5d4-44dc-99f9-28894ffe878b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:46.149181 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:46.149143    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/98825148-f5d4-44dc-99f9-28894ffe878b-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:46.769340 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:46.769311    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"
Sep 08 15:29:46.769542 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:46.769311    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4" event={"ID":"98825148-f5d4-44dc-99f9-28894ffe878b","Type":"ContainerDied","Data":"3f048521e88071c6dbc4d75faf413fa370b91b916b067d8e9e995c8d85f2ffe1"}
Sep 08 15:29:46.769542 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:46.769432    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f048521e88071c6dbc4d75faf413fa370b91b916b067d8e9e995c8d85f2ffe1"
Sep 08 15:29:47.254418 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.254383    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"]
Sep 08 15:29:47.254821 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.254720    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="98825148-f5d4-44dc-99f9-28894ffe878b" containerName="revoke-keys"
Sep 08 15:29:47.254821 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.254731    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="98825148-f5d4-44dc-99f9-28894ffe878b" containerName="revoke-keys"
Sep 08 15:29:47.254821 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.254795    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="98825148-f5d4-44dc-99f9-28894ffe878b" containerName="revoke-keys"
Sep 08 15:29:47.257818 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.257803    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"
Sep 08 15:29:47.260073 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.260051    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:29:47.260198 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.260116    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:29:47.265258 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.265201    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"]
Sep 08 15:29:47.358886 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.358856    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb48c1c-14d4-45e5-8a94-c9eee288746d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8acdf03d-st94w\" (UID: \"adb48c1c-14d4-45e5-8a94-c9eee288746d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"
Sep 08 15:29:47.460320 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.460284    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb48c1c-14d4-45e5-8a94-c9eee288746d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8acdf03d-st94w\" (UID: \"adb48c1c-14d4-45e5-8a94-c9eee288746d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"
Sep 08 15:29:47.460889 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.460869    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb48c1c-14d4-45e5-8a94-c9eee288746d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8acdf03d-st94w\" (UID: \"adb48c1c-14d4-45e5-8a94-c9eee288746d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"
Sep 08 15:29:47.569266 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.569235    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"
Sep 08 15:29:47.837151 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:47.837128    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"]
Sep 08 15:29:47.846652 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:29:47.846610    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podadb48c1c_14d4_45e5_8a94_c9eee288746d.slice/crio-6073e2760cc1a468a046ff8d06e84e40aa0c345e9445f827ad43a9cd3e1d2123 WatchSource:0}: Error finding container 6073e2760cc1a468a046ff8d06e84e40aa0c345e9445f827ad43a9cd3e1d2123: Status 404 returned error can't find the container with id 6073e2760cc1a468a046ff8d06e84e40aa0c345e9445f827ad43a9cd3e1d2123
Sep 08 15:29:48.008520 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.008496    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:29:48.166344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166323    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-socket\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166452 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166366    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qk2wt\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-kube-api-access-qk2wt\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166452 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166404    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-credential-socket\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166452 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166420    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-podinfo\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166452 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166438    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-token\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166488    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-certs\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166517    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-data\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166541    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istiod-ca-cert\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166579    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-envoy\") pod \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\" (UID: \"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6\") "
Sep 08 15:29:48.166661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166573    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:48.166960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166717    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:48.166960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166816    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-data" (OuterVolumeSpecName: "istio-data") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:48.166960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166895    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.166960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166917    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.166960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166930    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.166960 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.166895    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:48.167274 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.167028    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:48.168477 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.168448    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-kube-api-access-qk2wt" (OuterVolumeSpecName: "kube-api-access-qk2wt") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "kube-api-access-qk2wt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:48.168573 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.168539    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-token" (OuterVolumeSpecName: "istio-token") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:48.168615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.168590    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:29:48.168615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.168597    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" (UID: "91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:29:48.267950 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.267920    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.267950 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.267943    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.267950 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.267952    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.268358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.267960    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.268358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.267970    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qk2wt\" (UniqueName: \"kubernetes.io/projected/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-kube-api-access-qk2wt\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.268358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.267979    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:48.782549 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.782509    2556 generic.go:356] "Generic (PLEG): container finished" podID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerID="1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c" exitCode=0
Sep 08 15:29:48.782715 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.782575    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"
Sep 08 15:29:48.782715 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.782594    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" event={"ID":"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6","Type":"ContainerDied","Data":"1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c"}
Sep 08 15:29:48.782829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.782717    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m" event={"ID":"91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6","Type":"ContainerDied","Data":"be32e516dd2001d2f73f4293a1bcc493a97f1c1741af997495b77d004891d4f9"}
Sep 08 15:29:48.782829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.782757    2556 scope.go:117] "RemoveContainer" containerID="1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c"
Sep 08 15:29:48.784373 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.784348    2556 generic.go:356] "Generic (PLEG): container finished" podID="adb48c1c-14d4-45e5-8a94-c9eee288746d" containerID="9661139ebd10f04aca34220f89af5ee0dc1998b4a7380514c01e7789a86be1cf" exitCode=0
Sep 08 15:29:48.784462 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.784427    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w" event={"ID":"adb48c1c-14d4-45e5-8a94-c9eee288746d","Type":"ContainerDied","Data":"9661139ebd10f04aca34220f89af5ee0dc1998b4a7380514c01e7789a86be1cf"}
Sep 08 15:29:48.784529 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.784488    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w" event={"ID":"adb48c1c-14d4-45e5-8a94-c9eee288746d","Type":"ContainerStarted","Data":"6073e2760cc1a468a046ff8d06e84e40aa0c345e9445f827ad43a9cd3e1d2123"}
Sep 08 15:29:48.791463 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.791448    2556 scope.go:117] "RemoveContainer" containerID="7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723"
Sep 08 15:29:48.799185 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.799168    2556 scope.go:117] "RemoveContainer" containerID="1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c"
Sep 08 15:29:48.799438 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:29:48.799421    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c\": container with ID starting with 1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c not found: ID does not exist" containerID="1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c"
Sep 08 15:29:48.799486 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.799444    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c"} err="failed to get container status \"1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c\": rpc error: code = NotFound desc = could not find container \"1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c\": container with ID starting with 1d92eceabfe4ae9e18ab0a8867bea846cde9b53ed3cb424a94abbd5b7620f33c not found: ID does not exist"
Sep 08 15:29:48.799486 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.799459    2556 scope.go:117] "RemoveContainer" containerID="7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723"
Sep 08 15:29:48.799707 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:29:48.799693    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723\": container with ID starting with 7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723 not found: ID does not exist" containerID="7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723"
Sep 08 15:29:48.799754 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.799711    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723"} err="failed to get container status \"7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723\": rpc error: code = NotFound desc = could not find container \"7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723\": container with ID starting with 7127812facb3239094bc9e7f4865f6c074acd88e37a739b9591cd4b596897723 not found: ID does not exist"
Sep 08 15:29:48.816970 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.816936    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"]
Sep 08 15:29:48.820901 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:48.820880    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-60b543-openshift-default-7455bfc6fd-vcg2m"]
Sep 08 15:29:49.355416 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:49.355378    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" path="/var/lib/kubelet/pods/91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6/volumes"
Sep 08 15:29:49.914815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:49.914794    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"
Sep 08 15:29:50.084326 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:50.084296    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb48c1c-14d4-45e5-8a94-c9eee288746d-maas-api-service-ca\") pod \"adb48c1c-14d4-45e5-8a94-c9eee288746d\" (UID: \"adb48c1c-14d4-45e5-8a94-c9eee288746d\") "
Sep 08 15:29:50.084652 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:50.084626    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/adb48c1c-14d4-45e5-8a94-c9eee288746d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "adb48c1c-14d4-45e5-8a94-c9eee288746d" (UID: "adb48c1c-14d4-45e5-8a94-c9eee288746d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:50.185788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:50.185746    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/adb48c1c-14d4-45e5-8a94-c9eee288746d-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:50.797583 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:50.797552    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w" event={"ID":"adb48c1c-14d4-45e5-8a94-c9eee288746d","Type":"ContainerDied","Data":"6073e2760cc1a468a046ff8d06e84e40aa0c345e9445f827ad43a9cd3e1d2123"}
Sep 08 15:29:50.797995 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:50.797598    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6073e2760cc1a468a046ff8d06e84e40aa0c345e9445f827ad43a9cd3e1d2123"
Sep 08 15:29:50.797995 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:50.797566    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"
Sep 08 15:29:53.951551 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:53.951515    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"]
Sep 08 15:29:53.952047 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:53.951803    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw" podUID="ba804955-a016-43e9-89ca-59a0d64240c0" containerName="payload-processing" containerID="cri-o://ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864" gracePeriod=30
Sep 08 15:29:54.105145 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.105112    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"]
Sep 08 15:29:54.106699 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.106657    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-b75273-sgvw4"]
Sep 08 15:29:54.206625 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.206558    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:29:54.319607 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.319576    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba804955-a016-43e9-89ca-59a0d64240c0-plugins-config-volume\") pod \"ba804955-a016-43e9-89ca-59a0d64240c0\" (UID: \"ba804955-a016-43e9-89ca-59a0d64240c0\") "
Sep 08 15:29:54.319804 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.319649    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbxsg\" (UniqueName: \"kubernetes.io/projected/ba804955-a016-43e9-89ca-59a0d64240c0-kube-api-access-kbxsg\") pod \"ba804955-a016-43e9-89ca-59a0d64240c0\" (UID: \"ba804955-a016-43e9-89ca-59a0d64240c0\") "
Sep 08 15:29:54.320041 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.320008    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba804955-a016-43e9-89ca-59a0d64240c0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ba804955-a016-43e9-89ca-59a0d64240c0" (UID: "ba804955-a016-43e9-89ca-59a0d64240c0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:54.321689 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.321652    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba804955-a016-43e9-89ca-59a0d64240c0-kube-api-access-kbxsg" (OuterVolumeSpecName: "kube-api-access-kbxsg") pod "ba804955-a016-43e9-89ca-59a0d64240c0" (UID: "ba804955-a016-43e9-89ca-59a0d64240c0"). InnerVolumeSpecName "kube-api-access-kbxsg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:54.420784 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.420756    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbxsg\" (UniqueName: \"kubernetes.io/projected/ba804955-a016-43e9-89ca-59a0d64240c0-kube-api-access-kbxsg\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:54.420784 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.420779    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ba804955-a016-43e9-89ca-59a0d64240c0-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:54.817608 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.817567    2556 generic.go:356] "Generic (PLEG): container finished" podID="ba804955-a016-43e9-89ca-59a0d64240c0" containerID="ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864" exitCode=0
Sep 08 15:29:54.817608 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.817608    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"
Sep 08 15:29:54.817893 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.817612    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw" event={"ID":"ba804955-a016-43e9-89ca-59a0d64240c0","Type":"ContainerDied","Data":"ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864"}
Sep 08 15:29:54.817893 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.817689    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw" event={"ID":"ba804955-a016-43e9-89ca-59a0d64240c0","Type":"ContainerDied","Data":"758dba2c0ce2a9969b5f1ff18272aef35f9ffdc543f94a6061d9dd04fe41efbd"}
Sep 08 15:29:54.817893 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.817722    2556 scope.go:117] "RemoveContainer" containerID="ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864"
Sep 08 15:29:54.826870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.826854    2556 scope.go:117] "RemoveContainer" containerID="ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864"
Sep 08 15:29:54.827202 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:29:54.827182    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864\": container with ID starting with ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864 not found: ID does not exist" containerID="ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864"
Sep 08 15:29:54.827274 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.827223    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864"} err="failed to get container status \"ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864\": rpc error: code = NotFound desc = could not find container \"ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864\": container with ID starting with ee75df5170e4296d18c52dff93170a8207cb1783b84853593ce28c14fc9ab864 not found: ID does not exist"
Sep 08 15:29:54.842062 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.842036    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"]
Sep 08 15:29:54.846354 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:54.846333    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-b75273-7cb76bcfbc-hm2nw"]
Sep 08 15:29:55.354110 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:55.354070    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="98825148-f5d4-44dc-99f9-28894ffe878b" path="/var/lib/kubelet/pods/98825148-f5d4-44dc-99f9-28894ffe878b/volumes"
Sep 08 15:29:55.354589 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:55.354566    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba804955-a016-43e9-89ca-59a0d64240c0" path="/var/lib/kubelet/pods/ba804955-a016-43e9-89ca-59a0d64240c0/volumes"
Sep 08 15:29:58.159487 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.159455    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"]
Sep 08 15:29:58.159920 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.159658    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7" podUID="0670cba0-2d4e-4e9a-9912-dedc0715338b" containerName="payload-processing" containerID="cri-o://05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6" gracePeriod=30
Sep 08 15:29:58.178740 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.178715    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"]
Sep 08 15:29:58.178933 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.178913    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg" podUID="836ea6d8-eba3-4b4b-b092-6ccd60f2805e" containerName="payload-pre-processing" containerID="cri-o://22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f" gracePeriod=30
Sep 08 15:29:58.331903 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.331872    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"]
Sep 08 15:29:58.340020 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.337193    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8acdf03d-st94w"]
Sep 08 15:29:58.454510 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.454485    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:58.457473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.457455    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:58.555246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.555220    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-plugins-config-volume\") pod \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\" (UID: \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\") "
Sep 08 15:29:58.555436 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.555258    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxx6h\" (UniqueName: \"kubernetes.io/projected/0670cba0-2d4e-4e9a-9912-dedc0715338b-kube-api-access-wxx6h\") pod \"0670cba0-2d4e-4e9a-9912-dedc0715338b\" (UID: \"0670cba0-2d4e-4e9a-9912-dedc0715338b\") "
Sep 08 15:29:58.555436 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.555329    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rv7n6\" (UniqueName: \"kubernetes.io/projected/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-kube-api-access-rv7n6\") pod \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\" (UID: \"836ea6d8-eba3-4b4b-b092-6ccd60f2805e\") "
Sep 08 15:29:58.555436 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.555358    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0670cba0-2d4e-4e9a-9912-dedc0715338b-plugins-config-volume\") pod \"0670cba0-2d4e-4e9a-9912-dedc0715338b\" (UID: \"0670cba0-2d4e-4e9a-9912-dedc0715338b\") "
Sep 08 15:29:58.555685 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.555643    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "836ea6d8-eba3-4b4b-b092-6ccd60f2805e" (UID: "836ea6d8-eba3-4b4b-b092-6ccd60f2805e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:58.555931 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.555901    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0670cba0-2d4e-4e9a-9912-dedc0715338b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0670cba0-2d4e-4e9a-9912-dedc0715338b" (UID: "0670cba0-2d4e-4e9a-9912-dedc0715338b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:29:58.557461 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.557437    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-kube-api-access-rv7n6" (OuterVolumeSpecName: "kube-api-access-rv7n6") pod "836ea6d8-eba3-4b4b-b092-6ccd60f2805e" (UID: "836ea6d8-eba3-4b4b-b092-6ccd60f2805e"). InnerVolumeSpecName "kube-api-access-rv7n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:58.557550 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.557464    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0670cba0-2d4e-4e9a-9912-dedc0715338b-kube-api-access-wxx6h" (OuterVolumeSpecName: "kube-api-access-wxx6h") pod "0670cba0-2d4e-4e9a-9912-dedc0715338b" (UID: "0670cba0-2d4e-4e9a-9912-dedc0715338b"). InnerVolumeSpecName "kube-api-access-wxx6h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:29:58.656076 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.656048    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0670cba0-2d4e-4e9a-9912-dedc0715338b-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:58.656076 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.656071    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:58.656076 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.656080    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxx6h\" (UniqueName: \"kubernetes.io/projected/0670cba0-2d4e-4e9a-9912-dedc0715338b-kube-api-access-wxx6h\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:58.656264 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.656088    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rv7n6\" (UniqueName: \"kubernetes.io/projected/836ea6d8-eba3-4b4b-b092-6ccd60f2805e-kube-api-access-rv7n6\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:29:58.839507 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.839472    2556 generic.go:356] "Generic (PLEG): container finished" podID="836ea6d8-eba3-4b4b-b092-6ccd60f2805e" containerID="22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f" exitCode=0
Sep 08 15:29:58.839650 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.839510    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"
Sep 08 15:29:58.839650 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.839553    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg" event={"ID":"836ea6d8-eba3-4b4b-b092-6ccd60f2805e","Type":"ContainerDied","Data":"22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f"}
Sep 08 15:29:58.839650 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.839603    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg" event={"ID":"836ea6d8-eba3-4b4b-b092-6ccd60f2805e","Type":"ContainerDied","Data":"7a3f50e2ab70f8004c4c701b786ad9e840e9d1b2106f7d3eb71b6ffa08c10658"}
Sep 08 15:29:58.839650 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.839631    2556 scope.go:117] "RemoveContainer" containerID="22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f"
Sep 08 15:29:58.841220 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.841192    2556 generic.go:356] "Generic (PLEG): container finished" podID="0670cba0-2d4e-4e9a-9912-dedc0715338b" containerID="05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6" exitCode=0
Sep 08 15:29:58.841345 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.841239    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"
Sep 08 15:29:58.841345 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.841305    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7" event={"ID":"0670cba0-2d4e-4e9a-9912-dedc0715338b","Type":"ContainerDied","Data":"05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6"}
Sep 08 15:29:58.841469 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.841347    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7" event={"ID":"0670cba0-2d4e-4e9a-9912-dedc0715338b","Type":"ContainerDied","Data":"38ade93251eb6f6a147c07e979b4a98dcbe1b8cc784a7785c86854baa9304019"}
Sep 08 15:29:58.849277 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.849242    2556 scope.go:117] "RemoveContainer" containerID="22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f"
Sep 08 15:29:58.849594 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:29:58.849574    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f\": container with ID starting with 22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f not found: ID does not exist" containerID="22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f"
Sep 08 15:29:58.849691 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.849601    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f"} err="failed to get container status \"22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f\": rpc error: code = NotFound desc = could not find container \"22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f\": container with ID starting with 22363113f2c84709a5b28b66049231d45d2f5c1e3f759b18f09af135a533d60f not found: ID does not exist"
Sep 08 15:29:58.849691 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.849618    2556 scope.go:117] "RemoveContainer" containerID="05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6"
Sep 08 15:29:58.857325 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.857306    2556 scope.go:117] "RemoveContainer" containerID="05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6"
Sep 08 15:29:58.857607 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:29:58.857589    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6\": container with ID starting with 05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6 not found: ID does not exist" containerID="05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6"
Sep 08 15:29:58.857694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.857613    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6"} err="failed to get container status \"05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6\": rpc error: code = NotFound desc = could not find container \"05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6\": container with ID starting with 05a287bb8a4878ec0a46117b0fcf2a33abdb2bfbfe9f30985c95911a610d87f6 not found: ID does not exist"
Sep 08 15:29:58.864623 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.864606    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"]
Sep 08 15:29:58.870581 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.870558    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-8acdf03d-6cff7686df-v29k7"]
Sep 08 15:29:58.880633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.880613    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"]
Sep 08 15:29:58.884503 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:58.884485    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-8acdf03d-7cdbc775f4-wxvbg"]
Sep 08 15:29:59.355485 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:59.355451    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0670cba0-2d4e-4e9a-9912-dedc0715338b" path="/var/lib/kubelet/pods/0670cba0-2d4e-4e9a-9912-dedc0715338b/volumes"
Sep 08 15:29:59.356008 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:59.355986    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="836ea6d8-eba3-4b4b-b092-6ccd60f2805e" path="/var/lib/kubelet/pods/836ea6d8-eba3-4b4b-b092-6ccd60f2805e/volumes"
Sep 08 15:29:59.356333 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:29:59.356315    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="adb48c1c-14d4-45e5-8a94-c9eee288746d" path="/var/lib/kubelet/pods/adb48c1c-14d4-45e5-8a94-c9eee288746d/volumes"
Sep 08 15:30:00.136357 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136326    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn"]
Sep 08 15:30:00.136631 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136620    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy"
Sep 08 15:30:00.136700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136633    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy"
Sep 08 15:30:00.136700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136643    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy"
Sep 08 15:30:00.136700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136649    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy"
Sep 08 15:30:00.136700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136656    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="836ea6d8-eba3-4b4b-b092-6ccd60f2805e" containerName="payload-pre-processing"
Sep 08 15:30:00.136700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136662    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="836ea6d8-eba3-4b4b-b092-6ccd60f2805e" containerName="payload-pre-processing"
Sep 08 15:30:00.136700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136686    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba804955-a016-43e9-89ca-59a0d64240c0" containerName="payload-processing"
Sep 08 15:30:00.136700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136693    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba804955-a016-43e9-89ca-59a0d64240c0" containerName="payload-processing"
Sep 08 15:30:00.136700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136702    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0670cba0-2d4e-4e9a-9912-dedc0715338b" containerName="payload-processing"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136708    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0670cba0-2d4e-4e9a-9912-dedc0715338b" containerName="payload-processing"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136719    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="adb48c1c-14d4-45e5-8a94-c9eee288746d" containerName="revoke-keys"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136724    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="adb48c1c-14d4-45e5-8a94-c9eee288746d" containerName="revoke-keys"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136769    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136776    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="adb48c1c-14d4-45e5-8a94-c9eee288746d" containerName="revoke-keys"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136785    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba804955-a016-43e9-89ca-59a0d64240c0" containerName="payload-processing"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136791    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="836ea6d8-eba3-4b4b-b092-6ccd60f2805e" containerName="payload-pre-processing"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136796    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="91a35c98-c7ad-4a0f-bbd0-4488a70b4ed6" containerName="istio-proxy"
Sep 08 15:30:00.136938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.136802    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0670cba0-2d4e-4e9a-9912-dedc0715338b" containerName="payload-processing"
Sep 08 15:30:00.141116 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.141097    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn"
Sep 08 15:30:00.144009 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.143988    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:30:00.150843 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.150823    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn"]
Sep 08 15:30:00.151860 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.151840    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn"
Sep 08 15:30:00.427111 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.426963    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn"]
Sep 08 15:30:00.429871 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:30:00.429843    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb654a8cb_ac85_46a2_80b6_a88c2004aa0e.slice/crio-02e08ab394ce954a18489dc985c2bcd4354d953a6a3c43a57179107f1550bbbb WatchSource:0}: Error finding container 02e08ab394ce954a18489dc985c2bcd4354d953a6a3c43a57179107f1550bbbb: Status 404 returned error can't find the container with id 02e08ab394ce954a18489dc985c2bcd4354d953a6a3c43a57179107f1550bbbb
Sep 08 15:30:00.855014 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.854903    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn" event={"ID":"b654a8cb-ac85-46a2-80b6-a88c2004aa0e","Type":"ContainerStarted","Data":"c77b8d5fc6ff92b1e60a32a6a2e784ed9437b2af16b05d49d62bed3640b31eae"}
Sep 08 15:30:00.855014 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.854966    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn" event={"ID":"b654a8cb-ac85-46a2-80b6-a88c2004aa0e","Type":"ContainerStarted","Data":"02e08ab394ce954a18489dc985c2bcd4354d953a6a3c43a57179107f1550bbbb"}
Sep 08 15:30:00.870620 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:00.870572    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn" podStartSLOduration=0.87055843 podStartE2EDuration="870.55843ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:00.869606928 +0000 UTC m=+1027.970501051" watchObservedRunningTime="2026-09-08 15:30:00.87055843 +0000 UTC m=+1027.971452540"
Sep 08 15:30:01.765009 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.764931    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"]
Sep 08 15:30:01.768202 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.768180    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.771258 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.771236    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-fc867c-openshift-default-dockercfg-rnnvf\""
Sep 08 15:30:01.782329 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782303    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qxnd\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-kube-api-access-2qxnd\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.782516 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782339    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-certs\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.782516 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-envoy\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.782516 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782419    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-credential-socket\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.782516 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782434    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-data\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.782516 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782476    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-podinfo\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.782819 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782527    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-socket\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.782819 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782580    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-token\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.782819 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.782651    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istiod-ca-cert\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.784317 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.784298    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"]
Sep 08 15:30:01.861966 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.861936    2556 generic.go:356] "Generic (PLEG): container finished" podID="b654a8cb-ac85-46a2-80b6-a88c2004aa0e" containerID="c77b8d5fc6ff92b1e60a32a6a2e784ed9437b2af16b05d49d62bed3640b31eae" exitCode=0
Sep 08 15:30:01.862109 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.862033    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn" event={"ID":"b654a8cb-ac85-46a2-80b6-a88c2004aa0e","Type":"ContainerDied","Data":"c77b8d5fc6ff92b1e60a32a6a2e784ed9437b2af16b05d49d62bed3640b31eae"}
Sep 08 15:30:01.883589 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.883555    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-podinfo\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.883589 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.883593    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-socket\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.883822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.883616    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-token\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.883822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.883649    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istiod-ca-cert\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.883822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.883695    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qxnd\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-kube-api-access-2qxnd\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.883822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.883713    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-certs\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.883822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.883743    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-envoy\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.884102 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.884060    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-socket\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.884165 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.884140    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-credential-socket\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.884219 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.884174    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-certs\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.884219 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.884183    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-data\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.884340 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.884300    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-credential-socket\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.884441 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.884425    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istiod-ca-cert\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.884487 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.884453    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-data\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.886119 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.886099    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-envoy\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.886219 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.886204    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-podinfo\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.894286 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.894263    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-token\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:01.894759 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:01.894742    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qxnd\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-kube-api-access-2qxnd\") pod \"e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") " pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:02.077793 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.077747    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:02.358690 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.358588    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"]
Sep 08 15:30:02.366115 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:30:02.366073    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1370fa5a_2cb4_4b06_bd00_8669a05acb7d.slice/crio-b9fb816edd0bf4cc0869a04e2989849ae0eb532f32042613162662ee5aeea5dd WatchSource:0}: Error finding container b9fb816edd0bf4cc0869a04e2989849ae0eb532f32042613162662ee5aeea5dd: Status 404 returned error can't find the container with id b9fb816edd0bf4cc0869a04e2989849ae0eb532f32042613162662ee5aeea5dd
Sep 08 15:30:02.367928 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.367894    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:02.367993 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.367962    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:02.368034 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.367991    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:02.869050 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.869014    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" event={"ID":"1370fa5a-2cb4-4b06-bd00-8669a05acb7d","Type":"ContainerStarted","Data":"5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870"}
Sep 08 15:30:02.869537 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.869068    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" event={"ID":"1370fa5a-2cb4-4b06-bd00-8669a05acb7d","Type":"ContainerStarted","Data":"b9fb816edd0bf4cc0869a04e2989849ae0eb532f32042613162662ee5aeea5dd"}
Sep 08 15:30:02.889250 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.889187    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" podStartSLOduration=1.88917057 podStartE2EDuration="1.88917057s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:02.887658625 +0000 UTC m=+1029.988552736" watchObservedRunningTime="2026-09-08 15:30:02.88917057 +0000 UTC m=+1029.990064706"
Sep 08 15:30:02.997074 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:02.997045    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn"
Sep 08 15:30:03.078682 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:03.078631    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:03.083594 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:03.083563    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:03.874533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:03.874504    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn"
Sep 08 15:30:03.874533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:03.874506    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814690-5c4fn" event={"ID":"b654a8cb-ac85-46a2-80b6-a88c2004aa0e","Type":"ContainerDied","Data":"02e08ab394ce954a18489dc985c2bcd4354d953a6a3c43a57179107f1550bbbb"}
Sep 08 15:30:03.875092 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:03.874568    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02e08ab394ce954a18489dc985c2bcd4354d953a6a3c43a57179107f1550bbbb"
Sep 08 15:30:03.875092 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:03.874692    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:03.875653 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:03.875636    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:06.773295 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.773260    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"]
Sep 08 15:30:06.773644 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.773581    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b654a8cb-ac85-46a2-80b6-a88c2004aa0e" containerName="cleanup"
Sep 08 15:30:06.773644 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.773593    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="b654a8cb-ac85-46a2-80b6-a88c2004aa0e" containerName="cleanup"
Sep 08 15:30:06.773759 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.773658    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="b654a8cb-ac85-46a2-80b6-a88c2004aa0e" containerName="cleanup"
Sep 08 15:30:06.776624 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.776601    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:06.780078 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.780059    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-fc867c-dockercfg-2c956\""
Sep 08 15:30:06.781170 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.781154    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-fc867c\""
Sep 08 15:30:06.789559 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.789540    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"]
Sep 08 15:30:06.826978 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.826950    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b576759-2af2-4d87-bffa-72b5e98e5e55-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw\" (UID: \"4b576759-2af2-4d87-bffa-72b5e98e5e55\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:06.827086 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.827046    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7ddv\" (UniqueName: \"kubernetes.io/projected/4b576759-2af2-4d87-bffa-72b5e98e5e55-kube-api-access-j7ddv\") pod \"payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw\" (UID: \"4b576759-2af2-4d87-bffa-72b5e98e5e55\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:06.928024 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.927992    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7ddv\" (UniqueName: \"kubernetes.io/projected/4b576759-2af2-4d87-bffa-72b5e98e5e55-kube-api-access-j7ddv\") pod \"payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw\" (UID: \"4b576759-2af2-4d87-bffa-72b5e98e5e55\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:06.928194 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.928037    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b576759-2af2-4d87-bffa-72b5e98e5e55-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw\" (UID: \"4b576759-2af2-4d87-bffa-72b5e98e5e55\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:06.928733 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.928714    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b576759-2af2-4d87-bffa-72b5e98e5e55-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw\" (UID: \"4b576759-2af2-4d87-bffa-72b5e98e5e55\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:06.939947 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:06.939924    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7ddv\" (UniqueName: \"kubernetes.io/projected/4b576759-2af2-4d87-bffa-72b5e98e5e55-kube-api-access-j7ddv\") pod \"payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw\" (UID: \"4b576759-2af2-4d87-bffa-72b5e98e5e55\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:07.086905 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:07.086870    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:07.365993 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:07.365969    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"]
Sep 08 15:30:07.368028 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:30:07.367992    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b576759_2af2_4d87_bffa_72b5e98e5e55.slice/crio-6ace55b6beb9be0429796429f9557203de87ce268eded098a864acf9af05adce WatchSource:0}: Error finding container 6ace55b6beb9be0429796429f9557203de87ce268eded098a864acf9af05adce: Status 404 returned error can't find the container with id 6ace55b6beb9be0429796429f9557203de87ce268eded098a864acf9af05adce
Sep 08 15:30:07.897180 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:07.897140    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw" event={"ID":"4b576759-2af2-4d87-bffa-72b5e98e5e55","Type":"ContainerStarted","Data":"65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd"}
Sep 08 15:30:07.897585 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:07.897193    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw" event={"ID":"4b576759-2af2-4d87-bffa-72b5e98e5e55","Type":"ContainerStarted","Data":"6ace55b6beb9be0429796429f9557203de87ce268eded098a864acf9af05adce"}
Sep 08 15:30:07.897585 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:07.897277    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:07.922603 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:07.922547    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw" podStartSLOduration=1.9225305320000001 podStartE2EDuration="1.922530532s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:07.921267161 +0000 UTC m=+1035.022161296" watchObservedRunningTime="2026-09-08 15:30:07.922530532 +0000 UTC m=+1035.023424633"
Sep 08 15:30:18.875647 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.875608    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 15:30:18.876073 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.875690    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 15:30:18.904827 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.904804    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:30:18.950923 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.950896    2556 generic.go:356] "Generic (PLEG): container finished" podID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerID="5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870" exitCode=0
Sep 08 15:30:18.951047 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.950961    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" event={"ID":"1370fa5a-2cb4-4b06-bd00-8669a05acb7d","Type":"ContainerDied","Data":"5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870"}
Sep 08 15:30:18.951286 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.951273    2556 scope.go:117] "RemoveContainer" containerID="5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870"
Sep 08 15:30:18.952404 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.952365    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:18.952481 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.952463    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:18.952524 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:18.952511    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:19.961786 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:19.961739    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" event={"ID":"1370fa5a-2cb4-4b06-bd00-8669a05acb7d","Type":"ContainerStarted","Data":"7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce"}
Sep 08 15:30:20.078346 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:20.078308    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:20.078678 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:20.078646    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 15:30:20.078798 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:20.078728    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 15:30:21.078541 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:21.078506    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 15:30:21.079005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:21.078563    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 15:30:22.078311 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:22.078272    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 15:30:22.078500 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:22.078331    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 15:30:23.079051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:23.079011    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 15:30:23.079514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:23.079074    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 15:30:24.078110 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.078072    2556 patch_prober.go:28] interesting pod/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused" start-of-body=
Sep 08 15:30:24.078280 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.078129    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.58:15021/healthz/ready\": dial tcp 10.133.0.58:15021: connect: connection refused"
Sep 08 15:30:24.407735 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.407642    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"]
Sep 08 15:30:24.410853 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.410837    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:24.413875 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.413851    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-020a18-dockercfg-8tr5v\""
Sep 08 15:30:24.413994 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.413916    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-020a18\""
Sep 08 15:30:24.427758 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.427738    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"]
Sep 08 15:30:24.479405 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.479263    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d5ht\" (UniqueName: \"kubernetes.io/projected/2d05fd9d-8dc6-4570-9021-52b3315edd32-kube-api-access-8d5ht\") pod \"payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp\" (UID: \"2d05fd9d-8dc6-4570-9021-52b3315edd32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:24.479405 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.479325    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d05fd9d-8dc6-4570-9021-52b3315edd32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp\" (UID: \"2d05fd9d-8dc6-4570-9021-52b3315edd32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:24.580518 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.580481    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d5ht\" (UniqueName: \"kubernetes.io/projected/2d05fd9d-8dc6-4570-9021-52b3315edd32-kube-api-access-8d5ht\") pod \"payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp\" (UID: \"2d05fd9d-8dc6-4570-9021-52b3315edd32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:24.580696 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.580545    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d05fd9d-8dc6-4570-9021-52b3315edd32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp\" (UID: \"2d05fd9d-8dc6-4570-9021-52b3315edd32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:24.581258 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.581240    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d05fd9d-8dc6-4570-9021-52b3315edd32-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp\" (UID: \"2d05fd9d-8dc6-4570-9021-52b3315edd32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:24.590159 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.590140    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d5ht\" (UniqueName: \"kubernetes.io/projected/2d05fd9d-8dc6-4570-9021-52b3315edd32-kube-api-access-8d5ht\") pod \"payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp\" (UID: \"2d05fd9d-8dc6-4570-9021-52b3315edd32\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:24.721391 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:24.721308    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:25.019810 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:25.019782    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"]
Sep 08 15:30:25.023036 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:30:25.023001    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d05fd9d_8dc6_4570_9021_52b3315edd32.slice/crio-1da310bcedd68a769496ff80f503c806bcc0b22175182822ccd54b7e168983a9 WatchSource:0}: Error finding container 1da310bcedd68a769496ff80f503c806bcc0b22175182822ccd54b7e168983a9: Status 404 returned error can't find the container with id 1da310bcedd68a769496ff80f503c806bcc0b22175182822ccd54b7e168983a9
Sep 08 15:30:25.093814 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:25.093774    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:25.094191 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:25.094169    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:25.095139 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:25.095120    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:30:25.993588 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:25.993547    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp" event={"ID":"2d05fd9d-8dc6-4570-9021-52b3315edd32","Type":"ContainerStarted","Data":"3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec"}
Sep 08 15:30:25.994043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:25.993613    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp" event={"ID":"2d05fd9d-8dc6-4570-9021-52b3315edd32","Type":"ContainerStarted","Data":"1da310bcedd68a769496ff80f503c806bcc0b22175182822ccd54b7e168983a9"}
Sep 08 15:30:25.994043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:25.993772    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:26.018438 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:26.018389    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp" podStartSLOduration=2.01837376 podStartE2EDuration="2.01837376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:26.016193032 +0000 UTC m=+1053.117087156" watchObservedRunningTime="2026-09-08 15:30:26.01837376 +0000 UTC m=+1053.119267914"
Sep 08 15:30:35.569825 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.569789    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"]
Sep 08 15:30:35.573482 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.573458    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:35.576822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.576802    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-565cd7\""
Sep 08 15:30:35.585489 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.585466    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"]
Sep 08 15:30:35.675697 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.675637    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z27hn\" (UniqueName: \"kubernetes.io/projected/5bf311b5-7881-4afb-b108-8ba2dbbf164f-kube-api-access-z27hn\") pod \"payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm\" (UID: \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:35.675923 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.675897    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bf311b5-7881-4afb-b108-8ba2dbbf164f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm\" (UID: \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:35.776510 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.776476    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bf311b5-7881-4afb-b108-8ba2dbbf164f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm\" (UID: \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:35.776696 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.776588    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z27hn\" (UniqueName: \"kubernetes.io/projected/5bf311b5-7881-4afb-b108-8ba2dbbf164f-kube-api-access-z27hn\") pod \"payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm\" (UID: \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:35.777192 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.777171    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bf311b5-7881-4afb-b108-8ba2dbbf164f-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm\" (UID: \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:35.786262 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.786236    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z27hn\" (UniqueName: \"kubernetes.io/projected/5bf311b5-7881-4afb-b108-8ba2dbbf164f-kube-api-access-z27hn\") pod \"payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm\" (UID: \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:35.883917 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:35.883830    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:36.156309 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:36.156283    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"]
Sep 08 15:30:36.158796 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:30:36.158768    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bf311b5_7881_4afb_b108_8ba2dbbf164f.slice/crio-d1530b18587ece2a60c3eb1e39cc06b5911d4cf3f7f05998afd087780c37bd14 WatchSource:0}: Error finding container d1530b18587ece2a60c3eb1e39cc06b5911d4cf3f7f05998afd087780c37bd14: Status 404 returned error can't find the container with id d1530b18587ece2a60c3eb1e39cc06b5911d4cf3f7f05998afd087780c37bd14
Sep 08 15:30:37.001083 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:37.001052    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:30:37.051567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:37.051531    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm" event={"ID":"5bf311b5-7881-4afb-b108-8ba2dbbf164f","Type":"ContainerStarted","Data":"6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef"}
Sep 08 15:30:37.051763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:37.051593    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm" event={"ID":"5bf311b5-7881-4afb-b108-8ba2dbbf164f","Type":"ContainerStarted","Data":"d1530b18587ece2a60c3eb1e39cc06b5911d4cf3f7f05998afd087780c37bd14"}
Sep 08 15:30:37.051763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:37.051623    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:37.080612 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:37.080450    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm" podStartSLOduration=2.0804334 podStartE2EDuration="2.0804334s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:37.079148706 +0000 UTC m=+1064.180042818" watchObservedRunningTime="2026-09-08 15:30:37.0804334 +0000 UTC m=+1064.181327512"
Sep 08 15:30:47.977048 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:47.976963    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"]
Sep 08 15:30:47.980424 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:47.980402    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:47.983400 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:47.983374    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-d62b4e-openshift-default-dockercfg-wnjk6\""
Sep 08 15:30:48.003285 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.003260    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"]
Sep 08 15:30:48.059377 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.059348    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:30:48.086826 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.086781    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-data\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.087006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.086889    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-podinfo\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.087006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.086938    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-token\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.087006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.086989    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp5xg\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-kube-api-access-rp5xg\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.087143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.087052    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74bdbb6e-1f70-487e-80a6-480794e7ad59-istiod-ca-cert\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.087143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.087106    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-socket\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.087143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.087123    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-certs\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.087425 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.087193    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-credential-socket\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.087425 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.087224    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-envoy\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188459 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188426    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-podinfo\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188459 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188463    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-token\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188664 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188479    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp5xg\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-kube-api-access-rp5xg\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188741 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188712    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74bdbb6e-1f70-487e-80a6-480794e7ad59-istiod-ca-cert\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188822 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188803    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-socket\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188884 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188835    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-certs\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188884 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188878    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-credential-socket\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188990 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188905    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-envoy\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.188990 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.188936    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-data\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.189245 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.189219    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-socket\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.189339 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.189248    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-credential-socket\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.189339 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.189327    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-certs\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.189455 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.189379    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-data\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.189511 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.189466    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74bdbb6e-1f70-487e-80a6-480794e7ad59-istiod-ca-cert\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.191125 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.191095    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-envoy\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.191308 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.191282    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-podinfo\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.199046 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.199020    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp5xg\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-kube-api-access-rp5xg\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.199168 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.199152    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-token\") pod \"e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") " pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.290548 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.290482    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:48.598883 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.598856    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"]
Sep 08 15:30:48.601711 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:30:48.601682    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74bdbb6e_1f70_487e_80a6_480794e7ad59.slice/crio-7038d325061b626c22062150f9b4f175936a7a94c492c1d7de79ae47933f4b6e WatchSource:0}: Error finding container 7038d325061b626c22062150f9b4f175936a7a94c492c1d7de79ae47933f4b6e: Status 404 returned error can't find the container with id 7038d325061b626c22062150f9b4f175936a7a94c492c1d7de79ae47933f4b6e
Sep 08 15:30:48.604209 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.604174    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:48.604283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.604241    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:48.604283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:48.604270    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:30:49.113844 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:49.113804    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" event={"ID":"74bdbb6e-1f70-487e-80a6-480794e7ad59","Type":"ContainerStarted","Data":"bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722"}
Sep 08 15:30:49.114251 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:49.113856    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" event={"ID":"74bdbb6e-1f70-487e-80a6-480794e7ad59","Type":"ContainerStarted","Data":"7038d325061b626c22062150f9b4f175936a7a94c492c1d7de79ae47933f4b6e"}
Sep 08 15:30:49.145894 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:49.145844    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podStartSLOduration=2.145827418 podStartE2EDuration="2.145827418s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:49.145219577 +0000 UTC m=+1076.246113699" watchObservedRunningTime="2026-09-08 15:30:49.145827418 +0000 UTC m=+1076.246721529"
Sep 08 15:30:49.290624 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:49.290584    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:49.296028 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:49.295998    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:50.119898 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:50.119864    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:50.120789 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:50.120769    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:30:53.131441 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.131404    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"]
Sep 08 15:30:53.135273 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.135254    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:53.139790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.139770    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-d62b4e-dockercfg-6tr6c\""
Sep 08 15:30:53.140019 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.140005    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-d62b4e\""
Sep 08 15:30:53.148866 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.148841    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"]
Sep 08 15:30:53.228191 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.228146    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d86ps\" (UniqueName: \"kubernetes.io/projected/4ee60fab-0aff-41fc-b148-435d423be639-kube-api-access-d86ps\") pod \"payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh\" (UID: \"4ee60fab-0aff-41fc-b148-435d423be639\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:53.228376 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.228300    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ee60fab-0aff-41fc-b148-435d423be639-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh\" (UID: \"4ee60fab-0aff-41fc-b148-435d423be639\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:53.329515 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.329483    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d86ps\" (UniqueName: \"kubernetes.io/projected/4ee60fab-0aff-41fc-b148-435d423be639-kube-api-access-d86ps\") pod \"payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh\" (UID: \"4ee60fab-0aff-41fc-b148-435d423be639\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:53.329703 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.329644    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ee60fab-0aff-41fc-b148-435d423be639-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh\" (UID: \"4ee60fab-0aff-41fc-b148-435d423be639\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:53.332203 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.332186    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-d62b4e\""
Sep 08 15:30:53.338122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.338100    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d86ps\" (UniqueName: \"kubernetes.io/projected/4ee60fab-0aff-41fc-b148-435d423be639-kube-api-access-d86ps\") pod \"payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh\" (UID: \"4ee60fab-0aff-41fc-b148-435d423be639\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:53.341303 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.341279    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ee60fab-0aff-41fc-b148-435d423be639-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh\" (UID: \"4ee60fab-0aff-41fc-b148-435d423be639\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:53.457364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.457325    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-d62b4e-dockercfg-6tr6c\""
Sep 08 15:30:53.467601 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.467543    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:53.743479 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:30:53.743438    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ee60fab_0aff_41fc_b148_435d423be639.slice/crio-7cc69c44901fee991b2579d449af74638c5ada75fa1fe86871452780215e47ec WatchSource:0}: Error finding container 7cc69c44901fee991b2579d449af74638c5ada75fa1fe86871452780215e47ec: Status 404 returned error can't find the container with id 7cc69c44901fee991b2579d449af74638c5ada75fa1fe86871452780215e47ec
Sep 08 15:30:53.743607 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:53.743510    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"]
Sep 08 15:30:54.141400 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:54.141353    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh" event={"ID":"4ee60fab-0aff-41fc-b148-435d423be639","Type":"ContainerStarted","Data":"517767a61c30ad129b61f4759f0f96330e099e8a270d5efaa09d971d706ede51"}
Sep 08 15:30:54.141875 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:54.141420    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh" event={"ID":"4ee60fab-0aff-41fc-b148-435d423be639","Type":"ContainerStarted","Data":"7cc69c44901fee991b2579d449af74638c5ada75fa1fe86871452780215e47ec"}
Sep 08 15:30:54.141875 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:54.141541    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:30:54.163206 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:30:54.163161    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh" podStartSLOduration=1.163147226 podStartE2EDuration="1.163147226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:30:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:30:54.16157063 +0000 UTC m=+1081.262464743" watchObservedRunningTime="2026-09-08 15:30:54.163147226 +0000 UTC m=+1081.264041336"
Sep 08 15:31:05.153387 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:05.153360    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:31:06.160858 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:06.160820    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:31:06.161319 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:06.160891    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:31:08.222279 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:08.222249    2556 generic.go:356] "Generic (PLEG): container finished" podID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerID="bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722" exitCode=0
Sep 08 15:31:08.222717 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:08.222330    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" event={"ID":"74bdbb6e-1f70-487e-80a6-480794e7ad59","Type":"ContainerDied","Data":"bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722"}
Sep 08 15:31:08.222841 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:08.222823    2556 scope.go:117] "RemoveContainer" containerID="bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722"
Sep 08 15:31:08.223927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:08.223897    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:08.224033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:08.223981    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:08.224099 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:08.224028    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:09.230253 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:09.230220    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" event={"ID":"74bdbb6e-1f70-487e-80a6-480794e7ad59","Type":"ContainerStarted","Data":"58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c"}
Sep 08 15:31:09.291549 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:09.291510    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:31:09.291789 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:09.291766    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:31:09.291841 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:09.291816    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 15:31:10.291078 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:10.291039    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:31:10.291456 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:10.291096    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 15:31:11.291616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:11.291581    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:31:11.292012 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:11.291640    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 15:31:12.291886 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:12.291850    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:31:12.292265 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:12.291903    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 15:31:13.291383 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:13.291343    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:31:13.291591 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:13.291402    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused"
Sep 08 15:31:14.396827 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:14.396792    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:31:14.397200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:14.397063    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:31:14.397965 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:14.397941    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:31:29.961771 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:29.961732    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"]
Sep 08 15:31:29.964278 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:29.964255    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:29.968383 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:29.968363    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-26dbe7df-openshift-default-dockercfg-hf65d\""
Sep 08 15:31:30.026715 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.026664    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"]
Sep 08 15:31:30.042641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.042620    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-socket\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.042761 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.042698    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-envoy\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.042761 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.042746    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-podinfo\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.042863 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.042776    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-data\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.042863 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.042795    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-token\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.042863 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.042820    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-credential-socket\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.043036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.042916    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwt2j\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-kube-api-access-mwt2j\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.043036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.042973    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-certs\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.043036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.043030    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istiod-ca-cert\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144206 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144159    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-podinfo\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144389 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144230    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-data\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144389 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144260    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-token\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144389 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144302    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-credential-socket\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144389 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144349    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwt2j\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-kube-api-access-mwt2j\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144389 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144382    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-certs\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144664 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144419    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istiod-ca-cert\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144664 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144454    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-socket\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144808 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144746    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-data\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144808 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144767    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-envoy\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.144914 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.144816    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-socket\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.145085 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.145062    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-certs\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.145524 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.145487    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-credential-socket\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.145760 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.145736    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istiod-ca-cert\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.148026 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.148003    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-podinfo\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.148298 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.148269    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-envoy\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.157138 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.157109    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwt2j\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-kube-api-access-mwt2j\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.157726 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.157705    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-token\") pod \"e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") " pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.273928 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.273839    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:30.582163 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.582131    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"]
Sep 08 15:31:30.588534 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:31:30.588496    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b38e1af_b0d2_4bfe_955b_c0fd0b9c6419.slice/crio-f36717032d4fd808c13a8468d7ffb43ac9795a7edcda8be3e9329f5135abc02b WatchSource:0}: Error finding container f36717032d4fd808c13a8468d7ffb43ac9795a7edcda8be3e9329f5135abc02b: Status 404 returned error can't find the container with id f36717032d4fd808c13a8468d7ffb43ac9795a7edcda8be3e9329f5135abc02b
Sep 08 15:31:30.591243 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.591200    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:30.591324 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.591288    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:30.591364 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:30.591338    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:31.346951 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:31.346909    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" event={"ID":"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419","Type":"ContainerStarted","Data":"45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5"}
Sep 08 15:31:31.347331 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:31.346971    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" event={"ID":"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419","Type":"ContainerStarted","Data":"f36717032d4fd808c13a8468d7ffb43ac9795a7edcda8be3e9329f5135abc02b"}
Sep 08 15:31:31.384708 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:31.384627    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" podStartSLOduration=2.384606693 podStartE2EDuration="2.384606693s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:31:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:31.384454113 +0000 UTC m=+1118.485348225" watchObservedRunningTime="2026-09-08 15:31:31.384606693 +0000 UTC m=+1118.485500809"
Sep 08 15:31:32.274018 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:32.273981    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:32.278858 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:32.278834    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:32.352508 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:32.352475    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:32.353195 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:32.353176    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:35.531780 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.531747    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"]
Sep 08 15:31:35.534346 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.534324    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:35.536779 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.536759    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-26dbe7df\""
Sep 08 15:31:35.549074 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.549049    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"]
Sep 08 15:31:35.669835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.669795    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"]
Sep 08 15:31:35.673171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.673147    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:35.675804 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.675777    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-26dbe7df-dockercfg-bqjcv\""
Sep 08 15:31:35.686381 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.686347    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"]
Sep 08 15:31:35.693910 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.693878    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/778af850-3192-434f-9588-a738427c7c2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k\" (UID: \"778af850-3192-434f-9588-a738427c7c2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:35.694055 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.693922    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsq24\" (UniqueName: \"kubernetes.io/projected/778af850-3192-434f-9588-a738427c7c2c-kube-api-access-hsq24\") pod \"payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k\" (UID: \"778af850-3192-434f-9588-a738427c7c2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:35.795253 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.795160    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/778af850-3192-434f-9588-a738427c7c2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k\" (UID: \"778af850-3192-434f-9588-a738427c7c2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:35.795253 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.795203    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsq24\" (UniqueName: \"kubernetes.io/projected/778af850-3192-434f-9588-a738427c7c2c-kube-api-access-hsq24\") pod \"payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k\" (UID: \"778af850-3192-434f-9588-a738427c7c2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:35.795253 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.795238    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-plugins-config-volume\") pod \"payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk\" (UID: \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\") " pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:35.795476 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.795257    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv7bv\" (UniqueName: \"kubernetes.io/projected/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-kube-api-access-lv7bv\") pod \"payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk\" (UID: \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\") " pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:35.795924 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.795904    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/778af850-3192-434f-9588-a738427c7c2c-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k\" (UID: \"778af850-3192-434f-9588-a738427c7c2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:35.807006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.806963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsq24\" (UniqueName: \"kubernetes.io/projected/778af850-3192-434f-9588-a738427c7c2c-kube-api-access-hsq24\") pod \"payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k\" (UID: \"778af850-3192-434f-9588-a738427c7c2c\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:35.845866 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.845835    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:35.895816 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.895785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-plugins-config-volume\") pod \"payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk\" (UID: \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\") " pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:35.895816 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.895820    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv7bv\" (UniqueName: \"kubernetes.io/projected/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-kube-api-access-lv7bv\") pod \"payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk\" (UID: \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\") " pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:35.896468 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.896449    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-plugins-config-volume\") pod \"payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk\" (UID: \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\") " pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:35.906083 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.906002    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv7bv\" (UniqueName: \"kubernetes.io/projected/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-kube-api-access-lv7bv\") pod \"payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk\" (UID: \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\") " pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:35.985475 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:35.985442    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:36.146104 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:31:36.146073    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod778af850_3192_434f_9588_a738427c7c2c.slice/crio-a7588c3027ff354cdcd2f8c27765d3896dca103b1d3eaa697858039d3a0d2cb6 WatchSource:0}: Error finding container a7588c3027ff354cdcd2f8c27765d3896dca103b1d3eaa697858039d3a0d2cb6: Status 404 returned error can't find the container with id a7588c3027ff354cdcd2f8c27765d3896dca103b1d3eaa697858039d3a0d2cb6
Sep 08 15:31:36.150092 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.150070    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"]
Sep 08 15:31:36.273582 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.273549    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"]
Sep 08 15:31:36.277003 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:31:36.276972    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2f6214_85a0_4382_89ec_d8302dc3ba4a.slice/crio-a4abed00b169fde97ad298f1d03ede12885449df1b3202ff34caa11ae5428685 WatchSource:0}: Error finding container a4abed00b169fde97ad298f1d03ede12885449df1b3202ff34caa11ae5428685: Status 404 returned error can't find the container with id a4abed00b169fde97ad298f1d03ede12885449df1b3202ff34caa11ae5428685
Sep 08 15:31:36.373967 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.373926    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk" event={"ID":"1b2f6214-85a0-4382-89ec-d8302dc3ba4a","Type":"ContainerStarted","Data":"ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d"}
Sep 08 15:31:36.374143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.373983    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk" event={"ID":"1b2f6214-85a0-4382-89ec-d8302dc3ba4a","Type":"ContainerStarted","Data":"a4abed00b169fde97ad298f1d03ede12885449df1b3202ff34caa11ae5428685"}
Sep 08 15:31:36.374143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.374039    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:36.375827 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.375802    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k" event={"ID":"778af850-3192-434f-9588-a738427c7c2c","Type":"ContainerStarted","Data":"3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948"}
Sep 08 15:31:36.375945 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.375850    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k" event={"ID":"778af850-3192-434f-9588-a738427c7c2c","Type":"ContainerStarted","Data":"a7588c3027ff354cdcd2f8c27765d3896dca103b1d3eaa697858039d3a0d2cb6"}
Sep 08 15:31:36.375945 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.375877    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:36.412097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.411995    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk" podStartSLOduration=1.41197882 podStartE2EDuration="1.41197882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:36.409556406 +0000 UTC m=+1123.510450517" watchObservedRunningTime="2026-09-08 15:31:36.41197882 +0000 UTC m=+1123.512872957"
Sep 08 15:31:36.466930 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:36.466859    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k" podStartSLOduration=1.466838176 podStartE2EDuration="1.466838176s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:31:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:31:36.464326774 +0000 UTC m=+1123.565220882" watchObservedRunningTime="2026-09-08 15:31:36.466838176 +0000 UTC m=+1123.567732290"
Sep 08 15:31:47.384217 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:47.384185    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:31:47.385019 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:47.384999    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:31:53.448589 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:53.448562    2556 scope.go:117] "RemoveContainer" containerID="1b3dd79bedab70a5f0c01f5d4e87cc6f0f3d6190f4511ce6fa0022839f76211e"
Sep 08 15:31:54.489123 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:54.489089    2556 generic.go:356] "Generic (PLEG): container finished" podID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerID="45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5" exitCode=0
Sep 08 15:31:54.489495 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:54.489161    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" event={"ID":"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419","Type":"ContainerDied","Data":"45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5"}
Sep 08 15:31:54.489544 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:54.489527    2556 scope.go:117] "RemoveContainer" containerID="45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5"
Sep 08 15:31:54.490569 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:54.490541    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:54.490638 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:54.490608    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:54.490687 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:54.490644    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:31:55.496313 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:55.496279    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" event={"ID":"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419","Type":"ContainerStarted","Data":"a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e"}
Sep 08 15:31:56.275538 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:56.274753    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:31:56.275538 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:56.275227    2556 patch_prober.go:28] interesting pod/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:31:56.275538 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:56.275280    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 15:31:57.274515 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:57.274475    2556 patch_prober.go:28] interesting pod/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:31:57.274947 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:57.274538    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 15:31:58.274697 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:58.274638    2556 patch_prober.go:28] interesting pod/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:31:58.275107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:58.274725    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 15:31:59.274768 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:59.274727    2556 patch_prober.go:28] interesting pod/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:31:59.275172 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:31:59.274786    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 15:32:00.274803 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:32:00.274764    2556 patch_prober.go:28] interesting pod/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:32:00.275213 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:32:00.274829    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.64:15021/healthz/ready\": dial tcp 10.133.0.64:15021: connect: connection refused"
Sep 08 15:32:01.278643 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:32:01.278614    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:32:01.279038 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:32:01.279017    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:32:01.279736 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:32:01.279712    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:32:53.470138 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:32:53.470103    2556 scope.go:117] "RemoveContainer" containerID="7f3b0c11ebcc8431a66969d694a9d2a47750a2278d5135a0179a54ab2415a3b0"
Sep 08 15:32:53.478462 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:32:53.478440    2556 scope.go:117] "RemoveContainer" containerID="4e4fb9622c39b8de9187b50b3c17a65019f4f5948e73d23babd7483ecc2faf79"
Sep 08 15:33:04.027273 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.027234    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"]
Sep 08 15:33:04.030627 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.030609    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"
Sep 08 15:33:04.032927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.032901    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:33:04.033043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.032982    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:33:04.037139 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.037117    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"]
Sep 08 15:33:04.158813 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.158777    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb65612-76e7-415d-86c8-749799c28077-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9\" (UID: \"0fb65612-76e7-415d-86c8-749799c28077\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"
Sep 08 15:33:04.259867 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.259830    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb65612-76e7-415d-86c8-749799c28077-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9\" (UID: \"0fb65612-76e7-415d-86c8-749799c28077\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"
Sep 08 15:33:04.260503 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.260477    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb65612-76e7-415d-86c8-749799c28077-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9\" (UID: \"0fb65612-76e7-415d-86c8-749799c28077\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"
Sep 08 15:33:04.343884 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.343848    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"
Sep 08 15:33:04.614953 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.614929    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"]
Sep 08 15:33:04.616872 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:33:04.616846    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fb65612_76e7_415d_86c8_749799c28077.slice/crio-946d660ab8e7e1b302f8edcb94785a1ec68ff744e235afb07214f80f53f7280f WatchSource:0}: Error finding container 946d660ab8e7e1b302f8edcb94785a1ec68ff744e235afb07214f80f53f7280f: Status 404 returned error can't find the container with id 946d660ab8e7e1b302f8edcb94785a1ec68ff744e235afb07214f80f53f7280f
Sep 08 15:33:04.859309 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:04.859276    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9" event={"ID":"0fb65612-76e7-415d-86c8-749799c28077","Type":"ContainerStarted","Data":"946d660ab8e7e1b302f8edcb94785a1ec68ff744e235afb07214f80f53f7280f"}
Sep 08 15:33:05.866863 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:05.866829    2556 generic.go:356] "Generic (PLEG): container finished" podID="0fb65612-76e7-415d-86c8-749799c28077" containerID="9597a67fa262afe80e5da00b2d19fa93f1c7decb9c8e00a4b55b2d18e7171e80" exitCode=0
Sep 08 15:33:05.867237 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:05.866912    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9" event={"ID":"0fb65612-76e7-415d-86c8-749799c28077","Type":"ContainerDied","Data":"9597a67fa262afe80e5da00b2d19fa93f1c7decb9c8e00a4b55b2d18e7171e80"}
Sep 08 15:33:07.007289 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:07.007263    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"
Sep 08 15:33:07.085799 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:07.085764    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb65612-76e7-415d-86c8-749799c28077-maas-api-service-ca\") pod \"0fb65612-76e7-415d-86c8-749799c28077\" (UID: \"0fb65612-76e7-415d-86c8-749799c28077\") "
Sep 08 15:33:07.086183 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:07.086162    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fb65612-76e7-415d-86c8-749799c28077-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "0fb65612-76e7-415d-86c8-749799c28077" (UID: "0fb65612-76e7-415d-86c8-749799c28077"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:33:07.186996 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:07.186902    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/0fb65612-76e7-415d-86c8-749799c28077-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:33:07.877849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:07.877819    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"
Sep 08 15:33:07.878042 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:07.877868    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9" event={"ID":"0fb65612-76e7-415d-86c8-749799c28077","Type":"ContainerDied","Data":"946d660ab8e7e1b302f8edcb94785a1ec68ff744e235afb07214f80f53f7280f"}
Sep 08 15:33:07.878042 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:07.877924    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="946d660ab8e7e1b302f8edcb94785a1ec68ff744e235afb07214f80f53f7280f"
Sep 08 15:33:19.599198 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.599163    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"]
Sep 08 15:33:19.599731 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.599409    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk" podUID="1b2f6214-85a0-4382-89ec-d8302dc3ba4a" containerName="payload-processing" containerID="cri-o://ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d" gracePeriod=30
Sep 08 15:33:19.607842 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.607815    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"]
Sep 08 15:33:19.608089 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.608036    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k" podUID="778af850-3192-434f-9588-a738427c7c2c" containerName="payload-pre-processing" containerID="cri-o://3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948" gracePeriod=30
Sep 08 15:33:19.790790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.790721    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"]
Sep 08 15:33:19.792794 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.792768    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-26dbe7df-4ftq9"]
Sep 08 15:33:19.903821 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.903799    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:33:19.905560 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.905541    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:33:19.944531 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.944078    2556 generic.go:356] "Generic (PLEG): container finished" podID="1b2f6214-85a0-4382-89ec-d8302dc3ba4a" containerID="ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d" exitCode=0
Sep 08 15:33:19.944531 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.944146    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"
Sep 08 15:33:19.944531 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.944152    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk" event={"ID":"1b2f6214-85a0-4382-89ec-d8302dc3ba4a","Type":"ContainerDied","Data":"ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d"}
Sep 08 15:33:19.944531 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.944218    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk" event={"ID":"1b2f6214-85a0-4382-89ec-d8302dc3ba4a","Type":"ContainerDied","Data":"a4abed00b169fde97ad298f1d03ede12885449df1b3202ff34caa11ae5428685"}
Sep 08 15:33:19.945576 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.945079    2556 scope.go:117] "RemoveContainer" containerID="ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d"
Sep 08 15:33:19.946445 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.946254    2556 generic.go:356] "Generic (PLEG): container finished" podID="778af850-3192-434f-9588-a738427c7c2c" containerID="3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948" exitCode=0
Sep 08 15:33:19.946445 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.946305    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"
Sep 08 15:33:19.946445 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.946372    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k" event={"ID":"778af850-3192-434f-9588-a738427c7c2c","Type":"ContainerDied","Data":"3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948"}
Sep 08 15:33:19.946445 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.946409    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k" event={"ID":"778af850-3192-434f-9588-a738427c7c2c","Type":"ContainerDied","Data":"a7588c3027ff354cdcd2f8c27765d3896dca103b1d3eaa697858039d3a0d2cb6"}
Sep 08 15:33:19.954792 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.954773    2556 scope.go:117] "RemoveContainer" containerID="ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d"
Sep 08 15:33:19.955154 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:33:19.955125    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d\": container with ID starting with ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d not found: ID does not exist" containerID="ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d"
Sep 08 15:33:19.955235 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.955165    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d"} err="failed to get container status \"ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d\": rpc error: code = NotFound desc = could not find container \"ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d\": container with ID starting with ea83753335da548ada35599cfa7f8e929f5ff60c53b86d49c44f5c544453ca5d not found: ID does not exist"
Sep 08 15:33:19.955235 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.955189    2556 scope.go:117] "RemoveContainer" containerID="3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948"
Sep 08 15:33:19.966124 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.964908    2556 scope.go:117] "RemoveContainer" containerID="3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948"
Sep 08 15:33:19.966551 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:33:19.966525    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948\": container with ID starting with 3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948 not found: ID does not exist" containerID="3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948"
Sep 08 15:33:19.966649 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:19.966558    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948"} err="failed to get container status \"3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948\": rpc error: code = NotFound desc = could not find container \"3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948\": container with ID starting with 3e9aa31e25437b957479380a7c7188694873786816f751f86a84b9f18729f948 not found: ID does not exist"
Sep 08 15:33:20.003996 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.003974    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hsq24\" (UniqueName: \"kubernetes.io/projected/778af850-3192-434f-9588-a738427c7c2c-kube-api-access-hsq24\") pod \"778af850-3192-434f-9588-a738427c7c2c\" (UID: \"778af850-3192-434f-9588-a738427c7c2c\") "
Sep 08 15:33:20.004102 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.004008    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lv7bv\" (UniqueName: \"kubernetes.io/projected/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-kube-api-access-lv7bv\") pod \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\" (UID: \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\") "
Sep 08 15:33:20.004102 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.004074    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/778af850-3192-434f-9588-a738427c7c2c-plugins-config-volume\") pod \"778af850-3192-434f-9588-a738427c7c2c\" (UID: \"778af850-3192-434f-9588-a738427c7c2c\") "
Sep 08 15:33:20.004102 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.004093    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-plugins-config-volume\") pod \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\" (UID: \"1b2f6214-85a0-4382-89ec-d8302dc3ba4a\") "
Sep 08 15:33:20.004476 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.004452    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/778af850-3192-434f-9588-a738427c7c2c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "778af850-3192-434f-9588-a738427c7c2c" (UID: "778af850-3192-434f-9588-a738427c7c2c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:33:20.004519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.004484    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1b2f6214-85a0-4382-89ec-d8302dc3ba4a" (UID: "1b2f6214-85a0-4382-89ec-d8302dc3ba4a"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:33:20.006022 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.006002    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-kube-api-access-lv7bv" (OuterVolumeSpecName: "kube-api-access-lv7bv") pod "1b2f6214-85a0-4382-89ec-d8302dc3ba4a" (UID: "1b2f6214-85a0-4382-89ec-d8302dc3ba4a"). InnerVolumeSpecName "kube-api-access-lv7bv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:33:20.006084 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.006051    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/778af850-3192-434f-9588-a738427c7c2c-kube-api-access-hsq24" (OuterVolumeSpecName: "kube-api-access-hsq24") pod "778af850-3192-434f-9588-a738427c7c2c" (UID: "778af850-3192-434f-9588-a738427c7c2c"). InnerVolumeSpecName "kube-api-access-hsq24". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:33:20.104873 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.104833    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hsq24\" (UniqueName: \"kubernetes.io/projected/778af850-3192-434f-9588-a738427c7c2c-kube-api-access-hsq24\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:33:20.104873 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.104869    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lv7bv\" (UniqueName: \"kubernetes.io/projected/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-kube-api-access-lv7bv\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:33:20.104873 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.104880    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/778af850-3192-434f-9588-a738427c7c2c-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:33:20.104873 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.104889    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1b2f6214-85a0-4382-89ec-d8302dc3ba4a-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:33:20.267429 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.267395    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"]
Sep 08 15:33:20.271330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.271305    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-26dbe7df-654c85fd5d-sb48k"]
Sep 08 15:33:20.284712 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.280662    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"]
Sep 08 15:33:20.291806 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:20.291778    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-26dbe7df-5fff6c948f-5hglk"]
Sep 08 15:33:21.354344 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:21.354303    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fb65612-76e7-415d-86c8-749799c28077" path="/var/lib/kubelet/pods/0fb65612-76e7-415d-86c8-749799c28077/volumes"
Sep 08 15:33:21.354715 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:21.354652    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b2f6214-85a0-4382-89ec-d8302dc3ba4a" path="/var/lib/kubelet/pods/1b2f6214-85a0-4382-89ec-d8302dc3ba4a/volumes"
Sep 08 15:33:21.354999 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:21.354985    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="778af850-3192-434f-9588-a738427c7c2c" path="/var/lib/kubelet/pods/778af850-3192-434f-9588-a738427c7c2c/volumes"
Sep 08 15:33:42.814545 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.814507    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7769-2ddea6"]
Sep 08 15:33:42.814961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.814895    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b2f6214-85a0-4382-89ec-d8302dc3ba4a" containerName="payload-processing"
Sep 08 15:33:42.814961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.814909    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b2f6214-85a0-4382-89ec-d8302dc3ba4a" containerName="payload-processing"
Sep 08 15:33:42.814961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.814926    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="778af850-3192-434f-9588-a738427c7c2c" containerName="payload-pre-processing"
Sep 08 15:33:42.814961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.814934    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="778af850-3192-434f-9588-a738427c7c2c" containerName="payload-pre-processing"
Sep 08 15:33:42.814961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.814946    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fb65612-76e7-415d-86c8-749799c28077" containerName="revoke-keys"
Sep 08 15:33:42.814961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.814952    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fb65612-76e7-415d-86c8-749799c28077" containerName="revoke-keys"
Sep 08 15:33:42.815156 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.815035    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b2f6214-85a0-4382-89ec-d8302dc3ba4a" containerName="payload-processing"
Sep 08 15:33:42.815156 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.815043    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fb65612-76e7-415d-86c8-749799c28077" containerName="revoke-keys"
Sep 08 15:33:42.815156 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.815052    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="778af850-3192-434f-9588-a738427c7c2c" containerName="payload-pre-processing"
Sep 08 15:33:42.816946 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.816930    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7769-2ddea6"
Sep 08 15:33:42.819135 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.819115    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8vmw2\""
Sep 08 15:33:42.825021 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.824999    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7769-2ddea6"]
Sep 08 15:33:42.891244 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.891210    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t6mc\" (UniqueName: \"kubernetes.io/projected/fd7dc26e-2286-474d-9b91-24fe2b516bdb-kube-api-access-9t6mc\") pod \"mt-curl-7769-2ddea6\" (UID: \"fd7dc26e-2286-474d-9b91-24fe2b516bdb\") " pod="opendatahub/mt-curl-7769-2ddea6"
Sep 08 15:33:42.992007 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:42.991969    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t6mc\" (UniqueName: \"kubernetes.io/projected/fd7dc26e-2286-474d-9b91-24fe2b516bdb-kube-api-access-9t6mc\") pod \"mt-curl-7769-2ddea6\" (UID: \"fd7dc26e-2286-474d-9b91-24fe2b516bdb\") " pod="opendatahub/mt-curl-7769-2ddea6"
Sep 08 15:33:43.000544 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:43.000517    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t6mc\" (UniqueName: \"kubernetes.io/projected/fd7dc26e-2286-474d-9b91-24fe2b516bdb-kube-api-access-9t6mc\") pod \"mt-curl-7769-2ddea6\" (UID: \"fd7dc26e-2286-474d-9b91-24fe2b516bdb\") " pod="opendatahub/mt-curl-7769-2ddea6"
Sep 08 15:33:43.126533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:43.126504    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7769-2ddea6"
Sep 08 15:33:43.392458 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:43.392430    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7769-2ddea6"]
Sep 08 15:33:43.394728 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:33:43.394697    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd7dc26e_2286_474d_9b91_24fe2b516bdb.slice/crio-46ba1f06b006a677291eceaf225acec3b59b117ca19fe6035dbdcccc9f22eb92 WatchSource:0}: Error finding container 46ba1f06b006a677291eceaf225acec3b59b117ca19fe6035dbdcccc9f22eb92: Status 404 returned error can't find the container with id 46ba1f06b006a677291eceaf225acec3b59b117ca19fe6035dbdcccc9f22eb92
Sep 08 15:33:43.396323 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:43.396303    2556 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:33:44.072392 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:44.072366    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7769-2ddea6" event={"ID":"fd7dc26e-2286-474d-9b91-24fe2b516bdb","Type":"ContainerStarted","Data":"46ba1f06b006a677291eceaf225acec3b59b117ca19fe6035dbdcccc9f22eb92"}
Sep 08 15:33:45.078499 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:45.078456    2556 generic.go:356] "Generic (PLEG): container finished" podID="fd7dc26e-2286-474d-9b91-24fe2b516bdb" containerID="1ae56c933f237728922000220b4f80e0e55ea27afbaf7d4912ec8a615d0662a1" exitCode=0
Sep 08 15:33:45.078894 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:45.078541    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7769-2ddea6" event={"ID":"fd7dc26e-2286-474d-9b91-24fe2b516bdb","Type":"ContainerDied","Data":"1ae56c933f237728922000220b4f80e0e55ea27afbaf7d4912ec8a615d0662a1"}
Sep 08 15:33:46.209551 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:46.209523    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7769-2ddea6"
Sep 08 15:33:46.243088 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:46.243059    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7769-2ddea6_fd7dc26e-2286-474d-9b91-24fe2b516bdb/mt-curl-7769-2ddea6/0.log"
Sep 08 15:33:46.265849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:46.265823    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7769-2ddea6"]
Sep 08 15:33:46.267441 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:46.267421    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7769-2ddea6"]
Sep 08 15:33:46.325166 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:46.325143    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t6mc\" (UniqueName: \"kubernetes.io/projected/fd7dc26e-2286-474d-9b91-24fe2b516bdb-kube-api-access-9t6mc\") pod \"fd7dc26e-2286-474d-9b91-24fe2b516bdb\" (UID: \"fd7dc26e-2286-474d-9b91-24fe2b516bdb\") "
Sep 08 15:33:46.327229 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:46.327202    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd7dc26e-2286-474d-9b91-24fe2b516bdb-kube-api-access-9t6mc" (OuterVolumeSpecName: "kube-api-access-9t6mc") pod "fd7dc26e-2286-474d-9b91-24fe2b516bdb" (UID: "fd7dc26e-2286-474d-9b91-24fe2b516bdb"). InnerVolumeSpecName "kube-api-access-9t6mc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:33:46.426387 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:46.426327    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t6mc\" (UniqueName: \"kubernetes.io/projected/fd7dc26e-2286-474d-9b91-24fe2b516bdb-kube-api-access-9t6mc\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:33:47.089330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:47.089297    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7769-2ddea6"
Sep 08 15:33:47.089330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:47.089330    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="46ba1f06b006a677291eceaf225acec3b59b117ca19fe6035dbdcccc9f22eb92"
Sep 08 15:33:47.098727 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:33:47.098704    2556 status_manager.go:1018] "Failed to get status for pod" err="pods \"mt-curl-7769-2ddea6\" is forbidden: User \"system:node:ip-10-0-128-19.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-128-19.ec2.internal' and this object" podUID="fd7dc26e-2286-474d-9b91-24fe2b516bdb" pod="opendatahub/mt-curl-7769-2ddea6"
Sep 08 15:33:47.353687 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:47.353568    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd7dc26e-2286-474d-9b91-24fe2b516bdb" path="/var/lib/kubelet/pods/fd7dc26e-2286-474d-9b91-24fe2b516bdb/volumes"
Sep 08 15:33:53.499718 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:53.499660    2556 scope.go:117] "RemoveContainer" containerID="d0c7c5446ccf46e7b690faed9293ed78d4243a08eba40e64fd2cefdcf1affb62"
Sep 08 15:33:53.507425 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:33:53.507395    2556 scope.go:117] "RemoveContainer" containerID="01d701b851aaa1a789a11eb477e0d8806393bcfb8834f0e691056c65a1169d9e"
Sep 08 15:34:13.492256 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:13.492218    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"]
Sep 08 15:34:13.492776 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:13.492503    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy" containerID="cri-o://a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e" gracePeriod=30
Sep 08 15:34:16.281381 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:16.281340    2556 patch_prober.go:28] interesting pod/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:34:16.281790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:16.281420    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:34:18.762509 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.762444    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:34:18.813009 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.812986    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-data\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813157 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813036    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istiod-ca-cert\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813157 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813072    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-certs\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813157 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813118    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-credential-socket\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813157 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813142    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwt2j\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-kube-api-access-mwt2j\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813372 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813238    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-envoy\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813372 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813245    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-data" (OuterVolumeSpecName: "istio-data") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:34:18.813372 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813278    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-token\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813372 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813311    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-podinfo\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813372 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813352    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-socket\") pod \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\" (UID: \"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419\") "
Sep 08 15:34:18.813632 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813427    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:34:18.813632 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813522    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:34:18.813766 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813635    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:34:18.813766 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813745    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:18.813879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813770    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:18.813879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813768    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:34:18.813879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813787    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:18.813879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.813800    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:18.815416 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.815382    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:34:18.815534 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.815416    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-kube-api-access-mwt2j" (OuterVolumeSpecName: "kube-api-access-mwt2j") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "kube-api-access-mwt2j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:34:18.815534 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.815417    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-token" (OuterVolumeSpecName: "istio-token") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:34:18.815534 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.815469    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" (UID: "6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:34:18.915073 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.915046    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:18.915073 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.915070    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwt2j\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-kube-api-access-mwt2j\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:18.915073 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.915079    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:18.915271 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.915087    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:18.915271 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:18.915095    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:34:19.253361 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.253331    2556 generic.go:356] "Generic (PLEG): container finished" podID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerID="a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e" exitCode=0
Sep 08 15:34:19.253617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.253378    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"
Sep 08 15:34:19.253617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.253384    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" event={"ID":"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419","Type":"ContainerDied","Data":"a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e"}
Sep 08 15:34:19.253617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.253426    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t" event={"ID":"6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419","Type":"ContainerDied","Data":"f36717032d4fd808c13a8468d7ffb43ac9795a7edcda8be3e9329f5135abc02b"}
Sep 08 15:34:19.253617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.253455    2556 scope.go:117] "RemoveContainer" containerID="a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e"
Sep 08 15:34:19.262848 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.262831    2556 scope.go:117] "RemoveContainer" containerID="45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5"
Sep 08 15:34:19.270368 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.270351    2556 scope.go:117] "RemoveContainer" containerID="a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e"
Sep 08 15:34:19.270624 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:34:19.270609    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e\": container with ID starting with a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e not found: ID does not exist" containerID="a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e"
Sep 08 15:34:19.270692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.270630    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e"} err="failed to get container status \"a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e\": rpc error: code = NotFound desc = could not find container \"a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e\": container with ID starting with a49f7aa6f91b3e5c4b28e240b66030a79012e1c621687db7afab01b3bd2fdc5e not found: ID does not exist"
Sep 08 15:34:19.270692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.270644    2556 scope.go:117] "RemoveContainer" containerID="45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5"
Sep 08 15:34:19.270874 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:34:19.270859    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5\": container with ID starting with 45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5 not found: ID does not exist" containerID="45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5"
Sep 08 15:34:19.270915 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.270878    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5"} err="failed to get container status \"45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5\": rpc error: code = NotFound desc = could not find container \"45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5\": container with ID starting with 45ea2beb3117e8c493e448232781c7a6ed577ba838d72dde493dff2a4800a9e5 not found: ID does not exist"
Sep 08 15:34:19.275052 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.275025    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"]
Sep 08 15:34:19.280879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.280858    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-26dbe7df-openshift-default-59558c9fcb-xxh2t"]
Sep 08 15:34:19.355156 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:19.355129    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" path="/var/lib/kubelet/pods/6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419/volumes"
Sep 08 15:34:53.536584 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:34:53.536553    2556 scope.go:117] "RemoveContainer" containerID="9b5cb4cbfbd4949f9367c73315c75e5ce0ea0d0ce6046016eb49ead21083ae96"
Sep 08 15:35:12.964782 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.964745    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"]
Sep 08 15:35:12.965233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.965098    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy"
Sep 08 15:35:12.965233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.965111    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy"
Sep 08 15:35:12.965233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.965119    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy"
Sep 08 15:35:12.965233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.965125    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy"
Sep 08 15:35:12.965233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.965134    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7dc26e-2286-474d-9b91-24fe2b516bdb" containerName="mt-curl-7769-2ddea6"
Sep 08 15:35:12.965233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.965140    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7dc26e-2286-474d-9b91-24fe2b516bdb" containerName="mt-curl-7769-2ddea6"
Sep 08 15:35:12.965233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.965191    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy"
Sep 08 15:35:12.965233 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.965202    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd7dc26e-2286-474d-9b91-24fe2b516bdb" containerName="mt-curl-7769-2ddea6"
Sep 08 15:35:12.969421 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.969399    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:12.971768 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.971746    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-08794c-dockercfg-mrbzs\""
Sep 08 15:35:12.971886 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.971787    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-08794c\""
Sep 08 15:35:12.980395 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.980365    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"]
Sep 08 15:35:12.991820 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.991789    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"]
Sep 08 15:35:12.992186 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.992174    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6b38e1af-b0d2-4bfe-955b-c0fd0b9c6419" containerName="istio-proxy"
Sep 08 15:35:12.998111 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:12.998088    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:13.004492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.004461    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"]
Sep 08 15:35:13.072459 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.072426    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmjdf\" (UniqueName: \"kubernetes.io/projected/7c64fd39-9eab-4d0d-b18f-723d282c94e1-kube-api-access-xmjdf\") pod \"payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk\" (UID: \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\") " pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:13.072629 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.072486    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c64fd39-9eab-4d0d-b18f-723d282c94e1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk\" (UID: \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\") " pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:13.173535 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.173493    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2034f18-fecc-4e47-ae44-0df72c488e9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6\" (UID: \"d2034f18-fecc-4e47-ae44-0df72c488e9e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:13.173743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.173576    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmjdf\" (UniqueName: \"kubernetes.io/projected/7c64fd39-9eab-4d0d-b18f-723d282c94e1-kube-api-access-xmjdf\") pod \"payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk\" (UID: \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\") " pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:13.173743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.173608    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hhmf\" (UniqueName: \"kubernetes.io/projected/d2034f18-fecc-4e47-ae44-0df72c488e9e-kube-api-access-8hhmf\") pod \"payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6\" (UID: \"d2034f18-fecc-4e47-ae44-0df72c488e9e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:13.173743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.173656    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c64fd39-9eab-4d0d-b18f-723d282c94e1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk\" (UID: \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\") " pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:13.174390 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.174368    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c64fd39-9eab-4d0d-b18f-723d282c94e1-plugins-config-volume\") pod \"payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk\" (UID: \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\") " pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:13.181661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.181630    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmjdf\" (UniqueName: \"kubernetes.io/projected/7c64fd39-9eab-4d0d-b18f-723d282c94e1-kube-api-access-xmjdf\") pod \"payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk\" (UID: \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\") " pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:13.275061 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.274960    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hhmf\" (UniqueName: \"kubernetes.io/projected/d2034f18-fecc-4e47-ae44-0df72c488e9e-kube-api-access-8hhmf\") pod \"payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6\" (UID: \"d2034f18-fecc-4e47-ae44-0df72c488e9e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:13.275061 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.275050    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2034f18-fecc-4e47-ae44-0df72c488e9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6\" (UID: \"d2034f18-fecc-4e47-ae44-0df72c488e9e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:13.275698 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.275661    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2034f18-fecc-4e47-ae44-0df72c488e9e-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6\" (UID: \"d2034f18-fecc-4e47-ae44-0df72c488e9e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:13.279854 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.279834    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:13.282445 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.282425    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hhmf\" (UniqueName: \"kubernetes.io/projected/d2034f18-fecc-4e47-ae44-0df72c488e9e-kube-api-access-8hhmf\") pod \"payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6\" (UID: \"d2034f18-fecc-4e47-ae44-0df72c488e9e\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:13.311094 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.311063    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:13.555420 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.555401    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"]
Sep 08 15:35:13.557696 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:35:13.557657    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c64fd39_9eab_4d0d_b18f_723d282c94e1.slice/crio-2709b7f62487186980606f26590fff6e14576dbfb339bd011a7de00bff5b8d0b WatchSource:0}: Error finding container 2709b7f62487186980606f26590fff6e14576dbfb339bd011a7de00bff5b8d0b: Status 404 returned error can't find the container with id 2709b7f62487186980606f26590fff6e14576dbfb339bd011a7de00bff5b8d0b
Sep 08 15:35:13.595462 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:13.595430    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"]
Sep 08 15:35:13.602810 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:35:13.602781    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2034f18_fecc_4e47_ae44_0df72c488e9e.slice/crio-fe2f780de0585128ab2e1c4bd0f7dea44cd8af79cf2a9aee32a19cc4abfcd563 WatchSource:0}: Error finding container fe2f780de0585128ab2e1c4bd0f7dea44cd8af79cf2a9aee32a19cc4abfcd563: Status 404 returned error can't find the container with id fe2f780de0585128ab2e1c4bd0f7dea44cd8af79cf2a9aee32a19cc4abfcd563
Sep 08 15:35:14.526643 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:14.526604    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6" event={"ID":"d2034f18-fecc-4e47-ae44-0df72c488e9e","Type":"ContainerStarted","Data":"6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f"}
Sep 08 15:35:14.527145 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:14.526740    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6" event={"ID":"d2034f18-fecc-4e47-ae44-0df72c488e9e","Type":"ContainerStarted","Data":"fe2f780de0585128ab2e1c4bd0f7dea44cd8af79cf2a9aee32a19cc4abfcd563"}
Sep 08 15:35:14.527145 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:14.526781    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:14.528213 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:14.528186    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk" event={"ID":"7c64fd39-9eab-4d0d-b18f-723d282c94e1","Type":"ContainerStarted","Data":"34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4"}
Sep 08 15:35:14.528317 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:14.528231    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk" event={"ID":"7c64fd39-9eab-4d0d-b18f-723d282c94e1","Type":"ContainerStarted","Data":"2709b7f62487186980606f26590fff6e14576dbfb339bd011a7de00bff5b8d0b"}
Sep 08 15:35:14.528317 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:14.528264    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:14.544110 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:14.544056    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6" podStartSLOduration=2.544035924 podStartE2EDuration="2.544035924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:35:14.543271637 +0000 UTC m=+1341.644165778" watchObservedRunningTime="2026-09-08 15:35:14.544035924 +0000 UTC m=+1341.644930046"
Sep 08 15:35:14.564018 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:14.563965    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk" podStartSLOduration=2.563950593 podStartE2EDuration="2.563950593s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:35:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:35:14.561906547 +0000 UTC m=+1341.662800649" watchObservedRunningTime="2026-09-08 15:35:14.563950593 +0000 UTC m=+1341.664844703"
Sep 08 15:35:25.534953 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:25.534857    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:35:25.534953 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:25.534954    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:35:36.685753 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.685717    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"]
Sep 08 15:35:36.689860 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.689829    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.692820 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.692794    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-0e34cd-openshift-default-dockercfg-jbljj\""
Sep 08 15:35:36.699879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.699854    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"]
Sep 08 15:35:36.774424 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.774387    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-certs\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.774739 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.774714    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-token\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.775013 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.774993    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-credential-socket\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.775235 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.775178    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lntfh\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-kube-api-access-lntfh\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.775411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.775388    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-envoy\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.775599 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.775583    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istiod-ca-cert\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.775758 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.775740    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-podinfo\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.775895 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.775877    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-data\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.776065 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.776047    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-socket\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.877771 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.877727    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-socket\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.877962 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.877785    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-certs\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.877962 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.877811    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-token\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.877962 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.877839    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-credential-socket\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.877962 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.877865    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lntfh\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-kube-api-access-lntfh\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.877997    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-envoy\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.878082    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istiod-ca-cert\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.878117    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-podinfo\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.878147    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-data\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878410 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.878196    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-socket\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878410 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.878230    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-credential-socket\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878410 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.878354    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-certs\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878573 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.878527    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-data\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.878977 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.878953    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istiod-ca-cert\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.880396 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.880374    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-envoy\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.880656 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.880639    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-podinfo\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.885739 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.885716    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-token\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:36.885888 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:36.885871    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lntfh\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-kube-api-access-lntfh\") pod \"e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") " pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:37.001295 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:37.001213    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:37.277901 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:37.277871    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"]
Sep 08 15:35:37.280266 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:35:37.280241    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a9e1fc5_60cd_458c_81e8_5c25af1366ea.slice/crio-b2d0435c2cc4a23de0692a02b04163a518a494c7f611f47454cf1ec9fb9b0819 WatchSource:0}: Error finding container b2d0435c2cc4a23de0692a02b04163a518a494c7f611f47454cf1ec9fb9b0819: Status 404 returned error can't find the container with id b2d0435c2cc4a23de0692a02b04163a518a494c7f611f47454cf1ec9fb9b0819
Sep 08 15:35:37.283051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:37.283003    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:35:37.283133 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:37.283095    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:35:37.283133 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:37.283124    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:35:37.646331 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:37.646293    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" event={"ID":"6a9e1fc5-60cd-458c-81e8-5c25af1366ea","Type":"ContainerStarted","Data":"4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2"}
Sep 08 15:35:37.646522 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:37.646343    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" event={"ID":"6a9e1fc5-60cd-458c-81e8-5c25af1366ea","Type":"ContainerStarted","Data":"b2d0435c2cc4a23de0692a02b04163a518a494c7f611f47454cf1ec9fb9b0819"}
Sep 08 15:35:37.669169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:37.669119    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" podStartSLOduration=1.669102131 podStartE2EDuration="1.669102131s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:35:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:35:37.667634146 +0000 UTC m=+1364.768528257" watchObservedRunningTime="2026-09-08 15:35:37.669102131 +0000 UTC m=+1364.769996252"
Sep 08 15:35:38.001587 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:38.001493    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:38.007020 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:38.006993    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:38.651749 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:38.651715    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:38.652641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:38.652618    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:41.472901 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.472869    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"]
Sep 08 15:35:41.476584 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.476561    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:41.479308 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.479280    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-0e34cd\""
Sep 08 15:35:41.479457 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.479283    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-0e34cd-dockercfg-f7td5\""
Sep 08 15:35:41.488758 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.488729    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"]
Sep 08 15:35:41.490961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.490940    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"]
Sep 08 15:35:41.494130 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.494111    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:41.509682 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.509639    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"]
Sep 08 15:35:41.524824 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.524782    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdfh5\" (UniqueName: \"kubernetes.io/projected/861ba23a-cc1c-47fe-a229-07109f7014a6-kube-api-access-rdfh5\") pod \"payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n\" (UID: \"861ba23a-cc1c-47fe-a229-07109f7014a6\") " pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:41.525002 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.524835    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/861ba23a-cc1c-47fe-a229-07109f7014a6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n\" (UID: \"861ba23a-cc1c-47fe-a229-07109f7014a6\") " pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:41.626337 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.626300    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctzpd\" (UniqueName: \"kubernetes.io/projected/270d8551-448d-4c48-ad20-d59512d0c984-kube-api-access-ctzpd\") pod \"payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j\" (UID: \"270d8551-448d-4c48-ad20-d59512d0c984\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:41.626337 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.626351    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdfh5\" (UniqueName: \"kubernetes.io/projected/861ba23a-cc1c-47fe-a229-07109f7014a6-kube-api-access-rdfh5\") pod \"payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n\" (UID: \"861ba23a-cc1c-47fe-a229-07109f7014a6\") " pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:41.626593 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.626388    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/861ba23a-cc1c-47fe-a229-07109f7014a6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n\" (UID: \"861ba23a-cc1c-47fe-a229-07109f7014a6\") " pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:41.626593 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.626463    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/270d8551-448d-4c48-ad20-d59512d0c984-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j\" (UID: \"270d8551-448d-4c48-ad20-d59512d0c984\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:41.627187 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.627163    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/861ba23a-cc1c-47fe-a229-07109f7014a6-plugins-config-volume\") pod \"payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n\" (UID: \"861ba23a-cc1c-47fe-a229-07109f7014a6\") " pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:41.634460 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.634429    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdfh5\" (UniqueName: \"kubernetes.io/projected/861ba23a-cc1c-47fe-a229-07109f7014a6-kube-api-access-rdfh5\") pod \"payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n\" (UID: \"861ba23a-cc1c-47fe-a229-07109f7014a6\") " pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:41.727902 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.727807    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/270d8551-448d-4c48-ad20-d59512d0c984-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j\" (UID: \"270d8551-448d-4c48-ad20-d59512d0c984\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:41.727902 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.727885    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctzpd\" (UniqueName: \"kubernetes.io/projected/270d8551-448d-4c48-ad20-d59512d0c984-kube-api-access-ctzpd\") pod \"payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j\" (UID: \"270d8551-448d-4c48-ad20-d59512d0c984\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:41.728531 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.728507    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/270d8551-448d-4c48-ad20-d59512d0c984-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j\" (UID: \"270d8551-448d-4c48-ad20-d59512d0c984\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:41.736549 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.736517    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctzpd\" (UniqueName: \"kubernetes.io/projected/270d8551-448d-4c48-ad20-d59512d0c984-kube-api-access-ctzpd\") pod \"payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j\" (UID: \"270d8551-448d-4c48-ad20-d59512d0c984\") " pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:41.788284 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.788238    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:41.803879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:41.803837    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:42.066866 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.066839    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"]
Sep 08 15:35:42.068570 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:35:42.068542    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861ba23a_cc1c_47fe_a229_07109f7014a6.slice/crio-63bfeb3cda981fb08cfbe85b487908518ef58edb3a7b09c5b2a23a73f8f3bcc8 WatchSource:0}: Error finding container 63bfeb3cda981fb08cfbe85b487908518ef58edb3a7b09c5b2a23a73f8f3bcc8: Status 404 returned error can't find the container with id 63bfeb3cda981fb08cfbe85b487908518ef58edb3a7b09c5b2a23a73f8f3bcc8
Sep 08 15:35:42.092514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.092488    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"]
Sep 08 15:35:42.101882 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:35:42.101853    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270d8551_448d_4c48_ad20_d59512d0c984.slice/crio-60639ec8504e807d742254b87b39d9e3adcbf78eca2433f5f8c10895e2843b82 WatchSource:0}: Error finding container 60639ec8504e807d742254b87b39d9e3adcbf78eca2433f5f8c10895e2843b82: Status 404 returned error can't find the container with id 60639ec8504e807d742254b87b39d9e3adcbf78eca2433f5f8c10895e2843b82
Sep 08 15:35:42.674313 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.674280    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n" event={"ID":"861ba23a-cc1c-47fe-a229-07109f7014a6","Type":"ContainerStarted","Data":"e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b"}
Sep 08 15:35:42.674833 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.674330    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n" event={"ID":"861ba23a-cc1c-47fe-a229-07109f7014a6","Type":"ContainerStarted","Data":"63bfeb3cda981fb08cfbe85b487908518ef58edb3a7b09c5b2a23a73f8f3bcc8"}
Sep 08 15:35:42.674833 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.674390    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:42.676255 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.676232    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j" event={"ID":"270d8551-448d-4c48-ad20-d59512d0c984","Type":"ContainerStarted","Data":"d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0"}
Sep 08 15:35:42.676356 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.676272    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j" event={"ID":"270d8551-448d-4c48-ad20-d59512d0c984","Type":"ContainerStarted","Data":"60639ec8504e807d742254b87b39d9e3adcbf78eca2433f5f8c10895e2843b82"}
Sep 08 15:35:42.676356 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.676296    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:42.692411 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.692357    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n" podStartSLOduration=1.6923396670000002 podStartE2EDuration="1.692339667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:35:42.690381141 +0000 UTC m=+1369.791275273" watchObservedRunningTime="2026-09-08 15:35:42.692339667 +0000 UTC m=+1369.793233779"
Sep 08 15:35:42.706939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:42.706891    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j" podStartSLOduration=1.706875969 podStartE2EDuration="1.706875969s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:35:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:35:42.705967047 +0000 UTC m=+1369.806861153" watchObservedRunningTime="2026-09-08 15:35:42.706875969 +0000 UTC m=+1369.807770080"
Sep 08 15:35:53.560728 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:53.560685    2556 scope.go:117] "RemoveContainer" containerID="9661139ebd10f04aca34220f89af5ee0dc1998b4a7380514c01e7789a86be1cf"
Sep 08 15:35:53.569648 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:53.569625    2556 scope.go:117] "RemoveContainer" containerID="ad5353b3c19adb09fb009e0d9656643f70c0b5b2ffe5ed615e7490818737b248"
Sep 08 15:35:53.577694 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:53.577658    2556 scope.go:117] "RemoveContainer" containerID="3507635df9f6d2378b8891f9e8d1e0af759dc37fcd0ac7c6218ba9082fea81b8"
Sep 08 15:35:53.683181 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:53.683154    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:35:53.683306 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:53.683231    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:35:54.693885 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:54.693843    2556 patch_prober.go:28] interesting pod/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:35:54.694432 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:54.693915    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:35:56.758868 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:56.758836    2556 generic.go:356] "Generic (PLEG): container finished" podID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerID="4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2" exitCode=0
Sep 08 15:35:56.759254 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:56.758907    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" event={"ID":"6a9e1fc5-60cd-458c-81e8-5c25af1366ea","Type":"ContainerDied","Data":"4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2"}
Sep 08 15:35:56.759342 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:56.759328    2556 scope.go:117] "RemoveContainer" containerID="4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2"
Sep 08 15:35:56.760502 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:56.760476    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:35:56.760560 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:56.760543    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:35:56.760595 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:56.760574    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:35:57.774933 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:57.774894    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" event={"ID":"6a9e1fc5-60cd-458c-81e8-5c25af1366ea","Type":"ContainerStarted","Data":"a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab"}
Sep 08 15:35:58.002332 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:58.002297    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:35:58.002507 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:58.002461    2556 patch_prober.go:28] interesting pod/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:35:58.002552 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:58.002510    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 08 15:35:59.002184 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:59.002150    2556 patch_prober.go:28] interesting pod/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:35:59.002575 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:35:59.002229    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 08 15:36:00.002011 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:00.001967    2556 patch_prober.go:28] interesting pod/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:36:00.002197 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:00.002035    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 08 15:36:01.001931 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:01.001890    2556 patch_prober.go:28] interesting pod/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:36:01.002348 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:01.001951    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 08 15:36:02.001796 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:02.001758    2556 patch_prober.go:28] interesting pod/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused" start-of-body=
Sep 08 15:36:02.002044 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:02.001863    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.71:15021/healthz/ready\": dial tcp 10.133.0.71:15021: connect: connection refused"
Sep 08 15:36:03.145382 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:03.145318    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:36:03.146092 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:03.146071    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:36:03.147232 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:03.147207    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:36:07.373633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.373594    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"]
Sep 08 15:36:07.376049 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.376027    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"
Sep 08 15:36:07.378759 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.378735    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:36:07.378906 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.378888    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:36:07.386111 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.386084    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"]
Sep 08 15:36:07.389284 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.388912    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204ac6b9-25f6-4a80-8712-06383bf51ae0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-08794c-grcsp\" (UID: \"204ac6b9-25f6-4a80-8712-06383bf51ae0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"
Sep 08 15:36:07.489892 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.489860    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204ac6b9-25f6-4a80-8712-06383bf51ae0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-08794c-grcsp\" (UID: \"204ac6b9-25f6-4a80-8712-06383bf51ae0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"
Sep 08 15:36:07.490428 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.490409    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204ac6b9-25f6-4a80-8712-06383bf51ae0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-08794c-grcsp\" (UID: \"204ac6b9-25f6-4a80-8712-06383bf51ae0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"
Sep 08 15:36:07.688151 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.688077    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"
Sep 08 15:36:07.962638 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:07.962599    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"]
Sep 08 15:36:07.964893 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:36:07.964869    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod204ac6b9_25f6_4a80_8712_06383bf51ae0.slice/crio-20d5394e26fc4bea5ee3e8adc563317977b1919928627ef37d6ff23088237bdf WatchSource:0}: Error finding container 20d5394e26fc4bea5ee3e8adc563317977b1919928627ef37d6ff23088237bdf: Status 404 returned error can't find the container with id 20d5394e26fc4bea5ee3e8adc563317977b1919928627ef37d6ff23088237bdf
Sep 08 15:36:08.835131 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:08.835091    2556 generic.go:356] "Generic (PLEG): container finished" podID="204ac6b9-25f6-4a80-8712-06383bf51ae0" containerID="aae711bc14cbe0f2fe135e63b782a8260f679766ecb708182cd312e4e29f2dfa" exitCode=0
Sep 08 15:36:08.835615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:08.835145    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp" event={"ID":"204ac6b9-25f6-4a80-8712-06383bf51ae0","Type":"ContainerDied","Data":"aae711bc14cbe0f2fe135e63b782a8260f679766ecb708182cd312e4e29f2dfa"}
Sep 08 15:36:08.835615 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:08.835196    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp" event={"ID":"204ac6b9-25f6-4a80-8712-06383bf51ae0","Type":"ContainerStarted","Data":"20d5394e26fc4bea5ee3e8adc563317977b1919928627ef37d6ff23088237bdf"}
Sep 08 15:36:09.968760 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:09.968733    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"
Sep 08 15:36:10.012186 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:10.012161    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204ac6b9-25f6-4a80-8712-06383bf51ae0-maas-api-service-ca\") pod \"204ac6b9-25f6-4a80-8712-06383bf51ae0\" (UID: \"204ac6b9-25f6-4a80-8712-06383bf51ae0\") "
Sep 08 15:36:10.012491 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:10.012470    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/204ac6b9-25f6-4a80-8712-06383bf51ae0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "204ac6b9-25f6-4a80-8712-06383bf51ae0" (UID: "204ac6b9-25f6-4a80-8712-06383bf51ae0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:10.113742 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:10.113655    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/204ac6b9-25f6-4a80-8712-06383bf51ae0-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:10.848662 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:10.848633    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"
Sep 08 15:36:10.848852 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:10.848691    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp" event={"ID":"204ac6b9-25f6-4a80-8712-06383bf51ae0","Type":"ContainerDied","Data":"20d5394e26fc4bea5ee3e8adc563317977b1919928627ef37d6ff23088237bdf"}
Sep 08 15:36:10.848852 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:10.848741    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="20d5394e26fc4bea5ee3e8adc563317977b1919928627ef37d6ff23088237bdf"
Sep 08 15:36:23.248796 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.248756    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"]
Sep 08 15:36:23.249260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.249050    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk" podUID="7c64fd39-9eab-4d0d-b18f-723d282c94e1" containerName="payload-processing" containerID="cri-o://34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4" gracePeriod=30
Sep 08 15:36:23.253078 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.253049    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"]
Sep 08 15:36:23.253295 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.253270    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6" podUID="d2034f18-fecc-4e47-ae44-0df72c488e9e" containerName="payload-pre-processing" containerID="cri-o://6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f" gracePeriod=30
Sep 08 15:36:23.413777 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.413710    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"]
Sep 08 15:36:23.416028 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.416003    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-08794c-grcsp"]
Sep 08 15:36:23.514766 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.514741    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:36:23.527502 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.527482    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:36:23.628998 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.628970    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmjdf\" (UniqueName: \"kubernetes.io/projected/7c64fd39-9eab-4d0d-b18f-723d282c94e1-kube-api-access-xmjdf\") pod \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\" (UID: \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\") "
Sep 08 15:36:23.628998 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.629003    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8hhmf\" (UniqueName: \"kubernetes.io/projected/d2034f18-fecc-4e47-ae44-0df72c488e9e-kube-api-access-8hhmf\") pod \"d2034f18-fecc-4e47-ae44-0df72c488e9e\" (UID: \"d2034f18-fecc-4e47-ae44-0df72c488e9e\") "
Sep 08 15:36:23.629263 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.629023    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2034f18-fecc-4e47-ae44-0df72c488e9e-plugins-config-volume\") pod \"d2034f18-fecc-4e47-ae44-0df72c488e9e\" (UID: \"d2034f18-fecc-4e47-ae44-0df72c488e9e\") "
Sep 08 15:36:23.629263 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.629045    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c64fd39-9eab-4d0d-b18f-723d282c94e1-plugins-config-volume\") pod \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\" (UID: \"7c64fd39-9eab-4d0d-b18f-723d282c94e1\") "
Sep 08 15:36:23.629431 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.629406    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d2034f18-fecc-4e47-ae44-0df72c488e9e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d2034f18-fecc-4e47-ae44-0df72c488e9e" (UID: "d2034f18-fecc-4e47-ae44-0df72c488e9e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:23.629490 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.629448    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c64fd39-9eab-4d0d-b18f-723d282c94e1-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7c64fd39-9eab-4d0d-b18f-723d282c94e1" (UID: "7c64fd39-9eab-4d0d-b18f-723d282c94e1"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:23.631083 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.631063    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2034f18-fecc-4e47-ae44-0df72c488e9e-kube-api-access-8hhmf" (OuterVolumeSpecName: "kube-api-access-8hhmf") pod "d2034f18-fecc-4e47-ae44-0df72c488e9e" (UID: "d2034f18-fecc-4e47-ae44-0df72c488e9e"). InnerVolumeSpecName "kube-api-access-8hhmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:23.631182 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.631161    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c64fd39-9eab-4d0d-b18f-723d282c94e1-kube-api-access-xmjdf" (OuterVolumeSpecName: "kube-api-access-xmjdf") pod "7c64fd39-9eab-4d0d-b18f-723d282c94e1" (UID: "7c64fd39-9eab-4d0d-b18f-723d282c94e1"). InnerVolumeSpecName "kube-api-access-xmjdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:23.730076 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.730053    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmjdf\" (UniqueName: \"kubernetes.io/projected/7c64fd39-9eab-4d0d-b18f-723d282c94e1-kube-api-access-xmjdf\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:23.730076 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.730073    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8hhmf\" (UniqueName: \"kubernetes.io/projected/d2034f18-fecc-4e47-ae44-0df72c488e9e-kube-api-access-8hhmf\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:23.730076 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.730082    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d2034f18-fecc-4e47-ae44-0df72c488e9e-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:23.730274 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.730091    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7c64fd39-9eab-4d0d-b18f-723d282c94e1-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:23.913110 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.913077    2556 generic.go:356] "Generic (PLEG): container finished" podID="d2034f18-fecc-4e47-ae44-0df72c488e9e" containerID="6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f" exitCode=0
Sep 08 15:36:23.913279 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.913132    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"
Sep 08 15:36:23.913279 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.913149    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6" event={"ID":"d2034f18-fecc-4e47-ae44-0df72c488e9e","Type":"ContainerDied","Data":"6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f"}
Sep 08 15:36:23.913279 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.913202    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6" event={"ID":"d2034f18-fecc-4e47-ae44-0df72c488e9e","Type":"ContainerDied","Data":"fe2f780de0585128ab2e1c4bd0f7dea44cd8af79cf2a9aee32a19cc4abfcd563"}
Sep 08 15:36:23.913279 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.913234    2556 scope.go:117] "RemoveContainer" containerID="6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f"
Sep 08 15:36:23.914567 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.914545    2556 generic.go:356] "Generic (PLEG): container finished" podID="7c64fd39-9eab-4d0d-b18f-723d282c94e1" containerID="34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4" exitCode=0
Sep 08 15:36:23.914692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.914581    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"
Sep 08 15:36:23.914692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.914641    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk" event={"ID":"7c64fd39-9eab-4d0d-b18f-723d282c94e1","Type":"ContainerDied","Data":"34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4"}
Sep 08 15:36:23.914803 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.914720    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk" event={"ID":"7c64fd39-9eab-4d0d-b18f-723d282c94e1","Type":"ContainerDied","Data":"2709b7f62487186980606f26590fff6e14576dbfb339bd011a7de00bff5b8d0b"}
Sep 08 15:36:23.922843 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.922546    2556 scope.go:117] "RemoveContainer" containerID="6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f"
Sep 08 15:36:23.922927 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:36:23.922871    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f\": container with ID starting with 6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f not found: ID does not exist" containerID="6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f"
Sep 08 15:36:23.922927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.922899    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f"} err="failed to get container status \"6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f\": rpc error: code = NotFound desc = could not find container \"6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f\": container with ID starting with 6defbe09521bf0123dfe28c42d4098dea8f334a9dd35b449f82e20923d7c139f not found: ID does not exist"
Sep 08 15:36:23.922927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.922922    2556 scope.go:117] "RemoveContainer" containerID="34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4"
Sep 08 15:36:23.930617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.930600    2556 scope.go:117] "RemoveContainer" containerID="34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4"
Sep 08 15:36:23.930876 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:36:23.930859    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4\": container with ID starting with 34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4 not found: ID does not exist" containerID="34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4"
Sep 08 15:36:23.930926 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.930883    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4"} err="failed to get container status \"34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4\": rpc error: code = NotFound desc = could not find container \"34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4\": container with ID starting with 34f7f5b745b779500b6c398276e6d818dfceffd08190b3a588f2192d34a8aaf4 not found: ID does not exist"
Sep 08 15:36:23.937930 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.937907    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"]
Sep 08 15:36:23.943372 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.943343    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-08794c-7f77d5c99d-zjxw6"]
Sep 08 15:36:23.952298 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.952276    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"]
Sep 08 15:36:23.955574 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:23.955556    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-08794c-577f47cb4f-2mlnk"]
Sep 08 15:36:25.361632 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:25.361598    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="204ac6b9-25f6-4a80-8712-06383bf51ae0" path="/var/lib/kubelet/pods/204ac6b9-25f6-4a80-8712-06383bf51ae0/volumes"
Sep 08 15:36:25.362002 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:25.361965    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c64fd39-9eab-4d0d-b18f-723d282c94e1" path="/var/lib/kubelet/pods/7c64fd39-9eab-4d0d-b18f-723d282c94e1/volumes"
Sep 08 15:36:25.362269 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:25.362257    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2034f18-fecc-4e47-ae44-0df72c488e9e" path="/var/lib/kubelet/pods/d2034f18-fecc-4e47-ae44-0df72c488e9e/volumes"
Sep 08 15:36:30.352306 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352273    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"]
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352620    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c64fd39-9eab-4d0d-b18f-723d282c94e1" containerName="payload-processing"
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352631    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c64fd39-9eab-4d0d-b18f-723d282c94e1" containerName="payload-processing"
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352639    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="204ac6b9-25f6-4a80-8712-06383bf51ae0" containerName="revoke-keys"
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352645    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="204ac6b9-25f6-4a80-8712-06383bf51ae0" containerName="revoke-keys"
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352661    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2034f18-fecc-4e47-ae44-0df72c488e9e" containerName="payload-pre-processing"
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352679    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2034f18-fecc-4e47-ae44-0df72c488e9e" containerName="payload-pre-processing"
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352729    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="204ac6b9-25f6-4a80-8712-06383bf51ae0" containerName="revoke-keys"
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352737    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2034f18-fecc-4e47-ae44-0df72c488e9e" containerName="payload-pre-processing"
Sep 08 15:36:30.352788 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.352745    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c64fd39-9eab-4d0d-b18f-723d282c94e1" containerName="payload-processing"
Sep 08 15:36:30.357283 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.357267    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"
Sep 08 15:36:30.359598 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.359570    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:36:30.359735 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.359651    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:36:30.363563 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.363536    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"]
Sep 08 15:36:30.487256 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.487223    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c283d1-7424-4f9e-8c14-9b6268b91cfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj\" (UID: \"33c283d1-7424-4f9e-8c14-9b6268b91cfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"
Sep 08 15:36:30.588520 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.588489    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c283d1-7424-4f9e-8c14-9b6268b91cfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj\" (UID: \"33c283d1-7424-4f9e-8c14-9b6268b91cfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"
Sep 08 15:36:30.589106 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.589087    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c283d1-7424-4f9e-8c14-9b6268b91cfd-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj\" (UID: \"33c283d1-7424-4f9e-8c14-9b6268b91cfd\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"
Sep 08 15:36:30.670083 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.669993    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"
Sep 08 15:36:30.958564 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:30.957021    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"]
Sep 08 15:36:30.962177 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:36:30.962150    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod33c283d1_7424_4f9e_8c14_9b6268b91cfd.slice/crio-f05ed0ad26f9d8341bc851150a75e9c3ab290f3a5364ea35532f7b3965895d45 WatchSource:0}: Error finding container f05ed0ad26f9d8341bc851150a75e9c3ab290f3a5364ea35532f7b3965895d45: Status 404 returned error can't find the container with id f05ed0ad26f9d8341bc851150a75e9c3ab290f3a5364ea35532f7b3965895d45
Sep 08 15:36:31.963641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:31.963609    2556 generic.go:356] "Generic (PLEG): container finished" podID="33c283d1-7424-4f9e-8c14-9b6268b91cfd" containerID="06ed38bccbd7c51e1bf1b9f0f81fc4c0848c46a2e3e7da408c9efea2b74ffa4e" exitCode=0
Sep 08 15:36:31.964029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:31.963665    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj" event={"ID":"33c283d1-7424-4f9e-8c14-9b6268b91cfd","Type":"ContainerDied","Data":"06ed38bccbd7c51e1bf1b9f0f81fc4c0848c46a2e3e7da408c9efea2b74ffa4e"}
Sep 08 15:36:31.964029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:31.963735    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj" event={"ID":"33c283d1-7424-4f9e-8c14-9b6268b91cfd","Type":"ContainerStarted","Data":"f05ed0ad26f9d8341bc851150a75e9c3ab290f3a5364ea35532f7b3965895d45"}
Sep 08 15:36:33.100656 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:33.100634    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"
Sep 08 15:36:33.209993 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:33.209965    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c283d1-7424-4f9e-8c14-9b6268b91cfd-maas-api-service-ca\") pod \"33c283d1-7424-4f9e-8c14-9b6268b91cfd\" (UID: \"33c283d1-7424-4f9e-8c14-9b6268b91cfd\") "
Sep 08 15:36:33.210295 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:33.210273    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/33c283d1-7424-4f9e-8c14-9b6268b91cfd-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "33c283d1-7424-4f9e-8c14-9b6268b91cfd" (UID: "33c283d1-7424-4f9e-8c14-9b6268b91cfd"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:33.311445 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:33.311376    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/33c283d1-7424-4f9e-8c14-9b6268b91cfd-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:33.973299 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:33.973266    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"
Sep 08 15:36:33.973475 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:33.973316    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj" event={"ID":"33c283d1-7424-4f9e-8c14-9b6268b91cfd","Type":"ContainerDied","Data":"f05ed0ad26f9d8341bc851150a75e9c3ab290f3a5364ea35532f7b3965895d45"}
Sep 08 15:36:33.973475 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:33.973363    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f05ed0ad26f9d8341bc851150a75e9c3ab290f3a5364ea35532f7b3965895d45"
Sep 08 15:36:45.976047 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:45.975957    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"]
Sep 08 15:36:45.976600 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:45.976267    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n" podUID="861ba23a-cc1c-47fe-a229-07109f7014a6" containerName="payload-processing" containerID="cri-o://e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b" gracePeriod=30
Sep 08 15:36:45.984851 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:45.984822    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"]
Sep 08 15:36:45.985127 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:45.985078    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j" podUID="270d8551-448d-4c48-ad20-d59512d0c984" containerName="payload-pre-processing" containerID="cri-o://d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0" gracePeriod=30
Sep 08 15:36:46.154876 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.154815    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"]
Sep 08 15:36:46.159964 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.159888    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-0e34cd-drlbj"]
Sep 08 15:36:46.234124 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.234063    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:36:46.267647 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.267619    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:36:46.327036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.326973    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/861ba23a-cc1c-47fe-a229-07109f7014a6-plugins-config-volume\") pod \"861ba23a-cc1c-47fe-a229-07109f7014a6\" (UID: \"861ba23a-cc1c-47fe-a229-07109f7014a6\") "
Sep 08 15:36:46.327243 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.327049    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rdfh5\" (UniqueName: \"kubernetes.io/projected/861ba23a-cc1c-47fe-a229-07109f7014a6-kube-api-access-rdfh5\") pod \"861ba23a-cc1c-47fe-a229-07109f7014a6\" (UID: \"861ba23a-cc1c-47fe-a229-07109f7014a6\") "
Sep 08 15:36:46.329729 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.329701    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/861ba23a-cc1c-47fe-a229-07109f7014a6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "861ba23a-cc1c-47fe-a229-07109f7014a6" (UID: "861ba23a-cc1c-47fe-a229-07109f7014a6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:46.329870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.329855    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/861ba23a-cc1c-47fe-a229-07109f7014a6-kube-api-access-rdfh5" (OuterVolumeSpecName: "kube-api-access-rdfh5") pod "861ba23a-cc1c-47fe-a229-07109f7014a6" (UID: "861ba23a-cc1c-47fe-a229-07109f7014a6"). InnerVolumeSpecName "kube-api-access-rdfh5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:46.428533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.428496    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctzpd\" (UniqueName: \"kubernetes.io/projected/270d8551-448d-4c48-ad20-d59512d0c984-kube-api-access-ctzpd\") pod \"270d8551-448d-4c48-ad20-d59512d0c984\" (UID: \"270d8551-448d-4c48-ad20-d59512d0c984\") "
Sep 08 15:36:46.428763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.428563    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/270d8551-448d-4c48-ad20-d59512d0c984-plugins-config-volume\") pod \"270d8551-448d-4c48-ad20-d59512d0c984\" (UID: \"270d8551-448d-4c48-ad20-d59512d0c984\") "
Sep 08 15:36:46.428763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.428750    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/861ba23a-cc1c-47fe-a229-07109f7014a6-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:46.428763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.428762    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rdfh5\" (UniqueName: \"kubernetes.io/projected/861ba23a-cc1c-47fe-a229-07109f7014a6-kube-api-access-rdfh5\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:46.428956 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.428904    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/270d8551-448d-4c48-ad20-d59512d0c984-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "270d8551-448d-4c48-ad20-d59512d0c984" (UID: "270d8551-448d-4c48-ad20-d59512d0c984"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:46.430588 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.430564    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/270d8551-448d-4c48-ad20-d59512d0c984-kube-api-access-ctzpd" (OuterVolumeSpecName: "kube-api-access-ctzpd") pod "270d8551-448d-4c48-ad20-d59512d0c984" (UID: "270d8551-448d-4c48-ad20-d59512d0c984"). InnerVolumeSpecName "kube-api-access-ctzpd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:46.530144 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.530040    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/270d8551-448d-4c48-ad20-d59512d0c984-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:46.530144 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:46.530065    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctzpd\" (UniqueName: \"kubernetes.io/projected/270d8551-448d-4c48-ad20-d59512d0c984-kube-api-access-ctzpd\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:47.036797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.036758    2556 generic.go:356] "Generic (PLEG): container finished" podID="270d8551-448d-4c48-ad20-d59512d0c984" containerID="d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0" exitCode=0
Sep 08 15:36:47.036797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.036795    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"
Sep 08 15:36:47.037317 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.036880    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j" event={"ID":"270d8551-448d-4c48-ad20-d59512d0c984","Type":"ContainerDied","Data":"d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0"}
Sep 08 15:36:47.037317 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.036947    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j" event={"ID":"270d8551-448d-4c48-ad20-d59512d0c984","Type":"ContainerDied","Data":"60639ec8504e807d742254b87b39d9e3adcbf78eca2433f5f8c10895e2843b82"}
Sep 08 15:36:47.037317 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.036980    2556 scope.go:117] "RemoveContainer" containerID="d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0"
Sep 08 15:36:47.038509 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.038487    2556 generic.go:356] "Generic (PLEG): container finished" podID="861ba23a-cc1c-47fe-a229-07109f7014a6" containerID="e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b" exitCode=0
Sep 08 15:36:47.038617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.038529    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"
Sep 08 15:36:47.038617 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.038536    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n" event={"ID":"861ba23a-cc1c-47fe-a229-07109f7014a6","Type":"ContainerDied","Data":"e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b"}
Sep 08 15:36:47.038756 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.038644    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n" event={"ID":"861ba23a-cc1c-47fe-a229-07109f7014a6","Type":"ContainerDied","Data":"63bfeb3cda981fb08cfbe85b487908518ef58edb3a7b09c5b2a23a73f8f3bcc8"}
Sep 08 15:36:47.048046 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.048022    2556 scope.go:117] "RemoveContainer" containerID="d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0"
Sep 08 15:36:47.048368 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:36:47.048336    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0\": container with ID starting with d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0 not found: ID does not exist" containerID="d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0"
Sep 08 15:36:47.048450 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.048365    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0"} err="failed to get container status \"d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0\": rpc error: code = NotFound desc = could not find container \"d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0\": container with ID starting with d6b7ab2adef1386d923792de16dad98cef09bcdb3f7c69922a36f0fa64caaac0 not found: ID does not exist"
Sep 08 15:36:47.048450 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.048386    2556 scope.go:117] "RemoveContainer" containerID="e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b"
Sep 08 15:36:47.058114 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.058097    2556 scope.go:117] "RemoveContainer" containerID="e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b"
Sep 08 15:36:47.058396 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:36:47.058374    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b\": container with ID starting with e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b not found: ID does not exist" containerID="e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b"
Sep 08 15:36:47.058469 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.058416    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b"} err="failed to get container status \"e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b\": rpc error: code = NotFound desc = could not find container \"e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b\": container with ID starting with e866741be0e967f604724d5a4997263fc167431e2b66f913f1926d0d5410033b not found: ID does not exist"
Sep 08 15:36:47.061786 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.061757    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"]
Sep 08 15:36:47.065904 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.065883    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-b-0e34cd-55bc7bf58b-k967j"]
Sep 08 15:36:47.069690 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:36:47.069649    2556 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861ba23a_cc1c_47fe_a229_07109f7014a6.slice/crio-63bfeb3cda981fb08cfbe85b487908518ef58edb3a7b09c5b2a23a73f8f3bcc8\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod861ba23a_cc1c_47fe_a229_07109f7014a6.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod270d8551_448d_4c48_ad20_d59512d0c984.slice\": RecentStats: unable to find data in memory cache]"
Sep 08 15:36:47.075937 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.075914    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"]
Sep 08 15:36:47.079940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.079920    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-0e34cd-c8c9956f9-4pf2n"]
Sep 08 15:36:47.354719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.354687    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="270d8551-448d-4c48-ad20-d59512d0c984" path="/var/lib/kubelet/pods/270d8551-448d-4c48-ad20-d59512d0c984/volumes"
Sep 08 15:36:47.355023 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.355011    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="33c283d1-7424-4f9e-8c14-9b6268b91cfd" path="/var/lib/kubelet/pods/33c283d1-7424-4f9e-8c14-9b6268b91cfd/volumes"
Sep 08 15:36:47.355343 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:47.355331    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="861ba23a-cc1c-47fe-a229-07109f7014a6" path="/var/lib/kubelet/pods/861ba23a-cc1c-47fe-a229-07109f7014a6/volumes"
Sep 08 15:36:52.582546 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.582513    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"]
Sep 08 15:36:52.583059 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.582762    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy" containerID="cri-o://a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab" gracePeriod=30
Sep 08 15:36:52.927510 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927432    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"]
Sep 08 15:36:52.927801 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927788    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="270d8551-448d-4c48-ad20-d59512d0c984" containerName="payload-pre-processing"
Sep 08 15:36:52.927849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927803    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="270d8551-448d-4c48-ad20-d59512d0c984" containerName="payload-pre-processing"
Sep 08 15:36:52.927849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927826    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="861ba23a-cc1c-47fe-a229-07109f7014a6" containerName="payload-processing"
Sep 08 15:36:52.927849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927832    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="861ba23a-cc1c-47fe-a229-07109f7014a6" containerName="payload-processing"
Sep 08 15:36:52.927849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927839    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="33c283d1-7424-4f9e-8c14-9b6268b91cfd" containerName="revoke-keys"
Sep 08 15:36:52.927849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927845    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="33c283d1-7424-4f9e-8c14-9b6268b91cfd" containerName="revoke-keys"
Sep 08 15:36:52.927990 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927902    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="270d8551-448d-4c48-ad20-d59512d0c984" containerName="payload-pre-processing"
Sep 08 15:36:52.927990 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927912    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="33c283d1-7424-4f9e-8c14-9b6268b91cfd" containerName="revoke-keys"
Sep 08 15:36:52.927990 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.927919    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="861ba23a-cc1c-47fe-a229-07109f7014a6" containerName="payload-processing"
Sep 08 15:36:52.932141 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.932125    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"
Sep 08 15:36:52.934328 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.934303    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:36:52.934497 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.934470    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:36:52.937504 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.937483    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"]
Sep 08 15:36:52.987456 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:52.987423    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b69c4aa-88f9-4487-92d3-a57e8fc17d13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9\" (UID: \"3b69c4aa-88f9-4487-92d3-a57e8fc17d13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"
Sep 08 15:36:53.088199 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:53.088177    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b69c4aa-88f9-4487-92d3-a57e8fc17d13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9\" (UID: \"3b69c4aa-88f9-4487-92d3-a57e8fc17d13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"
Sep 08 15:36:53.088765 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:53.088747    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b69c4aa-88f9-4487-92d3-a57e8fc17d13-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9\" (UID: \"3b69c4aa-88f9-4487-92d3-a57e8fc17d13\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"
Sep 08 15:36:53.248270 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:53.248184    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:36:53.256739 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:53.256710    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"
Sep 08 15:36:53.526378 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:53.526259    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"]
Sep 08 15:36:53.528549 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:36:53.528512    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b69c4aa_88f9_4487_92d3_a57e8fc17d13.slice/crio-18b4c1d06c1d00d63df5dcc72fcc9e388d262e691f476c9169fc470a94ce3d1d WatchSource:0}: Error finding container 18b4c1d06c1d00d63df5dcc72fcc9e388d262e691f476c9169fc470a94ce3d1d: Status 404 returned error can't find the container with id 18b4c1d06c1d00d63df5dcc72fcc9e388d262e691f476c9169fc470a94ce3d1d
Sep 08 15:36:54.077749 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:54.077716    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9" event={"ID":"3b69c4aa-88f9-4487-92d3-a57e8fc17d13","Type":"ContainerStarted","Data":"a4996ffdf93eadf643a13271f168f52ccf1d11582879ff1e3fcfdccb4c5ec0ef"}
Sep 08 15:36:54.078098 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:54.077770    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9" event={"ID":"3b69c4aa-88f9-4487-92d3-a57e8fc17d13","Type":"ContainerStarted","Data":"18b4c1d06c1d00d63df5dcc72fcc9e388d262e691f476c9169fc470a94ce3d1d"}
Sep 08 15:36:54.091633 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:54.091587    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9" podStartSLOduration=2.091573022 podStartE2EDuration="2.091573022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:36:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:36:54.091036939 +0000 UTC m=+1441.191931033" watchObservedRunningTime="2026-09-08 15:36:54.091573022 +0000 UTC m=+1441.192467152"
Sep 08 15:36:55.083962 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:55.083931    2556 generic.go:356] "Generic (PLEG): container finished" podID="3b69c4aa-88f9-4487-92d3-a57e8fc17d13" containerID="a4996ffdf93eadf643a13271f168f52ccf1d11582879ff1e3fcfdccb4c5ec0ef" exitCode=0
Sep 08 15:36:55.084349 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:55.084000    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9" event={"ID":"3b69c4aa-88f9-4487-92d3-a57e8fc17d13","Type":"ContainerDied","Data":"a4996ffdf93eadf643a13271f168f52ccf1d11582879ff1e3fcfdccb4c5ec0ef"}
Sep 08 15:36:56.223992 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:56.223964    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"
Sep 08 15:36:56.312739 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:56.312713    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b69c4aa-88f9-4487-92d3-a57e8fc17d13-maas-api-service-ca\") pod \"3b69c4aa-88f9-4487-92d3-a57e8fc17d13\" (UID: \"3b69c4aa-88f9-4487-92d3-a57e8fc17d13\") "
Sep 08 15:36:56.313067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:56.313042    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b69c4aa-88f9-4487-92d3-a57e8fc17d13-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3b69c4aa-88f9-4487-92d3-a57e8fc17d13" (UID: "3b69c4aa-88f9-4487-92d3-a57e8fc17d13"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:56.414118 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:56.414054    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3b69c4aa-88f9-4487-92d3-a57e8fc17d13-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:57.095125 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.095092    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9" event={"ID":"3b69c4aa-88f9-4487-92d3-a57e8fc17d13","Type":"ContainerDied","Data":"18b4c1d06c1d00d63df5dcc72fcc9e388d262e691f476c9169fc470a94ce3d1d"}
Sep 08 15:36:57.095296 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.095139    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18b4c1d06c1d00d63df5dcc72fcc9e388d262e691f476c9169fc470a94ce3d1d"
Sep 08 15:36:57.095296 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.095100    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"
Sep 08 15:36:57.838063 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.838042    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:36:57.926479 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926409    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istiod-ca-cert\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926479 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926461    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lntfh\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-kube-api-access-lntfh\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926691 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926505    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-certs\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926691 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926522    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-podinfo\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926691 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926582    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-socket\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926691 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926620    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-token\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926691 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926644    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-credential-socket\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926702    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-envoy\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926726    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-data\") pod \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\" (UID: \"6a9e1fc5-60cd-458c-81e8-5c25af1366ea\") "
Sep 08 15:36:57.926961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926727    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:36:57.926961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926837    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:57.927169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.926967    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:57.927169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.927022    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:57.927169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.927047    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:57.927169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.927113    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:57.927366 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.927175    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:57.928805 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.928778    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:36:57.928928 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.928818    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:36:57.928928 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.928883    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:57.928928 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:57.928900    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-kube-api-access-lntfh" (OuterVolumeSpecName: "kube-api-access-lntfh") pod "6a9e1fc5-60cd-458c-81e8-5c25af1366ea" (UID: "6a9e1fc5-60cd-458c-81e8-5c25af1366ea"). InnerVolumeSpecName "kube-api-access-lntfh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:36:58.027644 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.027615    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:58.027644 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.027641    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:58.027829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.027657    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:58.027829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.027691    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:58.027829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.027704    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lntfh\" (UniqueName: \"kubernetes.io/projected/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-kube-api-access-lntfh\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:58.027829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.027718    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:58.027829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.027732    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6a9e1fc5-60cd-458c-81e8-5c25af1366ea-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:36:58.102200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.102168    2556 generic.go:356] "Generic (PLEG): container finished" podID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerID="a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab" exitCode=0
Sep 08 15:36:58.102311 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.102219    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" event={"ID":"6a9e1fc5-60cd-458c-81e8-5c25af1366ea","Type":"ContainerDied","Data":"a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab"}
Sep 08 15:36:58.102311 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.102222    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"
Sep 08 15:36:58.102311 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.102268    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd" event={"ID":"6a9e1fc5-60cd-458c-81e8-5c25af1366ea","Type":"ContainerDied","Data":"b2d0435c2cc4a23de0692a02b04163a518a494c7f611f47454cf1ec9fb9b0819"}
Sep 08 15:36:58.102311 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.102294    2556 scope.go:117] "RemoveContainer" containerID="a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab"
Sep 08 15:36:58.111743 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.111721    2556 scope.go:117] "RemoveContainer" containerID="4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2"
Sep 08 15:36:58.119533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.119515    2556 scope.go:117] "RemoveContainer" containerID="a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab"
Sep 08 15:36:58.119820 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:36:58.119801    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab\": container with ID starting with a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab not found: ID does not exist" containerID="a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab"
Sep 08 15:36:58.119880 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.119827    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab"} err="failed to get container status \"a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab\": rpc error: code = NotFound desc = could not find container \"a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab\": container with ID starting with a079eb08fbe1ed123816a908e61b14dc826b2dfc70513b181273769dcaa215ab not found: ID does not exist"
Sep 08 15:36:58.119880 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.119842    2556 scope.go:117] "RemoveContainer" containerID="4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2"
Sep 08 15:36:58.120081 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:36:58.120063    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2\": container with ID starting with 4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2 not found: ID does not exist" containerID="4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2"
Sep 08 15:36:58.120122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.120087    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2"} err="failed to get container status \"4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2\": rpc error: code = NotFound desc = could not find container \"4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2\": container with ID starting with 4eff28bc474b4a8f75624c9561b83462dde971273188aa96a22acbe8ae211fe2 not found: ID does not exist"
Sep 08 15:36:58.125916 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.125893    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"]
Sep 08 15:36:58.129616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:58.129595    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-0e34cd-openshift-default-557dd656d-fkrwd"]
Sep 08 15:36:59.355208 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:36:59.355173    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" path="/var/lib/kubelet/pods/6a9e1fc5-60cd-458c-81e8-5c25af1366ea/volumes"
Sep 08 15:37:03.408562 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.408534    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"]
Sep 08 15:37:03.409108 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.408733    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp" podUID="2d05fd9d-8dc6-4570-9021-52b3315edd32" containerName="payload-pre-processing" containerID="cri-o://3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec" gracePeriod=30
Sep 08 15:37:03.577551 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.577504    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"]
Sep 08 15:37:03.580094 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.580067    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-020a18-7v5z9"]
Sep 08 15:37:03.672899 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.672833    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:37:03.774500 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.774467    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d05fd9d-8dc6-4570-9021-52b3315edd32-plugins-config-volume\") pod \"2d05fd9d-8dc6-4570-9021-52b3315edd32\" (UID: \"2d05fd9d-8dc6-4570-9021-52b3315edd32\") "
Sep 08 15:37:03.774708 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.774569    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d5ht\" (UniqueName: \"kubernetes.io/projected/2d05fd9d-8dc6-4570-9021-52b3315edd32-kube-api-access-8d5ht\") pod \"2d05fd9d-8dc6-4570-9021-52b3315edd32\" (UID: \"2d05fd9d-8dc6-4570-9021-52b3315edd32\") "
Sep 08 15:37:03.774920 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.774897    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d05fd9d-8dc6-4570-9021-52b3315edd32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d05fd9d-8dc6-4570-9021-52b3315edd32" (UID: "2d05fd9d-8dc6-4570-9021-52b3315edd32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:37:03.776616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.776592    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d05fd9d-8dc6-4570-9021-52b3315edd32-kube-api-access-8d5ht" (OuterVolumeSpecName: "kube-api-access-8d5ht") pod "2d05fd9d-8dc6-4570-9021-52b3315edd32" (UID: "2d05fd9d-8dc6-4570-9021-52b3315edd32"). InnerVolumeSpecName "kube-api-access-8d5ht". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:03.875721 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.875691    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d5ht\" (UniqueName: \"kubernetes.io/projected/2d05fd9d-8dc6-4570-9021-52b3315edd32-kube-api-access-8d5ht\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:03.875721 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:03.875717    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d05fd9d-8dc6-4570-9021-52b3315edd32-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:04.134014 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.133985    2556 generic.go:356] "Generic (PLEG): container finished" podID="2d05fd9d-8dc6-4570-9021-52b3315edd32" containerID="3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec" exitCode=0
Sep 08 15:37:04.134175 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.134035    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"
Sep 08 15:37:04.134175 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.134073    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp" event={"ID":"2d05fd9d-8dc6-4570-9021-52b3315edd32","Type":"ContainerDied","Data":"3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec"}
Sep 08 15:37:04.134175 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.134127    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp" event={"ID":"2d05fd9d-8dc6-4570-9021-52b3315edd32","Type":"ContainerDied","Data":"1da310bcedd68a769496ff80f503c806bcc0b22175182822ccd54b7e168983a9"}
Sep 08 15:37:04.134175 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.134150    2556 scope.go:117] "RemoveContainer" containerID="3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec"
Sep 08 15:37:04.144060 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.144032    2556 scope.go:117] "RemoveContainer" containerID="3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec"
Sep 08 15:37:04.144340 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:37:04.144320    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec\": container with ID starting with 3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec not found: ID does not exist" containerID="3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec"
Sep 08 15:37:04.144424 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.144347    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec"} err="failed to get container status \"3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec\": rpc error: code = NotFound desc = could not find container \"3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec\": container with ID starting with 3d40b606b4729efb6de5599707df24c5f4c30f91dc84fea0b47168b0193c03ec not found: ID does not exist"
Sep 08 15:37:04.155897 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.155874    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"]
Sep 08 15:37:04.161602 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:04.161583    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-020a18-b95fcfc8b-n8sgp"]
Sep 08 15:37:05.354242 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:05.354205    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d05fd9d-8dc6-4570-9021-52b3315edd32" path="/var/lib/kubelet/pods/2d05fd9d-8dc6-4570-9021-52b3315edd32/volumes"
Sep 08 15:37:05.354732 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:05.354511    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b69c4aa-88f9-4487-92d3-a57e8fc17d13" path="/var/lib/kubelet/pods/3b69c4aa-88f9-4487-92d3-a57e8fc17d13/volumes"
Sep 08 15:37:10.422451 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422416    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"]
Sep 08 15:37:10.422832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422766    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy"
Sep 08 15:37:10.422832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422778    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy"
Sep 08 15:37:10.422832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422789    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d05fd9d-8dc6-4570-9021-52b3315edd32" containerName="payload-pre-processing"
Sep 08 15:37:10.422832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422796    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d05fd9d-8dc6-4570-9021-52b3315edd32" containerName="payload-pre-processing"
Sep 08 15:37:10.422832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422814    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b69c4aa-88f9-4487-92d3-a57e8fc17d13" containerName="revoke-keys"
Sep 08 15:37:10.422832 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422820    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b69c4aa-88f9-4487-92d3-a57e8fc17d13" containerName="revoke-keys"
Sep 08 15:37:10.423043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422872    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d05fd9d-8dc6-4570-9021-52b3315edd32" containerName="payload-pre-processing"
Sep 08 15:37:10.423043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422880    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy"
Sep 08 15:37:10.423043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.422889    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b69c4aa-88f9-4487-92d3-a57e8fc17d13" containerName="revoke-keys"
Sep 08 15:37:10.426956 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.426942    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"
Sep 08 15:37:10.429527 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.429505    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:37:10.429635 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.429512    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:37:10.434376 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.434352    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"]
Sep 08 15:37:10.529958 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.529925    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ed2cd-d935-4025-a550-723fcf97b434-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg\" (UID: \"ee4ed2cd-d935-4025-a550-723fcf97b434\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"
Sep 08 15:37:10.631254 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.631215    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ed2cd-d935-4025-a550-723fcf97b434-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg\" (UID: \"ee4ed2cd-d935-4025-a550-723fcf97b434\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"
Sep 08 15:37:10.631823 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.631804    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ed2cd-d935-4025-a550-723fcf97b434-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg\" (UID: \"ee4ed2cd-d935-4025-a550-723fcf97b434\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"
Sep 08 15:37:10.738430 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:10.738369    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"
Sep 08 15:37:11.012336 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:11.012310    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"]
Sep 08 15:37:11.014281 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:37:11.014249    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4ed2cd_d935_4025_a550_723fcf97b434.slice/crio-c52e38b076d38cfbcbf7c3130144efe7686f5186d4f696fdd270f774a90b918b WatchSource:0}: Error finding container c52e38b076d38cfbcbf7c3130144efe7686f5186d4f696fdd270f774a90b918b: Status 404 returned error can't find the container with id c52e38b076d38cfbcbf7c3130144efe7686f5186d4f696fdd270f774a90b918b
Sep 08 15:37:11.171325 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:11.171297    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg" event={"ID":"ee4ed2cd-d935-4025-a550-723fcf97b434","Type":"ContainerStarted","Data":"c52e38b076d38cfbcbf7c3130144efe7686f5186d4f696fdd270f774a90b918b"}
Sep 08 15:37:12.177808 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:12.177768    2556 generic.go:356] "Generic (PLEG): container finished" podID="ee4ed2cd-d935-4025-a550-723fcf97b434" containerID="804b9bde973fad51a82a74075fb2afb623c403da0d6cb0d6a983a5d6aa6f579f" exitCode=0
Sep 08 15:37:12.178201 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:12.177850    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg" event={"ID":"ee4ed2cd-d935-4025-a550-723fcf97b434","Type":"ContainerDied","Data":"804b9bde973fad51a82a74075fb2afb623c403da0d6cb0d6a983a5d6aa6f579f"}
Sep 08 15:37:13.313685 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:13.313644    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"
Sep 08 15:37:13.356503 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:13.356468    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ed2cd-d935-4025-a550-723fcf97b434-maas-api-service-ca\") pod \"ee4ed2cd-d935-4025-a550-723fcf97b434\" (UID: \"ee4ed2cd-d935-4025-a550-723fcf97b434\") "
Sep 08 15:37:13.356849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:13.356828    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ee4ed2cd-d935-4025-a550-723fcf97b434-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ee4ed2cd-d935-4025-a550-723fcf97b434" (UID: "ee4ed2cd-d935-4025-a550-723fcf97b434"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:37:13.457315 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:13.457214    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ee4ed2cd-d935-4025-a550-723fcf97b434-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:14.189388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:14.189348    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg" event={"ID":"ee4ed2cd-d935-4025-a550-723fcf97b434","Type":"ContainerDied","Data":"c52e38b076d38cfbcbf7c3130144efe7686f5186d4f696fdd270f774a90b918b"}
Sep 08 15:37:14.189568 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:14.189397    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c52e38b076d38cfbcbf7c3130144efe7686f5186d4f696fdd270f774a90b918b"
Sep 08 15:37:14.189568 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:14.189365    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"
Sep 08 15:37:21.083455 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.083424    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"]
Sep 08 15:37:21.083930 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.083639    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh" podUID="4ee60fab-0aff-41fc-b148-435d423be639" containerName="payload-pre-processing" containerID="cri-o://517767a61c30ad129b61f4759f0f96330e099e8a270d5efaa09d971d706ede51" gracePeriod=30
Sep 08 15:37:21.229370 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.229331    2556 generic.go:356] "Generic (PLEG): container finished" podID="4ee60fab-0aff-41fc-b148-435d423be639" containerID="517767a61c30ad129b61f4759f0f96330e099e8a270d5efaa09d971d706ede51" exitCode=0
Sep 08 15:37:21.229530 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.229391    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh" event={"ID":"4ee60fab-0aff-41fc-b148-435d423be639","Type":"ContainerDied","Data":"517767a61c30ad129b61f4759f0f96330e099e8a270d5efaa09d971d706ede51"}
Sep 08 15:37:21.244954 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.244927    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"]
Sep 08 15:37:21.249905 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.249883    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-d62b4e-5gtrg"]
Sep 08 15:37:21.330635 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.330614    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:37:21.357121 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.357062    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee4ed2cd-d935-4025-a550-723fcf97b434" path="/var/lib/kubelet/pods/ee4ed2cd-d935-4025-a550-723fcf97b434/volumes"
Sep 08 15:37:21.426326 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.426289    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ee60fab-0aff-41fc-b148-435d423be639-plugins-config-volume\") pod \"4ee60fab-0aff-41fc-b148-435d423be639\" (UID: \"4ee60fab-0aff-41fc-b148-435d423be639\") "
Sep 08 15:37:21.426490 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.426413    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d86ps\" (UniqueName: \"kubernetes.io/projected/4ee60fab-0aff-41fc-b148-435d423be639-kube-api-access-d86ps\") pod \"4ee60fab-0aff-41fc-b148-435d423be639\" (UID: \"4ee60fab-0aff-41fc-b148-435d423be639\") "
Sep 08 15:37:21.426879 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.426658    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ee60fab-0aff-41fc-b148-435d423be639-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ee60fab-0aff-41fc-b148-435d423be639" (UID: "4ee60fab-0aff-41fc-b148-435d423be639"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:37:21.428488 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.428466    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ee60fab-0aff-41fc-b148-435d423be639-kube-api-access-d86ps" (OuterVolumeSpecName: "kube-api-access-d86ps") pod "4ee60fab-0aff-41fc-b148-435d423be639" (UID: "4ee60fab-0aff-41fc-b148-435d423be639"). InnerVolumeSpecName "kube-api-access-d86ps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:21.528093 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.528058    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d86ps\" (UniqueName: \"kubernetes.io/projected/4ee60fab-0aff-41fc-b148-435d423be639-kube-api-access-d86ps\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:21.528093 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:21.528086    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ee60fab-0aff-41fc-b148-435d423be639-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:22.235744 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:22.235711    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"
Sep 08 15:37:22.235744 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:22.235725    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh" event={"ID":"4ee60fab-0aff-41fc-b148-435d423be639","Type":"ContainerDied","Data":"7cc69c44901fee991b2579d449af74638c5ada75fa1fe86871452780215e47ec"}
Sep 08 15:37:22.236251 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:22.235804    2556 scope.go:117] "RemoveContainer" containerID="517767a61c30ad129b61f4759f0f96330e099e8a270d5efaa09d971d706ede51"
Sep 08 15:37:22.256902 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:22.256875    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"]
Sep 08 15:37:22.259396 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:22.259366    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-d62b4e-5dd7b869cd-cxsjh"]
Sep 08 15:37:23.358328 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:23.358290    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ee60fab-0aff-41fc-b148-435d423be639" path="/var/lib/kubelet/pods/4ee60fab-0aff-41fc-b148-435d423be639/volumes"
Sep 08 15:37:27.693157 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:27.693126    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"]
Sep 08 15:37:27.693576 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:27.693356    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy" containerID="cri-o://58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c" gracePeriod=30
Sep 08 15:37:29.398852 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:29.398820    2556 patch_prober.go:28] interesting pod/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:37:29.399214 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:29.398875    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:37:32.938981 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:32.938955    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:37:33.021402 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021338    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-podinfo\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021402 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021369    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74bdbb6e-1f70-487e-80a6-480794e7ad59-istiod-ca-cert\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021587 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021411    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-socket\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021587 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021429    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-envoy\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021587 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021487    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-data\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021587 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021510    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rp5xg\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-kube-api-access-rp5xg\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021587 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021539    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-certs\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021587 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021565    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-credential-socket\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021917 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021604    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-token\") pod \"74bdbb6e-1f70-487e-80a6-480794e7ad59\" (UID: \"74bdbb6e-1f70-487e-80a6-480794e7ad59\") "
Sep 08 15:37:33.021917 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021768    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:33.021917 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021846    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/74bdbb6e-1f70-487e-80a6-480794e7ad59-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:37:33.021917 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021862    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-data" (OuterVolumeSpecName: "istio-data") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:33.022122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.021980    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.022122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.022030    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/74bdbb6e-1f70-487e-80a6-480794e7ad59-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.022122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.022048    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.022122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.022092    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:33.022313 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.022109    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:33.023627 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.023597    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-kube-api-access-rp5xg" (OuterVolumeSpecName: "kube-api-access-rp5xg") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "kube-api-access-rp5xg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:33.023921 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.023893    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-token" (OuterVolumeSpecName: "istio-token") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:33.024004 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.023948    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:37:33.024004 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.023968    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "74bdbb6e-1f70-487e-80a6-480794e7ad59" (UID: "74bdbb6e-1f70-487e-80a6-480794e7ad59"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:33.122643 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.122616    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.122643 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.122639    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rp5xg\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-kube-api-access-rp5xg\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.122815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.122649    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.122815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.122658    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/74bdbb6e-1f70-487e-80a6-480794e7ad59-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.122815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.122685    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.122815 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.122694    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/74bdbb6e-1f70-487e-80a6-480794e7ad59-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:37:33.300518 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.300443    2556 generic.go:356] "Generic (PLEG): container finished" podID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerID="58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c" exitCode=0
Sep 08 15:37:33.300518 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.300497    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"
Sep 08 15:37:33.300518 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.300512    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" event={"ID":"74bdbb6e-1f70-487e-80a6-480794e7ad59","Type":"ContainerDied","Data":"58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c"}
Sep 08 15:37:33.300756 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.300570    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z" event={"ID":"74bdbb6e-1f70-487e-80a6-480794e7ad59","Type":"ContainerDied","Data":"7038d325061b626c22062150f9b4f175936a7a94c492c1d7de79ae47933f4b6e"}
Sep 08 15:37:33.300756 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.300602    2556 scope.go:117] "RemoveContainer" containerID="58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c"
Sep 08 15:37:33.309498 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.309481    2556 scope.go:117] "RemoveContainer" containerID="bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722"
Sep 08 15:37:33.319784 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.319765    2556 scope.go:117] "RemoveContainer" containerID="58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c"
Sep 08 15:37:33.320055 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:37:33.320033    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c\": container with ID starting with 58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c not found: ID does not exist" containerID="58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c"
Sep 08 15:37:33.320102 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.320064    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c"} err="failed to get container status \"58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c\": rpc error: code = NotFound desc = could not find container \"58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c\": container with ID starting with 58db0fc2f80a7b312252349e665b8cc7b8168612275b0e37b8f9a939fc5fe92c not found: ID does not exist"
Sep 08 15:37:33.320102 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.320079    2556 scope.go:117] "RemoveContainer" containerID="bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722"
Sep 08 15:37:33.320316 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:37:33.320303    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722\": container with ID starting with bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722 not found: ID does not exist" containerID="bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722"
Sep 08 15:37:33.320361 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.320318    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722"} err="failed to get container status \"bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722\": rpc error: code = NotFound desc = could not find container \"bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722\": container with ID starting with bc8915d8c0316e117de5b13a949c09dfe8fd98b3c0e3fa6b9f578e1601a8b722 not found: ID does not exist"
Sep 08 15:37:33.324114 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.324089    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"]
Sep 08 15:37:33.327996 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.327975    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-d62b4e-openshift-default-568fc59fd6-zsm2z"]
Sep 08 15:37:33.354802 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:33.354780    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" path="/var/lib/kubelet/pods/74bdbb6e-1f70-487e-80a6-480794e7ad59/volumes"
Sep 08 15:37:42.653845 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.653808    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"]
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654161    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654172    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654187    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654192    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654204    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4ed2cd-d935-4025-a550-723fcf97b434" containerName="revoke-keys"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654210    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4ed2cd-d935-4025-a550-723fcf97b434" containerName="revoke-keys"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654218    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654223    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654230    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ee60fab-0aff-41fc-b148-435d423be639" containerName="payload-pre-processing"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654235    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ee60fab-0aff-41fc-b148-435d423be639" containerName="payload-pre-processing"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654282    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654288    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6a9e1fc5-60cd-458c-81e8-5c25af1366ea" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654296    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="74bdbb6e-1f70-487e-80a6-480794e7ad59" containerName="istio-proxy"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654301    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4ed2cd-d935-4025-a550-723fcf97b434" containerName="revoke-keys"
Sep 08 15:37:42.654330 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.654306    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ee60fab-0aff-41fc-b148-435d423be639" containerName="payload-pre-processing"
Sep 08 15:37:42.658496 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.658480    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:42.661042 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.661020    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-014f36\""
Sep 08 15:37:42.668066 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.668036    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"]
Sep 08 15:37:42.692212 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.692189    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"]
Sep 08 15:37:42.695352 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.695336    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:42.701635 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.701615    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-014f36-dockercfg-md8c8\""
Sep 08 15:37:42.708959 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.708938    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"]
Sep 08 15:37:42.801437 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.801392    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ktxqg\" (UniqueName: \"kubernetes.io/projected/935c7d9c-3a45-4973-9a6e-919d41d349ca-kube-api-access-ktxqg\") pod \"payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9\" (UID: \"935c7d9c-3a45-4973-9a6e-919d41d349ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:42.801625 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.801458    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttkvk\" (UniqueName: \"kubernetes.io/projected/a1f19d59-00db-4e09-bbb6-8d664c3bee70-kube-api-access-ttkvk\") pod \"payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6\" (UID: \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:42.801625 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.801517    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1f19d59-00db-4e09-bbb6-8d664c3bee70-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6\" (UID: \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:42.801812 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.801646    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935c7d9c-3a45-4973-9a6e-919d41d349ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9\" (UID: \"935c7d9c-3a45-4973-9a6e-919d41d349ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:42.902572 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.902540    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ktxqg\" (UniqueName: \"kubernetes.io/projected/935c7d9c-3a45-4973-9a6e-919d41d349ca-kube-api-access-ktxqg\") pod \"payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9\" (UID: \"935c7d9c-3a45-4973-9a6e-919d41d349ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:42.902572 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.902578    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ttkvk\" (UniqueName: \"kubernetes.io/projected/a1f19d59-00db-4e09-bbb6-8d664c3bee70-kube-api-access-ttkvk\") pod \"payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6\" (UID: \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:42.902796 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.902612    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1f19d59-00db-4e09-bbb6-8d664c3bee70-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6\" (UID: \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:42.902796 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.902659    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935c7d9c-3a45-4973-9a6e-919d41d349ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9\" (UID: \"935c7d9c-3a45-4973-9a6e-919d41d349ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:42.903560 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.903536    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1f19d59-00db-4e09-bbb6-8d664c3bee70-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6\" (UID: \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:42.903623 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.903536    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935c7d9c-3a45-4973-9a6e-919d41d349ca-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9\" (UID: \"935c7d9c-3a45-4973-9a6e-919d41d349ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:42.911353 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.911306    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttkvk\" (UniqueName: \"kubernetes.io/projected/a1f19d59-00db-4e09-bbb6-8d664c3bee70-kube-api-access-ttkvk\") pod \"payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6\" (UID: \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:42.913858 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.913840    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ktxqg\" (UniqueName: \"kubernetes.io/projected/935c7d9c-3a45-4973-9a6e-919d41d349ca-kube-api-access-ktxqg\") pod \"payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9\" (UID: \"935c7d9c-3a45-4973-9a6e-919d41d349ca\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:42.969789 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:42.969767    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:43.004876 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.004841    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:43.244391 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.244367    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"]
Sep 08 15:37:43.246504 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:37:43.246476    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod935c7d9c_3a45_4973_9a6e_919d41d349ca.slice/crio-28c37b2a4ce77ed52eb558a7ad31ff88e9cb6e4a085c4e4bd99e7df1d6675db1 WatchSource:0}: Error finding container 28c37b2a4ce77ed52eb558a7ad31ff88e9cb6e4a085c4e4bd99e7df1d6675db1: Status 404 returned error can't find the container with id 28c37b2a4ce77ed52eb558a7ad31ff88e9cb6e4a085c4e4bd99e7df1d6675db1
Sep 08 15:37:43.284650 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.284627    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"]
Sep 08 15:37:43.302738 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:37:43.302661    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1f19d59_00db_4e09_bbb6_8d664c3bee70.slice/crio-7c97262ddeaed3d7b2e215ff052779bd2fc911291abd100d60a843eadf4f493a WatchSource:0}: Error finding container 7c97262ddeaed3d7b2e215ff052779bd2fc911291abd100d60a843eadf4f493a: Status 404 returned error can't find the container with id 7c97262ddeaed3d7b2e215ff052779bd2fc911291abd100d60a843eadf4f493a
Sep 08 15:37:43.362443 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.362411    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6" event={"ID":"a1f19d59-00db-4e09-bbb6-8d664c3bee70","Type":"ContainerStarted","Data":"c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9"}
Sep 08 15:37:43.362579 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.362472    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6" event={"ID":"a1f19d59-00db-4e09-bbb6-8d664c3bee70","Type":"ContainerStarted","Data":"7c97262ddeaed3d7b2e215ff052779bd2fc911291abd100d60a843eadf4f493a"}
Sep 08 15:37:43.362698 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.362655    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:43.364256 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.364224    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9" event={"ID":"935c7d9c-3a45-4973-9a6e-919d41d349ca","Type":"ContainerStarted","Data":"3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175"}
Sep 08 15:37:43.364358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.364274    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9" event={"ID":"935c7d9c-3a45-4973-9a6e-919d41d349ca","Type":"ContainerStarted","Data":"28c37b2a4ce77ed52eb558a7ad31ff88e9cb6e4a085c4e4bd99e7df1d6675db1"}
Sep 08 15:37:43.364358 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.364319    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:37:43.381017 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.380973    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6" podStartSLOduration=1.380958095 podStartE2EDuration="1.380958095s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:43.378882647 +0000 UTC m=+1490.479776781" watchObservedRunningTime="2026-09-08 15:37:43.380958095 +0000 UTC m=+1490.481852225"
Sep 08 15:37:43.394626 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:43.394581    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9" podStartSLOduration=1.394567064 podStartE2EDuration="1.394567064s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:43.393330854 +0000 UTC m=+1490.494224964" watchObservedRunningTime="2026-09-08 15:37:43.394567064 +0000 UTC m=+1490.495461175"
Sep 08 15:37:54.372559 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:54.372528    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:37:54.372948 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:37:54.372592    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:38:12.118404 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.118362    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"]
Sep 08 15:38:12.121096 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.121078    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:12.123491 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.123471    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-30cc8d-dockercfg-pnwk9\""
Sep 08 15:38:12.123990 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.123970    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-30cc8d\""
Sep 08 15:38:12.133473 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.133450    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"]
Sep 08 15:38:12.243840 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.243807    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xw6f2\" (UniqueName: \"kubernetes.io/projected/7967a5c7-0618-45d5-b6dc-58745a79bdb2-kube-api-access-xw6f2\") pod \"payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br\" (UID: \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:12.244020 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.243873    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7967a5c7-0618-45d5-b6dc-58745a79bdb2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br\" (UID: \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:12.344875 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.344835    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xw6f2\" (UniqueName: \"kubernetes.io/projected/7967a5c7-0618-45d5-b6dc-58745a79bdb2-kube-api-access-xw6f2\") pod \"payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br\" (UID: \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:12.345013 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.344927    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7967a5c7-0618-45d5-b6dc-58745a79bdb2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br\" (UID: \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:12.345831 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.345807    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7967a5c7-0618-45d5-b6dc-58745a79bdb2-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br\" (UID: \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:12.354087 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.354062    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xw6f2\" (UniqueName: \"kubernetes.io/projected/7967a5c7-0618-45d5-b6dc-58745a79bdb2-kube-api-access-xw6f2\") pod \"payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br\" (UID: \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:12.431608 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.431539    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:12.704043 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:12.704010    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"]
Sep 08 15:38:12.705526 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:38:12.705499    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7967a5c7_0618_45d5_b6dc_58745a79bdb2.slice/crio-baa27580c94de80ec7857c0715ae54079e58727c498914658ae2498fdfad4c4a WatchSource:0}: Error finding container baa27580c94de80ec7857c0715ae54079e58727c498914658ae2498fdfad4c4a: Status 404 returned error can't find the container with id baa27580c94de80ec7857c0715ae54079e58727c498914658ae2498fdfad4c4a
Sep 08 15:38:13.514005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:13.513965    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br" event={"ID":"7967a5c7-0618-45d5-b6dc-58745a79bdb2","Type":"ContainerStarted","Data":"be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338"}
Sep 08 15:38:13.514448 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:13.514027    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br" event={"ID":"7967a5c7-0618-45d5-b6dc-58745a79bdb2","Type":"ContainerStarted","Data":"baa27580c94de80ec7857c0715ae54079e58727c498914658ae2498fdfad4c4a"}
Sep 08 15:38:13.514448 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:13.514059    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:24.522387 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:24.522318    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:38:24.539029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:38:24.538980    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br" podStartSLOduration=12.538965644 podStartE2EDuration="12.538965644s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:13.541994965 +0000 UTC m=+1520.642889076" watchObservedRunningTime="2026-09-08 15:38:24.538965644 +0000 UTC m=+1531.639859755"
Sep 08 15:39:23.220178 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:23.220145    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6_a1f19d59-00db-4e09-bbb6-8d664c3bee70/payload-processing/0.log"
Sep 08 15:39:24.038000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.037967    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"]
Sep 08 15:39:24.041266 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.041248    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.044006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.043983    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-6f830d-openshift-default-dockercfg-kf7zg\""
Sep 08 15:39:24.055075 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.055051    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"]
Sep 08 15:39:24.160618 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160587    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbqvc\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-kube-api-access-cbqvc\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.160618 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160623    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-data\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.160829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160646    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05a29e-8010-442c-8c26-294f973bfa2c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.160829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160713    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-envoy\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.160829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160760    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-certs\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.160829 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160791    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-podinfo\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.161006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160857    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-socket\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.161006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160892    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-token\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.161006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.160936    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-credential-socket\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261480 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261442    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-credential-socket\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261494    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cbqvc\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-kube-api-access-cbqvc\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261532    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-data\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261551    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05a29e-8010-442c-8c26-294f973bfa2c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261568    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-envoy\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261586    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-certs\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261606    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-podinfo\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261761    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-socket\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.261939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261824    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-token\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.262388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261944    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-credential-socket\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.262388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.261951    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-data\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.262388 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.262282    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05a29e-8010-442c-8c26-294f973bfa2c-istiod-ca-cert\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.262527 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.262396    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-socket\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.262527 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.262397    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-certs\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.264004 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.263982    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-envoy\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.264114 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.264033    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-podinfo\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.276684 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.276644    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbqvc\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-kube-api-access-cbqvc\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.291374 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.291311    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-token\") pod \"e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") " pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.353616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.353585    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:24.637148 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.637114    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"]
Sep 08 15:39:24.639250 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:39:24.639222    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f05a29e_8010_442c_8c26_294f973bfa2c.slice/crio-d952d4cb0aa4885c0d7711ec56739a0e1ce4fb0c3b6e5f11836901448cc2df1c WatchSource:0}: Error finding container d952d4cb0aa4885c0d7711ec56739a0e1ce4fb0c3b6e5f11836901448cc2df1c: Status 404 returned error can't find the container with id d952d4cb0aa4885c0d7711ec56739a0e1ce4fb0c3b6e5f11836901448cc2df1c
Sep 08 15:39:24.641449 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.641413    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:39:24.641520 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.641480    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:39:24.641520 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.641508    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:39:24.871191 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.871160    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" event={"ID":"3f05a29e-8010-442c-8c26-294f973bfa2c","Type":"ContainerStarted","Data":"d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5"}
Sep 08 15:39:24.871374 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.871210    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" event={"ID":"3f05a29e-8010-442c-8c26-294f973bfa2c","Type":"ContainerStarted","Data":"d952d4cb0aa4885c0d7711ec56739a0e1ce4fb0c3b6e5f11836901448cc2df1c"}
Sep 08 15:39:24.905961 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:24.905858    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" podStartSLOduration=0.905839768 podStartE2EDuration="905.839768ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:39:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:39:24.904511904 +0000 UTC m=+1592.005406024" watchObservedRunningTime="2026-09-08 15:39:24.905839768 +0000 UTC m=+1592.006733880"
Sep 08 15:39:25.354243 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:25.354219    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:25.359157 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:25.359132    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:25.876266 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:25.876237    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:25.877276 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:25.877258    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:28.591914 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.591883    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"]
Sep 08 15:39:28.595307 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.595291    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:28.599922 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.599901    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-6f830d\""
Sep 08 15:39:28.600007 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.599944    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-6f830d-dockercfg-t4lw5\""
Sep 08 15:39:28.608193 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.608170    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"]
Sep 08 15:39:28.704747 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.704714    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p8pcb\" (UniqueName: \"kubernetes.io/projected/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-kube-api-access-p8pcb\") pod \"payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9\" (UID: \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:28.704942 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.704837    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9\" (UID: \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:28.805799 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.805766    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9\" (UID: \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:28.806022 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.805873    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p8pcb\" (UniqueName: \"kubernetes.io/projected/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-kube-api-access-p8pcb\") pod \"payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9\" (UID: \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:28.806478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.806459    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9\" (UID: \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:28.814768 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.814742    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p8pcb\" (UniqueName: \"kubernetes.io/projected/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-kube-api-access-p8pcb\") pod \"payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9\" (UID: \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:28.905941 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:28.905854    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:29.176545 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:29.176522    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"]
Sep 08 15:39:29.178928 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:39:29.178897    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6b97ff_d1c5_40e6_a167_4e6668670ac9.slice/crio-97089d7dc1846da8252ed7b744b474e89c9971abe5b925027503709bdfa3456e WatchSource:0}: Error finding container 97089d7dc1846da8252ed7b744b474e89c9971abe5b925027503709bdfa3456e: Status 404 returned error can't find the container with id 97089d7dc1846da8252ed7b744b474e89c9971abe5b925027503709bdfa3456e
Sep 08 15:39:29.897747 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:29.897708    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9" event={"ID":"6e6b97ff-d1c5-40e6-a167-4e6668670ac9","Type":"ContainerStarted","Data":"10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150"}
Sep 08 15:39:29.898174 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:29.897762    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9" event={"ID":"6e6b97ff-d1c5-40e6-a167-4e6668670ac9","Type":"ContainerStarted","Data":"97089d7dc1846da8252ed7b744b474e89c9971abe5b925027503709bdfa3456e"}
Sep 08 15:39:29.898174 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:29.897899    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:29.915968 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:29.915922    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9" podStartSLOduration=1.915907993 podStartE2EDuration="1.915907993s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:39:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:39:29.914417483 +0000 UTC m=+1597.015311595" watchObservedRunningTime="2026-09-08 15:39:29.915907993 +0000 UTC m=+1597.016802131"
Sep 08 15:39:40.905059 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:40.905027    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:47.000817 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:47.000776    2556 generic.go:356] "Generic (PLEG): container finished" podID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerID="d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5" exitCode=0
Sep 08 15:39:47.001248 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:47.000847    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" event={"ID":"3f05a29e-8010-442c-8c26-294f973bfa2c","Type":"ContainerDied","Data":"d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5"}
Sep 08 15:39:47.001248 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:47.001194    2556 scope.go:117] "RemoveContainer" containerID="d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5"
Sep 08 15:39:47.002307 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:47.002278    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:39:47.002374 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:47.002348    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:39:47.002410 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:47.002380    2556 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236208Ki","pods":"250"}
Sep 08 15:39:48.008753 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:48.008721    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" event={"ID":"3f05a29e-8010-442c-8c26-294f973bfa2c","Type":"ContainerStarted","Data":"3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279"}
Sep 08 15:39:48.354485 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:48.354444    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:48.354719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:48.354610    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:39:48.354719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:48.354656    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:39:49.355497 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:49.355459    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:39:49.356084 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:49.356052    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:39:50.354936 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:50.354895    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:39:50.355246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:50.355212    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:39:51.354050 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:51.354006    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:39:51.354507 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:51.354089    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:39:52.354571 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.354527    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:39:52.355097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.354592    2556 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.81:15021/healthz/ready\": dial tcp 10.133.0.81:15021: connect: connection refused"
Sep 08 15:39:52.519448 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.519412    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"]
Sep 08 15:39:52.521700 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.521664    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"
Sep 08 15:39:52.524080 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.524057    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:39:52.524665 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.524647    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:39:52.531627 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.531604    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"]
Sep 08 15:39:52.606048 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.605935    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f895ac-7f20-4b97-a69a-c2a2500c983a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6\" (UID: \"94f895ac-7f20-4b97-a69a-c2a2500c983a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"
Sep 08 15:39:52.707488 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.707452    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f895ac-7f20-4b97-a69a-c2a2500c983a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6\" (UID: \"94f895ac-7f20-4b97-a69a-c2a2500c983a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"
Sep 08 15:39:52.708116 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.708095    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f895ac-7f20-4b97-a69a-c2a2500c983a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6\" (UID: \"94f895ac-7f20-4b97-a69a-c2a2500c983a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"
Sep 08 15:39:52.833298 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:52.833262    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"
Sep 08 15:39:53.126498 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:53.126470    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"]
Sep 08 15:39:53.129427 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:39:53.129398    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94f895ac_7f20_4b97_a69a_c2a2500c983a.slice/crio-1916f08c0bf1516fca7372d26f1a57bc6e4a297ee98c5b1159bb682817500849 WatchSource:0}: Error finding container 1916f08c0bf1516fca7372d26f1a57bc6e4a297ee98c5b1159bb682817500849: Status 404 returned error can't find the container with id 1916f08c0bf1516fca7372d26f1a57bc6e4a297ee98c5b1159bb682817500849
Sep 08 15:39:53.358228 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:53.358203    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:53.358549 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:53.358460    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:53.359132 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:53.359114    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:39:53.661583 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:53.661550    2556 scope.go:117] "RemoveContainer" containerID="1ae56c933f237728922000220b4f80e0e55ea27afbaf7d4912ec8a615d0662a1"
Sep 08 15:39:53.669846 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:53.669815    2556 scope.go:117] "RemoveContainer" containerID="9597a67fa262afe80e5da00b2d19fa93f1c7decb9c8e00a4b55b2d18e7171e80"
Sep 08 15:39:54.039932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:54.039899    2556 generic.go:356] "Generic (PLEG): container finished" podID="94f895ac-7f20-4b97-a69a-c2a2500c983a" containerID="902ffff2ee8b65a141c36445966f9e83504c48b02cbb4bfbb36eea9b36ab81a4" exitCode=0
Sep 08 15:39:54.040095 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:54.040000    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6" event={"ID":"94f895ac-7f20-4b97-a69a-c2a2500c983a","Type":"ContainerDied","Data":"902ffff2ee8b65a141c36445966f9e83504c48b02cbb4bfbb36eea9b36ab81a4"}
Sep 08 15:39:54.040153 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:54.040101    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6" event={"ID":"94f895ac-7f20-4b97-a69a-c2a2500c983a","Type":"ContainerStarted","Data":"1916f08c0bf1516fca7372d26f1a57bc6e4a297ee98c5b1159bb682817500849"}
Sep 08 15:39:55.185488 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:55.185467    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"
Sep 08 15:39:55.227911 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:55.227879    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f895ac-7f20-4b97-a69a-c2a2500c983a-maas-api-service-ca\") pod \"94f895ac-7f20-4b97-a69a-c2a2500c983a\" (UID: \"94f895ac-7f20-4b97-a69a-c2a2500c983a\") "
Sep 08 15:39:55.228223 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:55.228200    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94f895ac-7f20-4b97-a69a-c2a2500c983a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "94f895ac-7f20-4b97-a69a-c2a2500c983a" (UID: "94f895ac-7f20-4b97-a69a-c2a2500c983a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:39:55.328807 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:55.328782    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/94f895ac-7f20-4b97-a69a-c2a2500c983a-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:39:56.053169 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:56.053142    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"
Sep 08 15:39:56.053325 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:56.053133    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6" event={"ID":"94f895ac-7f20-4b97-a69a-c2a2500c983a","Type":"ContainerDied","Data":"1916f08c0bf1516fca7372d26f1a57bc6e4a297ee98c5b1159bb682817500849"}
Sep 08 15:39:56.053325 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:56.053267    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1916f08c0bf1516fca7372d26f1a57bc6e4a297ee98c5b1159bb682817500849"
Sep 08 15:39:58.712190 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:58.712160    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"]
Sep 08 15:39:58.712610 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:58.712350    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9" podUID="6e6b97ff-d1c5-40e6-a167-4e6668670ac9" containerName="payload-pre-processing" containerID="cri-o://10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150" gracePeriod=30
Sep 08 15:39:58.892565 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:58.892533    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"]
Sep 08 15:39:58.900354 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:58.900330    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-6f830d-hg6g6"]
Sep 08 15:39:58.968022 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:58.967971    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:59.063695 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.063008    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-plugins-config-volume\") pod \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\" (UID: \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\") "
Sep 08 15:39:59.063695 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.063064    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p8pcb\" (UniqueName: \"kubernetes.io/projected/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-kube-api-access-p8pcb\") pod \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\" (UID: \"6e6b97ff-d1c5-40e6-a167-4e6668670ac9\") "
Sep 08 15:39:59.065724 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.064124    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6e6b97ff-d1c5-40e6-a167-4e6668670ac9" (UID: "6e6b97ff-d1c5-40e6-a167-4e6668670ac9"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:39:59.067000 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.066967    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-kube-api-access-p8pcb" (OuterVolumeSpecName: "kube-api-access-p8pcb") pod "6e6b97ff-d1c5-40e6-a167-4e6668670ac9" (UID: "6e6b97ff-d1c5-40e6-a167-4e6668670ac9"). InnerVolumeSpecName "kube-api-access-p8pcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:39:59.073260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.073157    2556 generic.go:356] "Generic (PLEG): container finished" podID="6e6b97ff-d1c5-40e6-a167-4e6668670ac9" containerID="10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150" exitCode=0
Sep 08 15:39:59.073260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.073219    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"
Sep 08 15:39:59.073260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.073241    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9" event={"ID":"6e6b97ff-d1c5-40e6-a167-4e6668670ac9","Type":"ContainerDied","Data":"10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150"}
Sep 08 15:39:59.073492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.073338    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9" event={"ID":"6e6b97ff-d1c5-40e6-a167-4e6668670ac9","Type":"ContainerDied","Data":"97089d7dc1846da8252ed7b744b474e89c9971abe5b925027503709bdfa3456e"}
Sep 08 15:39:59.073492 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.073374    2556 scope.go:117] "RemoveContainer" containerID="10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150"
Sep 08 15:39:59.082309 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.082293    2556 scope.go:117] "RemoveContainer" containerID="10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150"
Sep 08 15:39:59.082586 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:39:59.082566    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150\": container with ID starting with 10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150 not found: ID does not exist" containerID="10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150"
Sep 08 15:39:59.082644 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.082595    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150"} err="failed to get container status \"10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150\": rpc error: code = NotFound desc = could not find container \"10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150\": container with ID starting with 10b66448859cc211471f1a490806f3de88dd8d1a57ee26707e4084d381716150 not found: ID does not exist"
Sep 08 15:39:59.094922 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.094900    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"]
Sep 08 15:39:59.101496 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.101474    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-6f830d-6446c64c6b-bl5w9"]
Sep 08 15:39:59.164117 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.164095    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:39:59.164117 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.164114    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p8pcb\" (UniqueName: \"kubernetes.io/projected/6e6b97ff-d1c5-40e6-a167-4e6668670ac9-kube-api-access-p8pcb\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:39:59.354877 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.354851    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6e6b97ff-d1c5-40e6-a167-4e6668670ac9" path="/var/lib/kubelet/pods/6e6b97ff-d1c5-40e6-a167-4e6668670ac9/volumes"
Sep 08 15:39:59.355192 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:39:59.355179    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94f895ac-7f20-4b97-a69a-c2a2500c983a" path="/var/lib/kubelet/pods/94f895ac-7f20-4b97-a69a-c2a2500c983a/volumes"
Sep 08 15:40:05.323641 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:05.323607    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"]
Sep 08 15:40:05.324098 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:05.323875    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy" containerID="cri-o://3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279" gracePeriod=30
Sep 08 15:40:08.360547 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:08.360510    2556 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:40:08.360928 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:08.360574    2556 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:40:09.014640 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.014607    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"]
Sep 08 15:40:09.014983 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.014970    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6e6b97ff-d1c5-40e6-a167-4e6668670ac9" containerName="payload-pre-processing"
Sep 08 15:40:09.015034 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.014985    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6e6b97ff-d1c5-40e6-a167-4e6668670ac9" containerName="payload-pre-processing"
Sep 08 15:40:09.015034 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.014997    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94f895ac-7f20-4b97-a69a-c2a2500c983a" containerName="revoke-keys"
Sep 08 15:40:09.015034 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.015003    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="94f895ac-7f20-4b97-a69a-c2a2500c983a" containerName="revoke-keys"
Sep 08 15:40:09.015141 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.015092    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="94f895ac-7f20-4b97-a69a-c2a2500c983a" containerName="revoke-keys"
Sep 08 15:40:09.015141 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.015100    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6e6b97ff-d1c5-40e6-a167-4e6668670ac9" containerName="payload-pre-processing"
Sep 08 15:40:09.019321 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.019306    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"
Sep 08 15:40:09.022632 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.022602    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:40:09.022777 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.022606    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:40:09.024300 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.024276    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"]
Sep 08 15:40:09.147533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.147503    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607c5665-43c4-4295-8b18-600b1bb3ede0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h\" (UID: \"607c5665-43c4-4295-8b18-600b1bb3ede0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"
Sep 08 15:40:09.248800 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.248765    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607c5665-43c4-4295-8b18-600b1bb3ede0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h\" (UID: \"607c5665-43c4-4295-8b18-600b1bb3ede0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"
Sep 08 15:40:09.249345 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.249323    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607c5665-43c4-4295-8b18-600b1bb3ede0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h\" (UID: \"607c5665-43c4-4295-8b18-600b1bb3ede0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"
Sep 08 15:40:09.330833 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.330812    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"
Sep 08 15:40:09.602152 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:09.601953    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"]
Sep 08 15:40:09.604889 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:40:09.604856    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod607c5665_43c4_4295_8b18_600b1bb3ede0.slice/crio-9a6f787a809ea40c74f3de66d74f2539f9cfc88ab7f8310c20039745baa44adb WatchSource:0}: Error finding container 9a6f787a809ea40c74f3de66d74f2539f9cfc88ab7f8310c20039745baa44adb: Status 404 returned error can't find the container with id 9a6f787a809ea40c74f3de66d74f2539f9cfc88ab7f8310c20039745baa44adb
Sep 08 15:40:10.133116 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.133023    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h" event={"ID":"607c5665-43c4-4295-8b18-600b1bb3ede0","Type":"ContainerStarted","Data":"e0f6e2bab0f4e9596d42de106668705ba638e242066bb2778c677c08a96db2eb"}
Sep 08 15:40:10.133116 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.133068    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h" event={"ID":"607c5665-43c4-4295-8b18-600b1bb3ede0","Type":"ContainerStarted","Data":"9a6f787a809ea40c74f3de66d74f2539f9cfc88ab7f8310c20039745baa44adb"}
Sep 08 15:40:10.148288 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.148235    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h" podStartSLOduration=2.148219581 podStartE2EDuration="2.148219581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:10.147015858 +0000 UTC m=+1637.247909969" watchObservedRunningTime="2026-09-08 15:40:10.148219581 +0000 UTC m=+1637.249113752"
Sep 08 15:40:10.580051 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.580029    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:40:10.661697 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661600    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-data\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.661697 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661644    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-envoy\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.661697 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661696    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-socket\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.662207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661737    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-token\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.662207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661753    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-credential-socket\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.662207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661797    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-certs\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.662207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661828    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-podinfo\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.662207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661865    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05a29e-8010-442c-8c26-294f973bfa2c-istiod-ca-cert\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.662207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661907    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbqvc\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-kube-api-access-cbqvc\") pod \"3f05a29e-8010-442c-8c26-294f973bfa2c\" (UID: \"3f05a29e-8010-442c-8c26-294f973bfa2c\") "
Sep 08 15:40:10.662207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.661922    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-data" (OuterVolumeSpecName: "istio-data") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:40:10.662207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.662067    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:40:10.662599 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.662555    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:40:10.662719 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.662664    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f05a29e-8010-442c-8c26-294f973bfa2c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:10.664480 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.662972    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:40:10.664480 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.663159    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:10.664480 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.663179    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3f05a29e-8010-442c-8c26-294f973bfa2c-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:10.664480 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.663200    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:10.664480 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.663213    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:10.672352 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.672325    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:40:10.672530 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.672489    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-kube-api-access-cbqvc" (OuterVolumeSpecName: "kube-api-access-cbqvc") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "kube-api-access-cbqvc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:10.673252 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.673221    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-token" (OuterVolumeSpecName: "istio-token") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:10.673564 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.673542    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3f05a29e-8010-442c-8c26-294f973bfa2c" (UID: "3f05a29e-8010-442c-8c26-294f973bfa2c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:40:10.763943 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.763912    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbqvc\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-kube-api-access-cbqvc\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:10.763943 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.763940    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:10.764097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.763950    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:10.764097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.763958    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3f05a29e-8010-442c-8c26-294f973bfa2c-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:10.764097 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:10.763967    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3f05a29e-8010-442c-8c26-294f973bfa2c-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:11.139384 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.139354    2556 generic.go:356] "Generic (PLEG): container finished" podID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerID="3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279" exitCode=0
Sep 08 15:40:11.139592 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.139427    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" event={"ID":"3f05a29e-8010-442c-8c26-294f973bfa2c","Type":"ContainerDied","Data":"3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279"}
Sep 08 15:40:11.139592 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.139523    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"
Sep 08 15:40:11.139592 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.139535    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6" event={"ID":"3f05a29e-8010-442c-8c26-294f973bfa2c","Type":"ContainerDied","Data":"d952d4cb0aa4885c0d7711ec56739a0e1ce4fb0c3b6e5f11836901448cc2df1c"}
Sep 08 15:40:11.139592 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.139568    2556 scope.go:117] "RemoveContainer" containerID="3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279"
Sep 08 15:40:11.141378 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.141355    2556 generic.go:356] "Generic (PLEG): container finished" podID="607c5665-43c4-4295-8b18-600b1bb3ede0" containerID="e0f6e2bab0f4e9596d42de106668705ba638e242066bb2778c677c08a96db2eb" exitCode=0
Sep 08 15:40:11.141487 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.141400    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h" event={"ID":"607c5665-43c4-4295-8b18-600b1bb3ede0","Type":"ContainerDied","Data":"e0f6e2bab0f4e9596d42de106668705ba638e242066bb2778c677c08a96db2eb"}
Sep 08 15:40:11.151818 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.150872    2556 scope.go:117] "RemoveContainer" containerID="d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5"
Sep 08 15:40:11.160435 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.160412    2556 scope.go:117] "RemoveContainer" containerID="3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279"
Sep 08 15:40:11.160777 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:40:11.160753    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279\": container with ID starting with 3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279 not found: ID does not exist" containerID="3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279"
Sep 08 15:40:11.160839 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.160790    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279"} err="failed to get container status \"3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279\": rpc error: code = NotFound desc = could not find container \"3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279\": container with ID starting with 3e8ed2fcffa214767d412838c19aaf3769229dc93a7f56f38c6552e6b1044279 not found: ID does not exist"
Sep 08 15:40:11.160839 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.160815    2556 scope.go:117] "RemoveContainer" containerID="d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5"
Sep 08 15:40:11.161100 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:40:11.161071    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5\": container with ID starting with d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5 not found: ID does not exist" containerID="d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5"
Sep 08 15:40:11.161154 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.161098    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5"} err="failed to get container status \"d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5\": rpc error: code = NotFound desc = could not find container \"d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5\": container with ID starting with d1c92471e6dcd48fbc0d0e914f3906b8ce2ce9f1ded6aba5cb1b94012a2f92b5 not found: ID does not exist"
Sep 08 15:40:11.175171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.175143    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"]
Sep 08 15:40:11.182516 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.182496    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-6f830d-openshift-default-66df667b74-vswc6"]
Sep 08 15:40:11.354751 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:11.354721    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" path="/var/lib/kubelet/pods/3f05a29e-8010-442c-8c26-294f973bfa2c/volumes"
Sep 08 15:40:12.281110 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:12.281087    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"
Sep 08 15:40:12.376630 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:12.376606    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607c5665-43c4-4295-8b18-600b1bb3ede0-maas-api-service-ca\") pod \"607c5665-43c4-4295-8b18-600b1bb3ede0\" (UID: \"607c5665-43c4-4295-8b18-600b1bb3ede0\") "
Sep 08 15:40:12.376932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:12.376911    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/607c5665-43c4-4295-8b18-600b1bb3ede0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "607c5665-43c4-4295-8b18-600b1bb3ede0" (UID: "607c5665-43c4-4295-8b18-600b1bb3ede0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:12.477300 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:12.477227    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/607c5665-43c4-4295-8b18-600b1bb3ede0-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:13.154983 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:13.154947    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h" event={"ID":"607c5665-43c4-4295-8b18-600b1bb3ede0","Type":"ContainerDied","Data":"9a6f787a809ea40c74f3de66d74f2539f9cfc88ab7f8310c20039745baa44adb"}
Sep 08 15:40:13.155164 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:13.155001    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9a6f787a809ea40c74f3de66d74f2539f9cfc88ab7f8310c20039745baa44adb"
Sep 08 15:40:13.155164 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:13.154963    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"
Sep 08 15:40:24.686122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:24.686089    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"]
Sep 08 15:40:24.686621 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:24.686385    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6" podUID="a1f19d59-00db-4e09-bbb6-8d664c3bee70" containerName="payload-processing" containerID="cri-o://c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9" gracePeriod=30
Sep 08 15:40:24.692226 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:24.692198    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"]
Sep 08 15:40:24.692639 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:24.692578    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9" podUID="935c7d9c-3a45-4973-9a6e-919d41d349ca" containerName="payload-pre-processing" containerID="cri-o://3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175" gracePeriod=30
Sep 08 15:40:24.861030 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:24.860976    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"]
Sep 08 15:40:24.862661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:24.862633    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-014f36-5dq5h"]
Sep 08 15:40:24.973708 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:24.973685    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:40:24.976389 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:24.976373    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:40:25.084783 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.084748    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ktxqg\" (UniqueName: \"kubernetes.io/projected/935c7d9c-3a45-4973-9a6e-919d41d349ca-kube-api-access-ktxqg\") pod \"935c7d9c-3a45-4973-9a6e-919d41d349ca\" (UID: \"935c7d9c-3a45-4973-9a6e-919d41d349ca\") "
Sep 08 15:40:25.084980 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.084799    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935c7d9c-3a45-4973-9a6e-919d41d349ca-plugins-config-volume\") pod \"935c7d9c-3a45-4973-9a6e-919d41d349ca\" (UID: \"935c7d9c-3a45-4973-9a6e-919d41d349ca\") "
Sep 08 15:40:25.084980 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.084819    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ttkvk\" (UniqueName: \"kubernetes.io/projected/a1f19d59-00db-4e09-bbb6-8d664c3bee70-kube-api-access-ttkvk\") pod \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\" (UID: \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\") "
Sep 08 15:40:25.084980 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.084857    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1f19d59-00db-4e09-bbb6-8d664c3bee70-plugins-config-volume\") pod \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\" (UID: \"a1f19d59-00db-4e09-bbb6-8d664c3bee70\") "
Sep 08 15:40:25.085227 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.085196    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/935c7d9c-3a45-4973-9a6e-919d41d349ca-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "935c7d9c-3a45-4973-9a6e-919d41d349ca" (UID: "935c7d9c-3a45-4973-9a6e-919d41d349ca"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:25.085308 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.085288    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1f19d59-00db-4e09-bbb6-8d664c3bee70-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a1f19d59-00db-4e09-bbb6-8d664c3bee70" (UID: "a1f19d59-00db-4e09-bbb6-8d664c3bee70"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:40:25.086913 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.086887    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1f19d59-00db-4e09-bbb6-8d664c3bee70-kube-api-access-ttkvk" (OuterVolumeSpecName: "kube-api-access-ttkvk") pod "a1f19d59-00db-4e09-bbb6-8d664c3bee70" (UID: "a1f19d59-00db-4e09-bbb6-8d664c3bee70"). InnerVolumeSpecName "kube-api-access-ttkvk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:25.086994 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.086910    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/935c7d9c-3a45-4973-9a6e-919d41d349ca-kube-api-access-ktxqg" (OuterVolumeSpecName: "kube-api-access-ktxqg") pod "935c7d9c-3a45-4973-9a6e-919d41d349ca" (UID: "935c7d9c-3a45-4973-9a6e-919d41d349ca"). InnerVolumeSpecName "kube-api-access-ktxqg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:25.185948 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.185907    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ktxqg\" (UniqueName: \"kubernetes.io/projected/935c7d9c-3a45-4973-9a6e-919d41d349ca-kube-api-access-ktxqg\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:25.185948 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.185941    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/935c7d9c-3a45-4973-9a6e-919d41d349ca-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:25.185948 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.185950    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ttkvk\" (UniqueName: \"kubernetes.io/projected/a1f19d59-00db-4e09-bbb6-8d664c3bee70-kube-api-access-ttkvk\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:25.186188 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.185959    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1f19d59-00db-4e09-bbb6-8d664c3bee70-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:40:25.215012 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.214925    2556 generic.go:356] "Generic (PLEG): container finished" podID="935c7d9c-3a45-4973-9a6e-919d41d349ca" containerID="3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175" exitCode=0
Sep 08 15:40:25.215012 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.214976    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"
Sep 08 15:40:25.215239 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.215009    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9" event={"ID":"935c7d9c-3a45-4973-9a6e-919d41d349ca","Type":"ContainerDied","Data":"3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175"}
Sep 08 15:40:25.215239 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.215078    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9" event={"ID":"935c7d9c-3a45-4973-9a6e-919d41d349ca","Type":"ContainerDied","Data":"28c37b2a4ce77ed52eb558a7ad31ff88e9cb6e4a085c4e4bd99e7df1d6675db1"}
Sep 08 15:40:25.215239 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.215103    2556 scope.go:117] "RemoveContainer" containerID="3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175"
Sep 08 15:40:25.216466 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.216444    2556 generic.go:356] "Generic (PLEG): container finished" podID="a1f19d59-00db-4e09-bbb6-8d664c3bee70" containerID="c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9" exitCode=0
Sep 08 15:40:25.216616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.216484    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"
Sep 08 15:40:25.216616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.216497    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6" event={"ID":"a1f19d59-00db-4e09-bbb6-8d664c3bee70","Type":"ContainerDied","Data":"c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9"}
Sep 08 15:40:25.216616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.216551    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6" event={"ID":"a1f19d59-00db-4e09-bbb6-8d664c3bee70","Type":"ContainerDied","Data":"7c97262ddeaed3d7b2e215ff052779bd2fc911291abd100d60a843eadf4f493a"}
Sep 08 15:40:25.224121 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.224098    2556 scope.go:117] "RemoveContainer" containerID="3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175"
Sep 08 15:40:25.224401 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:40:25.224380    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175\": container with ID starting with 3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175 not found: ID does not exist" containerID="3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175"
Sep 08 15:40:25.224478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.224409    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175"} err="failed to get container status \"3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175\": rpc error: code = NotFound desc = could not find container \"3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175\": container with ID starting with 3bd1b99ae543912d9441d58126da98ddabcd9a3b93168af5a453f9b43f818175 not found: ID does not exist"
Sep 08 15:40:25.224478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.224426    2556 scope.go:117] "RemoveContainer" containerID="c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9"
Sep 08 15:40:25.232241 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.232225    2556 scope.go:117] "RemoveContainer" containerID="c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9"
Sep 08 15:40:25.232520 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:40:25.232502    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9\": container with ID starting with c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9 not found: ID does not exist" containerID="c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9"
Sep 08 15:40:25.232585 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.232527    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9"} err="failed to get container status \"c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9\": rpc error: code = NotFound desc = could not find container \"c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9\": container with ID starting with c624af3a9fbf1361d08127f5fdd79c37e2a7e86caa8e18dbd00481ebc9c870a9 not found: ID does not exist"
Sep 08 15:40:25.239814 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.239779    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"]
Sep 08 15:40:25.245389 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.245365    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-014f36-86c65c6d5-v9mn6"]
Sep 08 15:40:25.257909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.257871    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"]
Sep 08 15:40:25.260333 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.260311    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-014f36-54bfc4666-xs9x9"]
Sep 08 15:40:25.355005 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.354970    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="607c5665-43c4-4295-8b18-600b1bb3ede0" path="/var/lib/kubelet/pods/607c5665-43c4-4295-8b18-600b1bb3ede0/volumes"
Sep 08 15:40:25.355376 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.355362    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="935c7d9c-3a45-4973-9a6e-919d41d349ca" path="/var/lib/kubelet/pods/935c7d9c-3a45-4973-9a6e-919d41d349ca/volumes"
Sep 08 15:40:25.355702 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:40:25.355679    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1f19d59-00db-4e09-bbb6-8d664c3bee70" path="/var/lib/kubelet/pods/a1f19d59-00db-4e09-bbb6-8d664c3bee70/volumes"
Sep 08 15:41:13.611980 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.611940    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"]
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612262    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612273    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612281    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="607c5665-43c4-4295-8b18-600b1bb3ede0" containerName="revoke-keys"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612288    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="607c5665-43c4-4295-8b18-600b1bb3ede0" containerName="revoke-keys"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612311    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1f19d59-00db-4e09-bbb6-8d664c3bee70" containerName="payload-processing"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612318    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1f19d59-00db-4e09-bbb6-8d664c3bee70" containerName="payload-processing"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612332    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="935c7d9c-3a45-4973-9a6e-919d41d349ca" containerName="payload-pre-processing"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612337    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="935c7d9c-3a45-4973-9a6e-919d41d349ca" containerName="payload-pre-processing"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612388    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612395    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1f19d59-00db-4e09-bbb6-8d664c3bee70" containerName="payload-processing"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612401    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="607c5665-43c4-4295-8b18-600b1bb3ede0" containerName="revoke-keys"
Sep 08 15:41:13.612453 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.612410    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="935c7d9c-3a45-4973-9a6e-919d41d349ca" containerName="payload-pre-processing"
Sep 08 15:41:13.615367 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.615347    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"
Sep 08 15:41:13.617709 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.617690    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:41:13.617790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.617690    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:41:13.623900 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.623873    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"]
Sep 08 15:41:13.677280 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.677246    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1230f644-94e1-4d56-a932-18e52eae5802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq\" (UID: \"1230f644-94e1-4d56-a932-18e52eae5802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"
Sep 08 15:41:13.778013 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.777985    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1230f644-94e1-4d56-a932-18e52eae5802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq\" (UID: \"1230f644-94e1-4d56-a932-18e52eae5802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"
Sep 08 15:41:13.778553 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.778534    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1230f644-94e1-4d56-a932-18e52eae5802-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq\" (UID: \"1230f644-94e1-4d56-a932-18e52eae5802\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"
Sep 08 15:41:13.927054 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:13.926954    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"
Sep 08 15:41:14.198205 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:14.198134    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"]
Sep 08 15:41:14.201107 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:41:14.201080    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1230f644_94e1_4d56_a932_18e52eae5802.slice/crio-3534f2a59301a203400e10edd79d61525642dd1a02089f9a041d6a50fd999881 WatchSource:0}: Error finding container 3534f2a59301a203400e10edd79d61525642dd1a02089f9a041d6a50fd999881: Status 404 returned error can't find the container with id 3534f2a59301a203400e10edd79d61525642dd1a02089f9a041d6a50fd999881
Sep 08 15:41:14.460029 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:14.459998    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq" event={"ID":"1230f644-94e1-4d56-a932-18e52eae5802","Type":"ContainerStarted","Data":"3534f2a59301a203400e10edd79d61525642dd1a02089f9a041d6a50fd999881"}
Sep 08 15:41:15.466606 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:15.466572    2556 generic.go:356] "Generic (PLEG): container finished" podID="1230f644-94e1-4d56-a932-18e52eae5802" containerID="eb5200d7472e7c86b189cab31304fde426efa4d27d64185feff9e1052d2929d0" exitCode=0
Sep 08 15:41:15.467056 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:15.466652    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq" event={"ID":"1230f644-94e1-4d56-a932-18e52eae5802","Type":"ContainerDied","Data":"eb5200d7472e7c86b189cab31304fde426efa4d27d64185feff9e1052d2929d0"}
Sep 08 15:41:16.606552 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:16.606528    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"
Sep 08 15:41:16.699576 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:16.699541    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1230f644-94e1-4d56-a932-18e52eae5802-maas-api-service-ca\") pod \"1230f644-94e1-4d56-a932-18e52eae5802\" (UID: \"1230f644-94e1-4d56-a932-18e52eae5802\") "
Sep 08 15:41:16.700020 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:16.699988    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1230f644-94e1-4d56-a932-18e52eae5802-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "1230f644-94e1-4d56-a932-18e52eae5802" (UID: "1230f644-94e1-4d56-a932-18e52eae5802"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:16.800326 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:16.800246    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/1230f644-94e1-4d56-a932-18e52eae5802-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:17.476774 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:17.476734    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq" event={"ID":"1230f644-94e1-4d56-a932-18e52eae5802","Type":"ContainerDied","Data":"3534f2a59301a203400e10edd79d61525642dd1a02089f9a041d6a50fd999881"}
Sep 08 15:41:17.476774 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:17.476755    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"
Sep 08 15:41:17.476966 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:17.476782    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3534f2a59301a203400e10edd79d61525642dd1a02089f9a041d6a50fd999881"
Sep 08 15:41:24.091784 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.091749    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"]
Sep 08 15:41:24.092334 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.092035    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br" podUID="7967a5c7-0618-45d5-b6dc-58745a79bdb2" containerName="payload-pre-processing" containerID="cri-o://be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338" gracePeriod=30
Sep 08 15:41:24.249071 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.249026    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"]
Sep 08 15:41:24.251690 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.251651    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-30cc8d-vvwsq"]
Sep 08 15:41:24.358797 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.358728    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:41:24.457940 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.457907    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xw6f2\" (UniqueName: \"kubernetes.io/projected/7967a5c7-0618-45d5-b6dc-58745a79bdb2-kube-api-access-xw6f2\") pod \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\" (UID: \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\") "
Sep 08 15:41:24.458100 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.458033    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7967a5c7-0618-45d5-b6dc-58745a79bdb2-plugins-config-volume\") pod \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\" (UID: \"7967a5c7-0618-45d5-b6dc-58745a79bdb2\") "
Sep 08 15:41:24.458403 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.458368    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7967a5c7-0618-45d5-b6dc-58745a79bdb2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7967a5c7-0618-45d5-b6dc-58745a79bdb2" (UID: "7967a5c7-0618-45d5-b6dc-58745a79bdb2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:24.460036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.460008    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7967a5c7-0618-45d5-b6dc-58745a79bdb2-kube-api-access-xw6f2" (OuterVolumeSpecName: "kube-api-access-xw6f2") pod "7967a5c7-0618-45d5-b6dc-58745a79bdb2" (UID: "7967a5c7-0618-45d5-b6dc-58745a79bdb2"). InnerVolumeSpecName "kube-api-access-xw6f2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:24.510876 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.510846    2556 generic.go:356] "Generic (PLEG): container finished" podID="7967a5c7-0618-45d5-b6dc-58745a79bdb2" containerID="be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338" exitCode=0
Sep 08 15:41:24.511040 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.510896    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"
Sep 08 15:41:24.511040 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.510936    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br" event={"ID":"7967a5c7-0618-45d5-b6dc-58745a79bdb2","Type":"ContainerDied","Data":"be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338"}
Sep 08 15:41:24.511040 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.510990    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br" event={"ID":"7967a5c7-0618-45d5-b6dc-58745a79bdb2","Type":"ContainerDied","Data":"baa27580c94de80ec7857c0715ae54079e58727c498914658ae2498fdfad4c4a"}
Sep 08 15:41:24.511040 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.511011    2556 scope.go:117] "RemoveContainer" containerID="be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338"
Sep 08 15:41:24.522390 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.522362    2556 scope.go:117] "RemoveContainer" containerID="be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338"
Sep 08 15:41:24.522850 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:41:24.522826    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338\": container with ID starting with be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338 not found: ID does not exist" containerID="be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338"
Sep 08 15:41:24.522938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.522860    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338"} err="failed to get container status \"be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338\": rpc error: code = NotFound desc = could not find container \"be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338\": container with ID starting with be160c9dbaadb67ce2501b07c10d22dab5a001f1ab0b0ff002fe9f13157d2338 not found: ID does not exist"
Sep 08 15:41:24.532728 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.532698    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"]
Sep 08 15:41:24.537036 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.537016    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-30cc8d-5dccb54486-p45br"]
Sep 08 15:41:24.558807 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.558786    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7967a5c7-0618-45d5-b6dc-58745a79bdb2-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:24.558807 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:24.558807    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xw6f2\" (UniqueName: \"kubernetes.io/projected/7967a5c7-0618-45d5-b6dc-58745a79bdb2-kube-api-access-xw6f2\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:25.354238 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:25.354204    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1230f644-94e1-4d56-a932-18e52eae5802" path="/var/lib/kubelet/pods/1230f644-94e1-4d56-a932-18e52eae5802/volumes"
Sep 08 15:41:25.354594 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:25.354543    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7967a5c7-0618-45d5-b6dc-58745a79bdb2" path="/var/lib/kubelet/pods/7967a5c7-0618-45d5-b6dc-58745a79bdb2/volumes"
Sep 08 15:41:31.547802 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.547769    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"]
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548082    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7967a5c7-0618-45d5-b6dc-58745a79bdb2" containerName="payload-pre-processing"
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548093    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="7967a5c7-0618-45d5-b6dc-58745a79bdb2" containerName="payload-pre-processing"
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548108    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1230f644-94e1-4d56-a932-18e52eae5802" containerName="revoke-keys"
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548113    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1230f644-94e1-4d56-a932-18e52eae5802" containerName="revoke-keys"
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548127    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy"
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548132    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy"
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548186    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1230f644-94e1-4d56-a932-18e52eae5802" containerName="revoke-keys"
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548195    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f05a29e-8010-442c-8c26-294f973bfa2c" containerName="istio-proxy"
Sep 08 15:41:31.548207 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.548202    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="7967a5c7-0618-45d5-b6dc-58745a79bdb2" containerName="payload-pre-processing"
Sep 08 15:41:31.550953 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.550937    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"
Sep 08 15:41:31.553685 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.553654    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:41:31.553808 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.553715    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:41:31.564503 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.564478    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"]
Sep 08 15:41:31.614957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.614925    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3871e34a-f91a-42ee-aaa3-3a283fead33a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp\" (UID: \"3871e34a-f91a-42ee-aaa3-3a283fead33a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"
Sep 08 15:41:31.715955 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.715918    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3871e34a-f91a-42ee-aaa3-3a283fead33a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp\" (UID: \"3871e34a-f91a-42ee-aaa3-3a283fead33a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"
Sep 08 15:41:31.716559 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.716537    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3871e34a-f91a-42ee-aaa3-3a283fead33a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp\" (UID: \"3871e34a-f91a-42ee-aaa3-3a283fead33a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"
Sep 08 15:41:31.860697 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:31.860644    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"
Sep 08 15:41:32.128265 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:32.128240    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"]
Sep 08 15:41:32.130699 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:41:32.130656    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3871e34a_f91a_42ee_aaa3_3a283fead33a.slice/crio-5988a91f37c55063b75817c48f0a09e54b194d12db0074371e07a29443194ea2 WatchSource:0}: Error finding container 5988a91f37c55063b75817c48f0a09e54b194d12db0074371e07a29443194ea2: Status 404 returned error can't find the container with id 5988a91f37c55063b75817c48f0a09e54b194d12db0074371e07a29443194ea2
Sep 08 15:41:32.554007 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:32.553972    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp" event={"ID":"3871e34a-f91a-42ee-aaa3-3a283fead33a","Type":"ContainerStarted","Data":"14760569c19b051877d6318ea0ca9b9a781ec6daef4f443afba756a41a0093b0"}
Sep 08 15:41:32.554394 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:32.554024    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp" event={"ID":"3871e34a-f91a-42ee-aaa3-3a283fead33a","Type":"ContainerStarted","Data":"5988a91f37c55063b75817c48f0a09e54b194d12db0074371e07a29443194ea2"}
Sep 08 15:41:32.574272 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:32.574229    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp" podStartSLOduration=1.574212212 podStartE2EDuration="1.574212212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:41:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:41:32.572665638 +0000 UTC m=+1719.673559774" watchObservedRunningTime="2026-09-08 15:41:32.574212212 +0000 UTC m=+1719.675106344"
Sep 08 15:41:33.560263 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:33.560231    2556 generic.go:356] "Generic (PLEG): container finished" podID="3871e34a-f91a-42ee-aaa3-3a283fead33a" containerID="14760569c19b051877d6318ea0ca9b9a781ec6daef4f443afba756a41a0093b0" exitCode=0
Sep 08 15:41:33.560626 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:33.560296    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp" event={"ID":"3871e34a-f91a-42ee-aaa3-3a283fead33a","Type":"ContainerDied","Data":"14760569c19b051877d6318ea0ca9b9a781ec6daef4f443afba756a41a0093b0"}
Sep 08 15:41:34.699958 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:34.699933    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"
Sep 08 15:41:34.842327 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:34.842295    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3871e34a-f91a-42ee-aaa3-3a283fead33a-maas-api-service-ca\") pod \"3871e34a-f91a-42ee-aaa3-3a283fead33a\" (UID: \"3871e34a-f91a-42ee-aaa3-3a283fead33a\") "
Sep 08 15:41:34.842638 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:34.842613    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3871e34a-f91a-42ee-aaa3-3a283fead33a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3871e34a-f91a-42ee-aaa3-3a283fead33a" (UID: "3871e34a-f91a-42ee-aaa3-3a283fead33a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:34.943372 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:34.943333    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3871e34a-f91a-42ee-aaa3-3a283fead33a-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:35.572263 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:35.572233    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"
Sep 08 15:41:35.572426 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:35.572266    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp" event={"ID":"3871e34a-f91a-42ee-aaa3-3a283fead33a","Type":"ContainerDied","Data":"5988a91f37c55063b75817c48f0a09e54b194d12db0074371e07a29443194ea2"}
Sep 08 15:41:35.572426 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:35.572306    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5988a91f37c55063b75817c48f0a09e54b194d12db0074371e07a29443194ea2"
Sep 08 15:41:42.144376 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.144343    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"]
Sep 08 15:41:42.144934 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.144585    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw" podUID="4b576759-2af2-4d87-bffa-72b5e98e5e55" containerName="payload-processing" containerID="cri-o://65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd" gracePeriod=30
Sep 08 15:41:42.311957 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.311923    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"]
Sep 08 15:41:42.316909 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.316886    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-fc867c-7sbqp"]
Sep 08 15:41:42.397024 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.396939    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:41:42.509589 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.509557    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7ddv\" (UniqueName: \"kubernetes.io/projected/4b576759-2af2-4d87-bffa-72b5e98e5e55-kube-api-access-j7ddv\") pod \"4b576759-2af2-4d87-bffa-72b5e98e5e55\" (UID: \"4b576759-2af2-4d87-bffa-72b5e98e5e55\") "
Sep 08 15:41:42.509777 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.509647    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b576759-2af2-4d87-bffa-72b5e98e5e55-plugins-config-volume\") pod \"4b576759-2af2-4d87-bffa-72b5e98e5e55\" (UID: \"4b576759-2af2-4d87-bffa-72b5e98e5e55\") "
Sep 08 15:41:42.510006 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.509975    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4b576759-2af2-4d87-bffa-72b5e98e5e55-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4b576759-2af2-4d87-bffa-72b5e98e5e55" (UID: "4b576759-2af2-4d87-bffa-72b5e98e5e55"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:42.511661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.511640    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b576759-2af2-4d87-bffa-72b5e98e5e55-kube-api-access-j7ddv" (OuterVolumeSpecName: "kube-api-access-j7ddv") pod "4b576759-2af2-4d87-bffa-72b5e98e5e55" (UID: "4b576759-2af2-4d87-bffa-72b5e98e5e55"). InnerVolumeSpecName "kube-api-access-j7ddv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:42.610375 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.610342    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4b576759-2af2-4d87-bffa-72b5e98e5e55-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:42.610375 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.610374    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7ddv\" (UniqueName: \"kubernetes.io/projected/4b576759-2af2-4d87-bffa-72b5e98e5e55-kube-api-access-j7ddv\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:42.610801 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.610777    2556 generic.go:356] "Generic (PLEG): container finished" podID="4b576759-2af2-4d87-bffa-72b5e98e5e55" containerID="65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd" exitCode=0
Sep 08 15:41:42.610869 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.610827    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"
Sep 08 15:41:42.610907 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.610868    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw" event={"ID":"4b576759-2af2-4d87-bffa-72b5e98e5e55","Type":"ContainerDied","Data":"65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd"}
Sep 08 15:41:42.610947 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.610921    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw" event={"ID":"4b576759-2af2-4d87-bffa-72b5e98e5e55","Type":"ContainerDied","Data":"6ace55b6beb9be0429796429f9557203de87ce268eded098a864acf9af05adce"}
Sep 08 15:41:42.610985 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.610944    2556 scope.go:117] "RemoveContainer" containerID="65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd"
Sep 08 15:41:42.619535 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.619518    2556 scope.go:117] "RemoveContainer" containerID="65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd"
Sep 08 15:41:42.619810 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:41:42.619791    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd\": container with ID starting with 65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd not found: ID does not exist" containerID="65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd"
Sep 08 15:41:42.619889 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.619819    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd"} err="failed to get container status \"65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd\": rpc error: code = NotFound desc = could not find container \"65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd\": container with ID starting with 65db81eb04eca7780221b8758ce291c64aaca7078025950e3f8a394c90bce0fd not found: ID does not exist"
Sep 08 15:41:42.631098 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.631073    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"]
Sep 08 15:41:42.635244 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:42.635221    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-fc867c-77f7d8ff57-vgprw"]
Sep 08 15:41:43.354596 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:43.354551    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3871e34a-f91a-42ee-aaa3-3a283fead33a" path="/var/lib/kubelet/pods/3871e34a-f91a-42ee-aaa3-3a283fead33a/volumes"
Sep 08 15:41:43.355107 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:43.355083    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b576759-2af2-4d87-bffa-72b5e98e5e55" path="/var/lib/kubelet/pods/4b576759-2af2-4d87-bffa-72b5e98e5e55/volumes"
Sep 08 15:41:48.821088 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:48.821052    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"]
Sep 08 15:41:48.821506 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:48.821363    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy" containerID="cri-o://7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce" gracePeriod=30
Sep 08 15:41:49.205488 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.205404    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"]
Sep 08 15:41:49.205746 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.205734    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b576759-2af2-4d87-bffa-72b5e98e5e55" containerName="payload-processing"
Sep 08 15:41:49.205811 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.205748    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b576759-2af2-4d87-bffa-72b5e98e5e55" containerName="payload-processing"
Sep 08 15:41:49.205811 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.205759    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3871e34a-f91a-42ee-aaa3-3a283fead33a" containerName="revoke-keys"
Sep 08 15:41:49.205811 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.205764    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="3871e34a-f91a-42ee-aaa3-3a283fead33a" containerName="revoke-keys"
Sep 08 15:41:49.205921 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.205815    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b576759-2af2-4d87-bffa-72b5e98e5e55" containerName="payload-processing"
Sep 08 15:41:49.205921 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.205825    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="3871e34a-f91a-42ee-aaa3-3a283fead33a" containerName="revoke-keys"
Sep 08 15:41:49.210167 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.210151    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"
Sep 08 15:41:49.212399 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.212376    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:41:49.212523 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.212378    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:41:49.216444 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.216410    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"]
Sep 08 15:41:49.363726 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.363699    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f33fbf-0c11-4450-8f3b-fc3085abf242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht\" (UID: \"68f33fbf-0c11-4450-8f3b-fc3085abf242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"
Sep 08 15:41:49.464810 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.464734    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f33fbf-0c11-4450-8f3b-fc3085abf242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht\" (UID: \"68f33fbf-0c11-4450-8f3b-fc3085abf242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"
Sep 08 15:41:49.465296 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.465279    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f33fbf-0c11-4450-8f3b-fc3085abf242-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht\" (UID: \"68f33fbf-0c11-4450-8f3b-fc3085abf242\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"
Sep 08 15:41:49.520651 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.520614    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"
Sep 08 15:41:49.802292 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:49.802206    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"]
Sep 08 15:41:49.805267 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:41:49.805239    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68f33fbf_0c11_4450_8f3b_fc3085abf242.slice/crio-042aad4bcd7174ca48425f588a89d8a542bf1d537dbf96e35880d16cae249440 WatchSource:0}: Error finding container 042aad4bcd7174ca48425f588a89d8a542bf1d537dbf96e35880d16cae249440: Status 404 returned error can't find the container with id 042aad4bcd7174ca48425f588a89d8a542bf1d537dbf96e35880d16cae249440
Sep 08 15:41:50.651765 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:50.651734    2556 generic.go:356] "Generic (PLEG): container finished" podID="68f33fbf-0c11-4450-8f3b-fc3085abf242" containerID="0818630cf30e6a46a8ab5c2b5242c1638924b8bc0de749b1ae3a0ea98d861e02" exitCode=0
Sep 08 15:41:50.652067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:50.651802    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht" event={"ID":"68f33fbf-0c11-4450-8f3b-fc3085abf242","Type":"ContainerDied","Data":"0818630cf30e6a46a8ab5c2b5242c1638924b8bc0de749b1ae3a0ea98d861e02"}
Sep 08 15:41:50.652067 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:50.651850    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht" event={"ID":"68f33fbf-0c11-4450-8f3b-fc3085abf242","Type":"ContainerStarted","Data":"042aad4bcd7174ca48425f588a89d8a542bf1d537dbf96e35880d16cae249440"}
Sep 08 15:41:51.781466 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:51.781443    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"
Sep 08 15:41:51.783547 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:51.783525    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f33fbf-0c11-4450-8f3b-fc3085abf242-maas-api-service-ca\") pod \"68f33fbf-0c11-4450-8f3b-fc3085abf242\" (UID: \"68f33fbf-0c11-4450-8f3b-fc3085abf242\") "
Sep 08 15:41:51.783856 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:51.783836    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68f33fbf-0c11-4450-8f3b-fc3085abf242-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "68f33fbf-0c11-4450-8f3b-fc3085abf242" (UID: "68f33fbf-0c11-4450-8f3b-fc3085abf242"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:51.884628 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:51.884604    2556 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/68f33fbf-0c11-4450-8f3b-fc3085abf242-maas-api-service-ca\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:52.663569 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:52.663536    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht" event={"ID":"68f33fbf-0c11-4450-8f3b-fc3085abf242","Type":"ContainerDied","Data":"042aad4bcd7174ca48425f588a89d8a542bf1d537dbf96e35880d16cae249440"}
Sep 08 15:41:52.663771 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:52.663594    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="042aad4bcd7174ca48425f588a89d8a542bf1d537dbf96e35880d16cae249440"
Sep 08 15:41:52.663771 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:52.663548    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"
Sep 08 15:41:54.072616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.072592    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:41:54.099604 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099579    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-credential-socket\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099753 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099623    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-envoy\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099753 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099638    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-socket\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099753 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099683    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-data\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099753 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099740    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2qxnd\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-kube-api-access-2qxnd\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099977 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099766    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istiod-ca-cert\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099977 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099819    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-token\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099977 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099874    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-certs\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099977 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099898    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-podinfo\") pod \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\" (UID: \"1370fa5a-2cb4-4b06-bd00-8669a05acb7d\") "
Sep 08 15:41:54.099977 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.099947    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:54.100238 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.100158    2556 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-credential-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.100496 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.100457    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:54.100718 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.100639    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:54.100718 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.100657    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-data" (OuterVolumeSpecName: "istio-data") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:54.100718 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.100698    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:54.102420 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.102387    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-token" (OuterVolumeSpecName: "istio-token") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:54.102576 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.102556    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:41:54.102645 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.102578    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-kube-api-access-2qxnd" (OuterVolumeSpecName: "kube-api-access-2qxnd") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "kube-api-access-2qxnd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:54.102645 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.102598    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1370fa5a-2cb4-4b06-bd00-8669a05acb7d" (UID: "1370fa5a-2cb4-4b06-bd00-8669a05acb7d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:41:54.201292 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.201259    2556 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-envoy\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.201292 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.201289    2556 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-socket\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.201292 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.201299    2556 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-data\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.201525 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.201308    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2qxnd\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-kube-api-access-2qxnd\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.201525 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.201318    2556 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istiod-ca-cert\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.201525 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.201326    2556 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-token\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.201525 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.201333    2556 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-workload-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.201525 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.201340    2556 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1370fa5a-2cb4-4b06-bd00-8669a05acb7d-istio-podinfo\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:41:54.675695 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.675641    2556 generic.go:356] "Generic (PLEG): container finished" podID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerID="7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce" exitCode=0
Sep 08 15:41:54.675870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.675713    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"
Sep 08 15:41:54.675870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.675734    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" event={"ID":"1370fa5a-2cb4-4b06-bd00-8669a05acb7d","Type":"ContainerDied","Data":"7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce"}
Sep 08 15:41:54.675870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.675801    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l" event={"ID":"1370fa5a-2cb4-4b06-bd00-8669a05acb7d","Type":"ContainerDied","Data":"b9fb816edd0bf4cc0869a04e2989849ae0eb532f32042613162662ee5aeea5dd"}
Sep 08 15:41:54.675870 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.675830    2556 scope.go:117] "RemoveContainer" containerID="7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce"
Sep 08 15:41:54.685524 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.685508    2556 scope.go:117] "RemoveContainer" containerID="5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870"
Sep 08 15:41:54.693033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.693015    2556 scope.go:117] "RemoveContainer" containerID="7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce"
Sep 08 15:41:54.693266 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:41:54.693246    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce\": container with ID starting with 7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce not found: ID does not exist" containerID="7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce"
Sep 08 15:41:54.693316 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.693272    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce"} err="failed to get container status \"7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce\": rpc error: code = NotFound desc = could not find container \"7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce\": container with ID starting with 7b729ef4d9500f9892e5fbc60eed2b6129bf82760140e37f72cf68384b15bfce not found: ID does not exist"
Sep 08 15:41:54.693316 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.693293    2556 scope.go:117] "RemoveContainer" containerID="5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870"
Sep 08 15:41:54.693491 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:41:54.693475    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870\": container with ID starting with 5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870 not found: ID does not exist" containerID="5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870"
Sep 08 15:41:54.693535 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.693495    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870"} err="failed to get container status \"5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870\": rpc error: code = NotFound desc = could not find container \"5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870\": container with ID starting with 5570b61fc8f5c1cbe20f9bbf80da99d65615ddd29c4498b5d24ef1244ecf6870 not found: ID does not exist"
Sep 08 15:41:54.697445 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.697424    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"]
Sep 08 15:41:54.701297 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:54.701276    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-fc867c-openshift-default-56d6c5cf74-mxr7l"]
Sep 08 15:41:55.353593 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:55.353558    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" path="/var/lib/kubelet/pods/1370fa5a-2cb4-4b06-bd00-8669a05acb7d/volumes"
Sep 08 15:41:59.743683 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:59.743632    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"]
Sep 08 15:41:59.744127 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:59.743880    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm" podUID="5bf311b5-7881-4afb-b108-8ba2dbbf164f" containerName="payload-processing" containerID="cri-o://6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef" gracePeriod=30
Sep 08 15:41:59.916866 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:59.916838    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"]
Sep 08 15:41:59.920403 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:59.920380    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-565cd7-nj7ht"]
Sep 08 15:41:59.988337 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:41:59.988317    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:42:00.047778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.047708    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bf311b5-7881-4afb-b108-8ba2dbbf164f-plugins-config-volume\") pod \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\" (UID: \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\") "
Sep 08 15:42:00.047778 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.047747    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z27hn\" (UniqueName: \"kubernetes.io/projected/5bf311b5-7881-4afb-b108-8ba2dbbf164f-kube-api-access-z27hn\") pod \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\" (UID: \"5bf311b5-7881-4afb-b108-8ba2dbbf164f\") "
Sep 08 15:42:00.048080 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.048057    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5bf311b5-7881-4afb-b108-8ba2dbbf164f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5bf311b5-7881-4afb-b108-8ba2dbbf164f" (UID: "5bf311b5-7881-4afb-b108-8ba2dbbf164f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:42:00.049905 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.049858    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5bf311b5-7881-4afb-b108-8ba2dbbf164f-kube-api-access-z27hn" (OuterVolumeSpecName: "kube-api-access-z27hn") pod "5bf311b5-7881-4afb-b108-8ba2dbbf164f" (UID: "5bf311b5-7881-4afb-b108-8ba2dbbf164f"). InnerVolumeSpecName "kube-api-access-z27hn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:42:00.149028 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.148997    2556 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5bf311b5-7881-4afb-b108-8ba2dbbf164f-plugins-config-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:42:00.149028 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.149020    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z27hn\" (UniqueName: \"kubernetes.io/projected/5bf311b5-7881-4afb-b108-8ba2dbbf164f-kube-api-access-z27hn\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:42:00.707717 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.707654    2556 generic.go:356] "Generic (PLEG): container finished" podID="5bf311b5-7881-4afb-b108-8ba2dbbf164f" containerID="6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef" exitCode=0
Sep 08 15:42:00.707927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.707727    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"
Sep 08 15:42:00.707927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.707731    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm" event={"ID":"5bf311b5-7881-4afb-b108-8ba2dbbf164f","Type":"ContainerDied","Data":"6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef"}
Sep 08 15:42:00.707927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.707786    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm" event={"ID":"5bf311b5-7881-4afb-b108-8ba2dbbf164f","Type":"ContainerDied","Data":"d1530b18587ece2a60c3eb1e39cc06b5911d4cf3f7f05998afd087780c37bd14"}
Sep 08 15:42:00.707927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.707813    2556 scope.go:117] "RemoveContainer" containerID="6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef"
Sep 08 15:42:00.716199 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.716183    2556 scope.go:117] "RemoveContainer" containerID="6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef"
Sep 08 15:42:00.716497 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:42:00.716480    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef\": container with ID starting with 6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef not found: ID does not exist" containerID="6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef"
Sep 08 15:42:00.716544 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.716506    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef"} err="failed to get container status \"6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef\": rpc error: code = NotFound desc = could not find container \"6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef\": container with ID starting with 6b7e112f26a5d5f19788cba3aab70fcb237c14266e290bb58b09290c0e3f71ef not found: ID does not exist"
Sep 08 15:42:00.728471 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.728442    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"]
Sep 08 15:42:00.731763 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:00.731739    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-565cd7-756fb557c-drpjm"]
Sep 08 15:42:01.354556 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:01.354521    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5bf311b5-7881-4afb-b108-8ba2dbbf164f" path="/var/lib/kubelet/pods/5bf311b5-7881-4afb-b108-8ba2dbbf164f/volumes"
Sep 08 15:42:01.354939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:01.354855    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68f33fbf-0c11-4450-8f3b-fc3085abf242" path="/var/lib/kubelet/pods/68f33fbf-0c11-4450-8f3b-fc3085abf242/volumes"
Sep 08 15:42:53.732867 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:53.732837    2556 scope.go:117] "RemoveContainer" containerID="06ed38bccbd7c51e1bf1b9f0f81fc4c0848c46a2e3e7da408c9efea2b74ffa4e"
Sep 08 15:42:53.740514 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:53.740493    2556 scope.go:117] "RemoveContainer" containerID="a4996ffdf93eadf643a13271f168f52ccf1d11582879ff1e3fcfdccb4c5ec0ef"
Sep 08 15:42:53.747962 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:42:53.747945    2556 scope.go:117] "RemoveContainer" containerID="aae711bc14cbe0f2fe135e63b782a8260f679766ecb708182cd312e4e29f2dfa"
Sep 08 15:43:53.778217 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:43:53.778186    2556 scope.go:117] "RemoveContainer" containerID="804b9bde973fad51a82a74075fb2afb623c403da0d6cb0d6a983a5d6aa6f579f"
Sep 08 15:44:34.518662 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:34.518625    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"]
Sep 08 15:44:34.519147 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:34.518827    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp" podUID="519a7a6e-cedd-4056-8e3d-d7a4ac47fd78" containerName="manager" containerID="cri-o://9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a" gracePeriod=10
Sep 08 15:44:36.867202 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:36.867180    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:44:36.950214 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:36.950134    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-extensions-socket-volume\") pod \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\" (UID: \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\") "
Sep 08 15:44:36.950214 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:36.950171    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kr2zn\" (UniqueName: \"kubernetes.io/projected/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-kube-api-access-kr2zn\") pod \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\" (UID: \"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78\") "
Sep 08 15:44:36.950536 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:36.950514    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "519a7a6e-cedd-4056-8e3d-d7a4ac47fd78" (UID: "519a7a6e-cedd-4056-8e3d-d7a4ac47fd78"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:44:36.952122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:36.952097    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-kube-api-access-kr2zn" (OuterVolumeSpecName: "kube-api-access-kr2zn") pod "519a7a6e-cedd-4056-8e3d-d7a4ac47fd78" (UID: "519a7a6e-cedd-4056-8e3d-d7a4ac47fd78"). InnerVolumeSpecName "kube-api-access-kr2zn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:44:37.051236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.051206    2556 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-extensions-socket-volume\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:44:37.051236 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.051229    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kr2zn\" (UniqueName: \"kubernetes.io/projected/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78-kube-api-access-kr2zn\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:44:37.423588 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.423556    2556 generic.go:356] "Generic (PLEG): container finished" podID="519a7a6e-cedd-4056-8e3d-d7a4ac47fd78" containerID="9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a" exitCode=0
Sep 08 15:44:37.423748 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.423603    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"
Sep 08 15:44:37.423748 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.423608    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp" event={"ID":"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78","Type":"ContainerDied","Data":"9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a"}
Sep 08 15:44:37.423748 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.423724    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp" event={"ID":"519a7a6e-cedd-4056-8e3d-d7a4ac47fd78","Type":"ContainerDied","Data":"0a3cc4a6bca942ffbe7c0ce17f40e3d5d87fa95beff305e46357922b1104f5e9"}
Sep 08 15:44:37.423910 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.423755    2556 scope.go:117] "RemoveContainer" containerID="9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a"
Sep 08 15:44:37.433009 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.432985    2556 scope.go:117] "RemoveContainer" containerID="9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a"
Sep 08 15:44:37.433243 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:44:37.433222    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a\": container with ID starting with 9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a not found: ID does not exist" containerID="9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a"
Sep 08 15:44:37.433300 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.433248    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a"} err="failed to get container status \"9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a\": rpc error: code = NotFound desc = could not find container \"9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a\": container with ID starting with 9ee58815427facb75272f2f777229855af616e4f6e21ac0ff61089031fada77a not found: ID does not exist"
Sep 08 15:44:37.445035 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.445012    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"]
Sep 08 15:44:37.449326 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:37.449307    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-49jpp"]
Sep 08 15:44:39.354448 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:44:39.354417    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="519a7a6e-cedd-4056-8e3d-d7a4ac47fd78" path="/var/lib/kubelet/pods/519a7a6e-cedd-4056-8e3d-d7a4ac47fd78/volumes"
Sep 08 15:45:00.147835 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.147801    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h"]
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148086    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148097    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148108    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5bf311b5-7881-4afb-b108-8ba2dbbf164f" containerName="payload-processing"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148114    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="5bf311b5-7881-4afb-b108-8ba2dbbf164f" containerName="payload-processing"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148125    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="519a7a6e-cedd-4056-8e3d-d7a4ac47fd78" containerName="manager"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148130    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="519a7a6e-cedd-4056-8e3d-d7a4ac47fd78" containerName="manager"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148139    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68f33fbf-0c11-4450-8f3b-fc3085abf242" containerName="revoke-keys"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148145    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="68f33fbf-0c11-4450-8f3b-fc3085abf242" containerName="revoke-keys"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148190    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="519a7a6e-cedd-4056-8e3d-d7a4ac47fd78" containerName="manager"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148197    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="5bf311b5-7881-4afb-b108-8ba2dbbf164f" containerName="payload-processing"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148203    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148209    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy"
Sep 08 15:45:00.148260 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.148215    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="68f33fbf-0c11-4450-8f3b-fc3085abf242" containerName="revoke-keys"
Sep 08 15:45:00.150951 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.150933    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h"
Sep 08 15:45:00.153293 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.153271    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-lzls6\""
Sep 08 15:45:00.158450 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.158077    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h"]
Sep 08 15:45:00.161958 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.161936    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h"
Sep 08 15:45:00.430965 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.430850    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h"]
Sep 08 15:45:00.433563 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:45:00.433537    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6073a4a0_601f_43c9_a2db_23dbf7c6605d.slice/crio-db4e6931622bc7d9d98a3748523f2cc5594ab7482e3819472a25f112e49180ec WatchSource:0}: Error finding container db4e6931622bc7d9d98a3748523f2cc5594ab7482e3819472a25f112e49180ec: Status 404 returned error can't find the container with id db4e6931622bc7d9d98a3748523f2cc5594ab7482e3819472a25f112e49180ec
Sep 08 15:45:00.528429 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:00.528404    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h" event={"ID":"6073a4a0-601f-43c9-a2db-23dbf7c6605d","Type":"ContainerStarted","Data":"db4e6931622bc7d9d98a3748523f2cc5594ab7482e3819472a25f112e49180ec"}
Sep 08 15:45:01.534221 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:01.534185    2556 generic.go:356] "Generic (PLEG): container finished" podID="6073a4a0-601f-43c9-a2db-23dbf7c6605d" containerID="3c50159fd4d43a6505b6b342bd9c1a616becd197ff57e9e5ac2ea36501239e6f" exitCode=0
Sep 08 15:45:01.534600 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:01.534268    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h" event={"ID":"6073a4a0-601f-43c9-a2db-23dbf7c6605d","Type":"ContainerDied","Data":"3c50159fd4d43a6505b6b342bd9c1a616becd197ff57e9e5ac2ea36501239e6f"}
Sep 08 15:45:02.660145 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:02.660117    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h"
Sep 08 15:45:03.545489 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:03.545461    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h"
Sep 08 15:45:03.545689 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:03.545497    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29814705-2458h" event={"ID":"6073a4a0-601f-43c9-a2db-23dbf7c6605d","Type":"ContainerDied","Data":"db4e6931622bc7d9d98a3748523f2cc5594ab7482e3819472a25f112e49180ec"}
Sep 08 15:45:03.545689 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:03.545545    2556 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="db4e6931622bc7d9d98a3748523f2cc5594ab7482e3819472a25f112e49180ec"
Sep 08 15:45:35.224042 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.224008    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"]
Sep 08 15:45:35.224478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.224297    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy"
Sep 08 15:45:35.224478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.224308    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="1370fa5a-2cb4-4b06-bd00-8669a05acb7d" containerName="istio-proxy"
Sep 08 15:45:35.224478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.224315    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6073a4a0-601f-43c9-a2db-23dbf7c6605d" containerName="cleanup"
Sep 08 15:45:35.224478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.224320    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="6073a4a0-601f-43c9-a2db-23dbf7c6605d" containerName="cleanup"
Sep 08 15:45:35.224478 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.224381    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="6073a4a0-601f-43c9-a2db-23dbf7c6605d" containerName="cleanup"
Sep 08 15:45:35.227378 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.227358    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:35.229944 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.229918    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-g2gcd\""
Sep 08 15:45:35.244077 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.244054    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"]
Sep 08 15:45:35.395173 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.395145    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f8cnt\" (UniqueName: \"kubernetes.io/projected/25375b13-0aab-4845-8799-a638af9e44ac-kube-api-access-f8cnt\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-dw9bs\" (UID: \"25375b13-0aab-4845-8799-a638af9e44ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:35.395336 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.395200    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25375b13-0aab-4845-8799-a638af9e44ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-dw9bs\" (UID: \"25375b13-0aab-4845-8799-a638af9e44ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:35.496543 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.496491    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25375b13-0aab-4845-8799-a638af9e44ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-dw9bs\" (UID: \"25375b13-0aab-4845-8799-a638af9e44ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:35.496543 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.496537    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f8cnt\" (UniqueName: \"kubernetes.io/projected/25375b13-0aab-4845-8799-a638af9e44ac-kube-api-access-f8cnt\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-dw9bs\" (UID: \"25375b13-0aab-4845-8799-a638af9e44ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:35.496849 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.496830    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/25375b13-0aab-4845-8799-a638af9e44ac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-dw9bs\" (UID: \"25375b13-0aab-4845-8799-a638af9e44ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:35.504980 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.504963    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f8cnt\" (UniqueName: \"kubernetes.io/projected/25375b13-0aab-4845-8799-a638af9e44ac-kube-api-access-f8cnt\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-dw9bs\" (UID: \"25375b13-0aab-4845-8799-a638af9e44ac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:35.537790 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.537758    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:35.817451 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:35.817428    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"]
Sep 08 15:45:35.819583 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:45:35.819548    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod25375b13_0aab_4845_8799_a638af9e44ac.slice/crio-04f7e49569596c7701277b82ecd743f216a653373de5f889ba3ebc950794750e WatchSource:0}: Error finding container 04f7e49569596c7701277b82ecd743f216a653373de5f889ba3ebc950794750e: Status 404 returned error can't find the container with id 04f7e49569596c7701277b82ecd743f216a653373de5f889ba3ebc950794750e
Sep 08 15:45:36.697123 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:36.697087    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs" event={"ID":"25375b13-0aab-4845-8799-a638af9e44ac","Type":"ContainerStarted","Data":"b1a2de2b1bc8cd41e5e58f6362966135b66cb3dd5e576c371938cd9621323b9b"}
Sep 08 15:45:36.697628 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:36.697138    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs" event={"ID":"25375b13-0aab-4845-8799-a638af9e44ac","Type":"ContainerStarted","Data":"04f7e49569596c7701277b82ecd743f216a653373de5f889ba3ebc950794750e"}
Sep 08 15:45:36.697628 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:36.697186    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:36.722833 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:36.722788    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs" podStartSLOduration=1.722774537 podStartE2EDuration="1.722774537s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:36.720622926 +0000 UTC m=+1963.821517037" watchObservedRunningTime="2026-09-08 15:45:36.722774537 +0000 UTC m=+1963.823668647"
Sep 08 15:45:47.704403 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:47.704316    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-dw9bs"
Sep 08 15:45:53.806074 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:45:53.806041    2556 scope.go:117] "RemoveContainer" containerID="902ffff2ee8b65a141c36445966f9e83504c48b02cbb4bfbb36eea9b36ab81a4"
Sep 08 15:46:32.558938 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.558906    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"]
Sep 08 15:46:32.562143 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.562125    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.567217 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.567196    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-360f3caf-kserve-self-signed-certs\""
Sep 08 15:46:32.583405 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.583384    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"]
Sep 08 15:46:32.746183 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.746148    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-model-cache\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.746183 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.746184    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-tmp-dir\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.746413 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.746206    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c852cbeb-0911-42bd-893e-b277f43cf87c-tls-certs\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.746413 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.746259    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-dshm\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.746413 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.746309    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd7v4\" (UniqueName: \"kubernetes.io/projected/c852cbeb-0911-42bd-893e-b277f43cf87c-kube-api-access-pd7v4\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.746413 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.746336    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-home\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.847442 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847414    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-model-cache\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.847442 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847444    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-tmp-dir\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.847692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847466    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c852cbeb-0911-42bd-893e-b277f43cf87c-tls-certs\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.847692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847490    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-dshm\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.847692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847520    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd7v4\" (UniqueName: \"kubernetes.io/projected/c852cbeb-0911-42bd-893e-b277f43cf87c-kube-api-access-pd7v4\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.847692 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847544    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-home\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.847937 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847915    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-model-cache\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.847985 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847934    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-home\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.848022 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.847991    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-tmp-dir\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.849813 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.849790    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-dshm\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.850338 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.850318    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c852cbeb-0911-42bd-893e-b277f43cf87c-tls-certs\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.858156 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.858132    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd7v4\" (UniqueName: \"kubernetes.io/projected/c852cbeb-0911-42bd-893e-b277f43cf87c-kube-api-access-pd7v4\") pod \"e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") " pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:32.870430 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:32.870408    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:33.149820 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:33.149569    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"]
Sep 08 15:46:33.152380 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:46:33.152358    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc852cbeb_0911_42bd_893e_b277f43cf87c.slice/crio-ee997439ad5bbf9ccbdebe023affaac0e375171000a0bee9f91324f2080f0d26 WatchSource:0}: Error finding container ee997439ad5bbf9ccbdebe023affaac0e375171000a0bee9f91324f2080f0d26: Status 404 returned error can't find the container with id ee997439ad5bbf9ccbdebe023affaac0e375171000a0bee9f91324f2080f0d26
Sep 08 15:46:33.959705 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:33.959654    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk" event={"ID":"c852cbeb-0911-42bd-893e-b277f43cf87c","Type":"ContainerStarted","Data":"ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6"}
Sep 08 15:46:33.960078 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:33.959719    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk" event={"ID":"c852cbeb-0911-42bd-893e-b277f43cf87c","Type":"ContainerStarted","Data":"ee997439ad5bbf9ccbdebe023affaac0e375171000a0bee9f91324f2080f0d26"}
Sep 08 15:46:33.977080 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:33.977035    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk" podStartSLOduration=1.977020074 podStartE2EDuration="1.977020074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:33.976100089 +0000 UTC m=+2021.076994200" watchObservedRunningTime="2026-09-08 15:46:33.977020074 +0000 UTC m=+2021.077914185"
Sep 08 15:46:42.871167 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:42.871131    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:42.871785 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:42.871451    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:42.883377 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:42.883355    2556 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:43.011122 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:43.011098    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:46:46.435362 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:46.435328    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"]
Sep 08 15:46:53.824910 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:46:53.824874    2556 scope.go:117] "RemoveContainer" containerID="e0f6e2bab0f4e9596d42de106668705ba638e242066bb2778c677c08a96db2eb"
Sep 08 15:47:01.455686 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.455625    2556 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk" podUID="c852cbeb-0911-42bd-893e-b277f43cf87c" containerName="main" containerID="cri-o://ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6" gracePeriod=45
Sep 08 15:47:01.708618 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.708550    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:47:01.773859 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.773822    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-tmp-dir\") pod \"c852cbeb-0911-42bd-893e-b277f43cf87c\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") "
Sep 08 15:47:01.774046 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.773902    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-home\") pod \"c852cbeb-0911-42bd-893e-b277f43cf87c\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") "
Sep 08 15:47:01.774046 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.773937    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c852cbeb-0911-42bd-893e-b277f43cf87c-tls-certs\") pod \"c852cbeb-0911-42bd-893e-b277f43cf87c\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") "
Sep 08 15:47:01.774046 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.773981    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-dshm\") pod \"c852cbeb-0911-42bd-893e-b277f43cf87c\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") "
Sep 08 15:47:01.774046 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.774008    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pd7v4\" (UniqueName: \"kubernetes.io/projected/c852cbeb-0911-42bd-893e-b277f43cf87c-kube-api-access-pd7v4\") pod \"c852cbeb-0911-42bd-893e-b277f43cf87c\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") "
Sep 08 15:47:01.774252 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.774062    2556 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-model-cache\") pod \"c852cbeb-0911-42bd-893e-b277f43cf87c\" (UID: \"c852cbeb-0911-42bd-893e-b277f43cf87c\") "
Sep 08 15:47:01.774252 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.774058    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c852cbeb-0911-42bd-893e-b277f43cf87c" (UID: "c852cbeb-0911-42bd-893e-b277f43cf87c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:01.774356 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.774245    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-home" (OuterVolumeSpecName: "home") pod "c852cbeb-0911-42bd-893e-b277f43cf87c" (UID: "c852cbeb-0911-42bd-893e-b277f43cf87c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:01.774356 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.774318    2556 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-tmp-dir\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:47:01.774435 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.774362    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-model-cache" (OuterVolumeSpecName: "model-cache") pod "c852cbeb-0911-42bd-893e-b277f43cf87c" (UID: "c852cbeb-0911-42bd-893e-b277f43cf87c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:01.776277 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.776245    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c852cbeb-0911-42bd-893e-b277f43cf87c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c852cbeb-0911-42bd-893e-b277f43cf87c" (UID: "c852cbeb-0911-42bd-893e-b277f43cf87c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:47:01.776398 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.776291    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c852cbeb-0911-42bd-893e-b277f43cf87c-kube-api-access-pd7v4" (OuterVolumeSpecName: "kube-api-access-pd7v4") pod "c852cbeb-0911-42bd-893e-b277f43cf87c" (UID: "c852cbeb-0911-42bd-893e-b277f43cf87c"). InnerVolumeSpecName "kube-api-access-pd7v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:47:01.776398 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.776300    2556 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-dshm" (OuterVolumeSpecName: "dshm") pod "c852cbeb-0911-42bd-893e-b277f43cf87c" (UID: "c852cbeb-0911-42bd-893e-b277f43cf87c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:01.874906 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.874867    2556 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-dshm\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:47:01.874906 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.874901    2556 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pd7v4\" (UniqueName: \"kubernetes.io/projected/c852cbeb-0911-42bd-893e-b277f43cf87c-kube-api-access-pd7v4\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:47:01.874906 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.874912    2556 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-model-cache\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:47:01.875147 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.874921    2556 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c852cbeb-0911-42bd-893e-b277f43cf87c-home\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:47:01.875147 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:01.874929    2556 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c852cbeb-0911-42bd-893e-b277f43cf87c-tls-certs\") on node \"ip-10-0-128-19.ec2.internal\" DevicePath \"\""
Sep 08 15:47:02.096171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.096127    2556 generic.go:356] "Generic (PLEG): container finished" podID="c852cbeb-0911-42bd-893e-b277f43cf87c" containerID="ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6" exitCode=0
Sep 08 15:47:02.096369 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.096180    2556 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"
Sep 08 15:47:02.096369 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.096192    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk" event={"ID":"c852cbeb-0911-42bd-893e-b277f43cf87c","Type":"ContainerDied","Data":"ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6"}
Sep 08 15:47:02.096369 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.096238    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk" event={"ID":"c852cbeb-0911-42bd-893e-b277f43cf87c","Type":"ContainerDied","Data":"ee997439ad5bbf9ccbdebe023affaac0e375171000a0bee9f91324f2080f0d26"}
Sep 08 15:47:02.096369 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.096265    2556 scope.go:117] "RemoveContainer" containerID="ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6"
Sep 08 15:47:02.105393 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.105377    2556 scope.go:117] "RemoveContainer" containerID="ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6"
Sep 08 15:47:02.105643 ip-10-0-128-19 kubenswrapper[2556]: E0908 15:47:02.105624    2556 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6\": container with ID starting with ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6 not found: ID does not exist" containerID="ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6"
Sep 08 15:47:02.105742 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.105649    2556 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6"} err="failed to get container status \"ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6\": rpc error: code = NotFound desc = could not find container \"ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6\": container with ID starting with ff2b5be677c118bbaec2fffbda0d610fca46eb5fd87906256b9d36fe26e131f6 not found: ID does not exist"
Sep 08 15:47:02.117390 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.117367    2556 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"]
Sep 08 15:47:02.121235 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:02.121213    2556 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-360f3caf-kserve-6b798458f5-lmrwk"]
Sep 08 15:47:03.354014 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:03.353982    2556 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c852cbeb-0911-42bd-893e-b277f43cf87c" path="/var/lib/kubelet/pods/c852cbeb-0911-42bd-893e-b277f43cf87c/volumes"
Sep 08 15:47:43.917795 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:43.917758    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5hztk_38ced7e9-9325-454b-ab82-53fc7787d998/manager/0.log"
Sep 08 15:47:44.025092 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:44.025065    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dbb6d945-l56vg_93e90173-a399-47b7-9571-3ecc1087f2c9/copy-manifests/0.log"
Sep 08 15:47:44.031242 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:44.031221    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dbb6d945-l56vg_93e90173-a399-47b7-9571-3ecc1087f2c9/manager/0.log"
Sep 08 15:47:44.805012 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:44.804977    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814690-5c4fn_b654a8cb-ac85-46a2-80b6-a88c2004aa0e/cleanup/0.log"
Sep 08 15:47:44.913947 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:44.913923    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29814705-2458h_6073a4a0-601f-43c9-a2db-23dbf7c6605d/cleanup/0.log"
Sep 08 15:47:45.901246 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:45.901215    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-q6vhb_9664ef33-9af6-436e-b2b2-711ecf5b2a52/manager/0.log"
Sep 08 15:47:46.017985 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:46.017954    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-xfprp_0db3458f-f26d-4685-90ef-b61a1a785883/manager/0.log"
Sep 08 15:47:46.256519 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:46.256443    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-dw9bs_25375b13-0aab-4845-8799-a638af9e44ac/manager/0.log"
Sep 08 15:47:46.502943 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:46.502912    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-2w75m_a05931fa-06e3-40e5-8673-0bdab5d417fb/manager/0.log"
Sep 08 15:47:46.976451 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:46.976425    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cgp6q_24b0fd7b-4f77-4d73-ab10-157a84f5e657/discovery/0.log"
Sep 08 15:47:47.198496 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:47.198466    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-565756cbb6-tw8jg_240ede5d-3596-44fe-a7f6-19cd82899836/kube-auth-proxy/0.log"
Sep 08 15:47:47.441816 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:47.441784    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vrgbs_8bd76297-19b8-4d68-b87e-9e913ec5cfe7/payload-pre-processing/0.log"
Sep 08 15:47:48.237736 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:48.237703    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-embedding-simulated-kserve-bcc9ff8d8-vdqhz_309c874f-a4ea-4858-a4ec-2612b52daa55/main/0.log"
Sep 08 15:47:48.460932 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:48.460901    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68fwlwnz_ab59f4e4-8052-4f45-9348-0f653c830b55/main/0.log"
Sep 08 15:47:53.844086 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:53.844055    2556 scope.go:117] "RemoveContainer" containerID="eb5200d7472e7c86b189cab31304fde426efa4d27d64185feff9e1052d2929d0"
Sep 08 15:47:53.852423 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:53.852408    2556 scope.go:117] "RemoveContainer" containerID="0818630cf30e6a46a8ab5c2b5242c1638924b8bc0de749b1ae3a0ea98d861e02"
Sep 08 15:47:53.860234 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:53.860215    2556 scope.go:117] "RemoveContainer" containerID="14760569c19b051877d6318ea0ca9b9a781ec6daef4f443afba756a41a0093b0"
Sep 08 15:47:57.271723 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:57.271682    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8jb99_79e91d38-55a8-45a6-abd3-3836ff1c05cc/global-pull-secret-syncer/0.log"
Sep 08 15:47:57.380267 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:57.380238    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-njrjl_5dd06d06-113d-451c-960e-94953d46245c/konnectivity-agent/0.log"
Sep 08 15:47:57.401020 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:47:57.400987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-19.ec2.internal_ad804f188e808aed7f4cdb7919ae721f/haproxy/0.log"
Sep 08 15:48:02.329484 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:02.329448    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-68d88948d8-q6vhb_9664ef33-9af6-436e-b2b2-711ecf5b2a52/manager/0.log"
Sep 08 15:48:02.377313 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:02.377277    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-5985564776-xfprp_0db3458f-f26d-4685-90ef-b61a1a785883/manager/0.log"
Sep 08 15:48:02.457880 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:02.457847    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5b65f94d4c-dw9bs_25375b13-0aab-4845-8799-a638af9e44ac/manager/0.log"
Sep 08 15:48:02.566328 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:02.566292    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-6c549b6d85-2w75m_a05931fa-06e3-40e5-8673-0bdab5d417fb/manager/0.log"
Sep 08 15:48:04.530024 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:04.529930    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ccdp6_7d47f4a6-115c-4f46-a5a3-b05db3f11eec/node-exporter/0.log"
Sep 08 15:48:04.553914 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:04.553885    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ccdp6_7d47f4a6-115c-4f46-a5a3-b05db3f11eec/kube-rbac-proxy/0.log"
Sep 08 15:48:04.574451 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:04.574430    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ccdp6_7d47f4a6-115c-4f46-a5a3-b05db3f11eec/init-textfile/0.log"
Sep 08 15:48:07.156171 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.156135    2556 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"]
Sep 08 15:48:07.156533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.156456    2556 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c852cbeb-0911-42bd-893e-b277f43cf87c" containerName="main"
Sep 08 15:48:07.156533 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.156467    2556 state_mem.go:107] "Deleted CPUSet assignment" podUID="c852cbeb-0911-42bd-893e-b277f43cf87c" containerName="main"
Sep 08 15:48:07.156604 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.156534    2556 memory_manager.go:368] "RemoveStaleState removing state" podUID="c852cbeb-0911-42bd-893e-b277f43cf87c" containerName="main"
Sep 08 15:48:07.159594 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.159573    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.161979 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.161946    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m72hg\"/\"openshift-service-ca.crt\""
Sep 08 15:48:07.162096 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.162079    2556 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m72hg\"/\"kube-root-ca.crt\""
Sep 08 15:48:07.162904 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.162890    2556 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m72hg\"/\"default-dockercfg-hqgkw\""
Sep 08 15:48:07.169573 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.169554    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"]
Sep 08 15:48:07.246970 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.246945    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-lib-modules\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.247086 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.246975    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-sys\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.247086 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.246990    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-proc\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.247086 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.247007    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4knc\" (UniqueName: \"kubernetes.io/projected/3bf13362-28ca-4eb9-9ac4-6abad2080260-kube-api-access-j4knc\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.247200 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.247131    2556 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-podres\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348232 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348202    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-sys\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348384 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348241    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-proc\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348384 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348273    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4knc\" (UniqueName: \"kubernetes.io/projected/3bf13362-28ca-4eb9-9ac4-6abad2080260-kube-api-access-j4knc\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348384 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348330    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-sys\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348384 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348330    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-proc\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348384 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348356    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-podres\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348642 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348401    2556 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-lib-modules\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348642 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348457    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-podres\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.348642 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.348488    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3bf13362-28ca-4eb9-9ac4-6abad2080260-lib-modules\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.356563 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.356534    2556 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4knc\" (UniqueName: \"kubernetes.io/projected/3bf13362-28ca-4eb9-9ac4-6abad2080260-kube-api-access-j4knc\") pod \"perf-node-gather-daemonset-cf9gj\" (UID: \"3bf13362-28ca-4eb9-9ac4-6abad2080260\") " pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.468872 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.468820    2556 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:07.733661 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.733630    2556 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"]
Sep 08 15:48:07.736313 ip-10-0-128-19 kubenswrapper[2556]: W0908 15:48:07.736287    2556 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod3bf13362_28ca_4eb9_9ac4_6abad2080260.slice/crio-b6331530658ee9ee8dd6456890fd2e0a01bd5f90b60d270421c709f664ed1db6 WatchSource:0}: Error finding container b6331530658ee9ee8dd6456890fd2e0a01bd5f90b60d270421c709f664ed1db6: Status 404 returned error can't find the container with id b6331530658ee9ee8dd6456890fd2e0a01bd5f90b60d270421c709f664ed1db6
Sep 08 15:48:07.760640 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:07.760616    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-85d98c998f-gkzjm_0effb25a-05a8-4455-b6ee-ca8f59ae2d3d/download-server/0.log"
Sep 08 15:48:08.401244 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:08.401209    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj" event={"ID":"3bf13362-28ca-4eb9-9ac4-6abad2080260","Type":"ContainerStarted","Data":"07c94ff7ea12a2be86740db5826f842d282907be1f2cb6b36a10606f35c40755"}
Sep 08 15:48:08.401616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:08.401265    2556 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj" event={"ID":"3bf13362-28ca-4eb9-9ac4-6abad2080260","Type":"ContainerStarted","Data":"b6331530658ee9ee8dd6456890fd2e0a01bd5f90b60d270421c709f664ed1db6"}
Sep 08 15:48:08.401616 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:08.401322    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:08.419038 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:08.418992    2556 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj" podStartSLOduration=1.418978536 podStartE2EDuration="1.418978536s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:48:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:08.417745918 +0000 UTC m=+2115.518640028" watchObservedRunningTime="2026-09-08 15:48:08.418978536 +0000 UTC m=+2115.519872683"
Sep 08 15:48:09.561357 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:09.561317    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ckqmm_4163df94-d80d-416b-8c76-e7d47c0bf11c/dns/0.log"
Sep 08 15:48:09.581247 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:09.581219    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ckqmm_4163df94-d80d-416b-8c76-e7d47c0bf11c/kube-rbac-proxy/0.log"
Sep 08 15:48:09.695160 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:09.695136    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-kvvkc_c7918019-eab8-461e-8168-0b482a89b3a5/dns-node-resolver/0.log"
Sep 08 15:48:10.269759 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:10.269723    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-ddd5cf967-9rvsg_5795edf9-e5cd-4d1e-9dce-9107893194be/registry/0.log"
Sep 08 15:48:10.312927 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:10.312905    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-l8bd8_65668f60-2edb-466d-9412-4d1ff328fed1/node-ca/0.log"
Sep 08 15:48:11.832725 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:11.832696    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cgp6q_24b0fd7b-4f77-4d73-ab10-157a84f5e657/discovery/0.log"
Sep 08 15:48:11.882101 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:11.882077    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-565756cbb6-tw8jg_240ede5d-3596-44fe-a7f6-19cd82899836/kube-auth-proxy/0.log"
Sep 08 15:48:11.963569 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:11.963546    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vrgbs_8bd76297-19b8-4d68-b87e-9e913ec5cfe7/payload-pre-processing/0.log"
Sep 08 15:48:12.884012 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:12.883987    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-699dx_61660523-2fc2-4b9f-98fb-3c185e15f7ff/serve-healthcheck-canary/0.log"
Sep 08 15:48:13.502367 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:13.502336    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjpvn_4002ba64-5bf7-4421-a4e2-d51238449cc4/kube-rbac-proxy/0.log"
Sep 08 15:48:13.521520 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:13.521496    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjpvn_4002ba64-5bf7-4421-a4e2-d51238449cc4/exporter/0.log"
Sep 08 15:48:13.544038 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:13.544015    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-mjpvn_4002ba64-5bf7-4421-a4e2-d51238449cc4/extractor/0.log"
Sep 08 15:48:14.414973 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:14.414944    2556 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m72hg/perf-node-gather-daemonset-cf9gj"
Sep 08 15:48:16.228501 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:16.228472    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-5hztk_38ced7e9-9325-454b-ab82-53fc7787d998/manager/0.log"
Sep 08 15:48:16.255299 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:16.255278    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dbb6d945-l56vg_93e90173-a399-47b7-9571-3ecc1087f2c9/manager/0.log"
Sep 08 15:48:16.276942 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:16.276887    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68dbb6d945-l56vg_93e90173-a399-47b7-9571-3ecc1087f2c9/copy-manifests/0.log"
Sep 08 15:48:18.287939 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:18.287850    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cgp6q_24b0fd7b-4f77-4d73-ab10-157a84f5e657/discovery/0.log"
Sep 08 15:48:18.313833 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:18.313807    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-565756cbb6-tw8jg_240ede5d-3596-44fe-a7f6-19cd82899836/kube-auth-proxy/0.log"
Sep 08 15:48:18.383907 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:18.383877    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vrgbs_8bd76297-19b8-4d68-b87e-9e913ec5cfe7/payload-pre-processing/0.log"
Sep 08 15:48:20.380770 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:20.380740    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-cgp6q_24b0fd7b-4f77-4d73-ab10-157a84f5e657/discovery/0.log"
Sep 08 15:48:20.413165 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:20.413138    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-565756cbb6-tw8jg_240ede5d-3596-44fe-a7f6-19cd82899836/kube-auth-proxy/0.log"
Sep 08 15:48:20.485506 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:20.485478    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-vrgbs_8bd76297-19b8-4d68-b87e-9e913ec5cfe7/payload-pre-processing/0.log"
Sep 08 15:48:24.055033 ip-10-0-128-19 kubenswrapper[2556]: I0908 15:48:24.054978    2556 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4l4jl_ef70d42e-8937-46c3-b3f6-39ca76ab3d38/kube-multus/0.log"