Sep 15 09:07:04.143128 ip-10-0-141-185 systemd[1]: Starting Kubernetes Kubelet...
Sep 15 09:07:04.539283 ip-10-0-141-185 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:07:04.539283 ip-10-0-141-185 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 15 09:07:04.539283 ip-10-0-141-185 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:07:04.539283 ip-10-0-141-185 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 15 09:07:04.539283 ip-10-0-141-185 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 15 09:07:04.540510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.540405    2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 15 09:07:04.543697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543674    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:07:04.543697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543692    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:07:04.543697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543698    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:07:04.543697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543702    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543706    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543711    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543714    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543718    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543722    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543726    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543729    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543733    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543737    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543741    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543749    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543753    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543757    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543760    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543764    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543768    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543772    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543777    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543781    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:07:04.543964 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543785    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543789    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543793    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543797    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543801    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543805    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543809    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543813    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543818    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543822    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543827    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543831    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543835    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543856    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543862    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543869    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543875    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543879    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543883    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:07:04.544790 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543888    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543892    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543897    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543901    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543906    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543910    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543914    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543927    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543934    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543941    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543946    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543950    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543955    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543959    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543963    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543968    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543973    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543977    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543981    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:07:04.545605 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543985    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543990    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.543997    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544002    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544008    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544012    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544017    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544021    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544026    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544031    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544044    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544051    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544055    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544059    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544063    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544067    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544072    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544076    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544080    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544084    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:07:04.546106 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544089    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544093    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544097    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544101    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544105    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544110    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544114    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544119    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544123    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544127    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544131    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544136    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544140    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544144    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544148    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544152    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544157    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.544161    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545314    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:07:04.546691 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545323    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545329    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545333    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545338    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545343    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545347    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545352    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545356    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545361    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545365    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545369    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545374    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545378    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545383    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545388    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545392    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545396    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545400    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545404    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545408    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:07:04.547176 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545412    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545416    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545421    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545425    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545429    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545433    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545437    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545441    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545445    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545450    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545454    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545458    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545462    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545468    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545473    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545477    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545484    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545492    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545498    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:07:04.547722 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545503    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545508    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545512    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545517    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545521    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545528    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545535    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545540    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545544    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545574    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545592    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545597    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545600    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545604    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545607    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545610    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545614    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545617    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545620    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:07:04.548217 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545624    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545629    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545634    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545641    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545646    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545650    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545652    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545655    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545659    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545662    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545664    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545667    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545669    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545672    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545675    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545677    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545680    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545683    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545685    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:07:04.548702 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545688    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545694    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545696    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545699    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545703    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545707    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545713    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545717    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545721    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545726    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545729    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545731    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545734    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545736    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545739    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545742    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545744    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545747    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545749    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545752    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:07:04.549202 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.545755    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546186    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546192    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546195    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546199    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546203    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546209    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546213    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546218    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546221    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546225    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546230    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546233    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546236    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546239    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546242    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546246    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546249    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546252    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546254    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:07:04.549697 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546257    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546259    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546262    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546264    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546267    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546269    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546272    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546274    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546277    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546281    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546285    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546289    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546296    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546299    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546302    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546305    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546307    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546310    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546312    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546314    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:07:04.550228 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546317    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546319    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546322    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546324    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546327    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546329    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546331    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546334    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546336    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546340    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546343    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546347    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546351    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546355    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546359    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546365    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546370    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546375    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546379    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:07:04.550723 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546382    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546384    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546387    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546389    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546392    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546395    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546398    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546400    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546403    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546406    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546408    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546411    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546414    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546417    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546419    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546422    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546425    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546428    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546430    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:07:04.551221 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546433    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546436    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546438    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546441    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546446    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546450    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546454    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546458    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546463    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546466    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546468    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546471    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546473    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546476    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546479    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546482    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546485    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546487    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546490    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546492    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:07:04.551705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546494    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.546497    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546613    2568 flags.go:64] FLAG: --address="0.0.0.0"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546666    2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546675    2568 flags.go:64] FLAG: --anonymous-auth="true"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546679    2568 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546684    2568 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546687    2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546691    2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546696    2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546699    2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546702    2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546706    2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546709    2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546712    2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546715    2568 flags.go:64] FLAG: --cgroup-root=""
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546718    2568 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546721    2568 flags.go:64] FLAG: --client-ca-file=""
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546724    2568 flags.go:64] FLAG: --cloud-provider="external"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546727    2568 flags.go:64] FLAG: --cluster-dns="[]"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546731    2568 flags.go:64] FLAG: --cluster-domain=""
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546733    2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546737    2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546740    2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 15 09:07:04.552206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546743    2568 flags.go:64] FLAG: --container-log-max-files="5"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546746    2568 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546749    2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546753    2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546756    2568 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546759    2568 flags.go:64] FLAG: --contention-profiling="false"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546762    2568 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546765    2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546768    2568 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546771    2568 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546775    2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546780    2568 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546783    2568 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546786    2568 flags.go:64] FLAG: --enable-load-reader="false"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546789    2568 flags.go:64] FLAG: --enable-server="true"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546792    2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546796    2568 flags.go:64] FLAG: --event-burst="100"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546800    2568 flags.go:64] FLAG: --event-qps="50"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546803    2568 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546806    2568 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546809    2568 flags.go:64] FLAG: --eviction-hard=""
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546813    2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546816    2568 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546819    2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546822    2568 flags.go:64] FLAG: --eviction-soft=""
Sep 15 09:07:04.552831 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546824    2568 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546827    2568 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546830    2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546833    2568 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546836    2568 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546854    2568 flags.go:64] FLAG: --fail-swap-on="true"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546857    2568 flags.go:64] FLAG: --feature-gates=""
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546862    2568 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546865    2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546868    2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546872    2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546875    2568 flags.go:64] FLAG: --healthz-port="10248"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546878    2568 flags.go:64] FLAG: --help="false"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546881    2568 flags.go:64] FLAG: --hostname-override="ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546884    2568 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546887    2568 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546890    2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546895    2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546898    2568 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546902    2568 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546905    2568 flags.go:64] FLAG: --image-service-endpoint=""
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546908    2568 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546910    2568 flags.go:64] FLAG: --kube-api-burst="100"
Sep 15 09:07:04.553454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546913    2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546916    2568 flags.go:64] FLAG: --kube-api-qps="50"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546919    2568 flags.go:64] FLAG: --kube-reserved=""
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546922    2568 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546925    2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546928    2568 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546931    2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546934    2568 flags.go:64] FLAG: --lock-file=""
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546939    2568 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546942    2568 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546945    2568 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546950    2568 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546953    2568 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546956    2568 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546959    2568 flags.go:64] FLAG: --logging-format="text"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546962    2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546965    2568 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546968    2568 flags.go:64] FLAG: --manifest-url=""
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546972    2568 flags.go:64] FLAG: --manifest-url-header=""
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546976    2568 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546979    2568 flags.go:64] FLAG: --max-open-files="1000000"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546983    2568 flags.go:64] FLAG: --max-pods="110"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546986    2568 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546989    2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546992    2568 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 15 09:07:04.554086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.546995    2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547000    2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547002    2568 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547005    2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547013    2568 flags.go:64] FLAG: --node-status-max-images="50"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547016    2568 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547019    2568 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547022    2568 flags.go:64] FLAG: --pod-cidr=""
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547025    2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547030    2568 flags.go:64] FLAG: --pod-manifest-path=""
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547033    2568 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547036    2568 flags.go:64] FLAG: --pods-per-core="0"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547039    2568 flags.go:64] FLAG: --port="10250"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547042    2568 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547045    2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-010c496a77739dc6d"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547049    2568 flags.go:64] FLAG: --qos-reserved=""
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547052    2568 flags.go:64] FLAG: --read-only-port="10255"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547055    2568 flags.go:64] FLAG: --register-node="true"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547058    2568 flags.go:64] FLAG: --register-with-taints=""
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547061    2568 flags.go:64] FLAG: --registry-burst="10"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547064    2568 flags.go:64] FLAG: --registry-qps="5"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547067    2568 flags.go:64] FLAG: --reserved-cpus=""
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547070    2568 flags.go:64] FLAG: --reserved-memory=""
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547073    2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547077    2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 15 09:07:04.554718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547080    2568 flags.go:64] FLAG: --rotate-certificates="false"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547083    2568 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547085    2568 flags.go:64] FLAG: --runonce="false"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547088    2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547091    2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547094    2568 flags.go:64] FLAG: --seccomp-default="false"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547097    2568 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547100    2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547103    2568 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547107    2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547110    2568 flags.go:64] FLAG: --storage-driver-password="root"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547113    2568 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547116    2568 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547119    2568 flags.go:64] FLAG: --storage-driver-user="root"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547122    2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547125    2568 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547128    2568 flags.go:64] FLAG: --system-cgroups=""
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547131    2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547137    2568 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547140    2568 flags.go:64] FLAG: --tls-cert-file=""
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547143    2568 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547146    2568 flags.go:64] FLAG: --tls-min-version=""
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547150    2568 flags.go:64] FLAG: --tls-private-key-file=""
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547153    2568 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547156    2568 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 15 09:07:04.555405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547159    2568 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547162    2568 flags.go:64] FLAG: --v="2"
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547166    2568 flags.go:64] FLAG: --version="false"
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547169    2568 flags.go:64] FLAG: --vmodule=""
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547174    2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547177    2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547297    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547301    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547304    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547307    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547310    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547313    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547316    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547318    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547321    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547324    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547328    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547331    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547334    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547337    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547341    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:07:04.556032 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547343    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547346    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547350    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547354    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547357    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547359    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547362    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547365    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547369    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547372    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547375    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547377    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547381    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547384    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547387    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547389    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547392    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547395    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547397    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:07:04.556596 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547400    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547403    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547405    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547408    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547410    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547413    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547417    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547421    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547425    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547428    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547431    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547433    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547436    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547439    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547442    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547445    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547447    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547450    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547453    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547455    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:07:04.557119 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547458    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547462    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547465    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547467    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547470    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547472    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547475    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547478    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547480    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547483    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547485    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547488    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547491    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547493    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547496    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547498    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547501    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547503    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547506    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547508    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:07:04.557613 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547512    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547516    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547520    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547523    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547526    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547529    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547532    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547535    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547538    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547541    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547543    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547546    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547549    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547554    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547556    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547559    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547562    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547565    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547567    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547570    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:07:04.558117 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547572    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547575    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547577    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547580    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.547583    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.547588    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.555324    2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.555337    2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.556233    2568 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.556241    2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556296    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556301    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556305    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556309    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:07:04.558610 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556312    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556315    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556318    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556321    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556323    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556327    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556330    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556332    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556335    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556338    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556341    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556344    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556347    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556350    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556353    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556356    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556358    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556361    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556363    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556366    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:07:04.558982 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556368    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556371    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556373    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556376    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556378    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556381    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556383    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556386    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556388    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556391    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556393    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556396    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556399    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556402    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556404    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556407    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556409    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556412    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556423    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556427    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:07:04.559468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556430    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556432    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556437    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556440    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556444    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556447    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556450    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556454    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556456    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556459    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556462    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556464    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556467    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556470    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556472    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556475    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556478    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556480    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556483    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:07:04.560073 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556486    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556488    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556491    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556493    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556496    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556498    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556501    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556503    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556506    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556508    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556511    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556513    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556516    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556518    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556521    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556524    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556526    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556529    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556531    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556534    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:07:04.560549 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556537    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556540    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556543    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556545    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556549    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556553    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556556    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556559    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556563    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556566    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556569    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556571    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556574    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556576    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556579    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:07:04.561155 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556581    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.556586    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556701    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556705    2568 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556708    2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556711    2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556714    2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556717    2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556719    2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556722    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556725    2568 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556728    2568 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556731    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556733    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556736    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 15 09:07:04.561510 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556739    2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556741    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556744    2568 feature_gate.go:328] unrecognized feature gate: Example2
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556746    2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556750    2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556752    2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556755    2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556758    2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556760    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556762    2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556765    2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556767    2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556770    2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556772    2568 feature_gate.go:328] unrecognized feature gate: Example
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556775    2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556778    2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556782    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556785    2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556788    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 15 09:07:04.561907 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556790    2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556793    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556796    2568 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556799    2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556802    2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556804    2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556807    2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556810    2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556813    2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556815    2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556818    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556821    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556823    2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556826    2568 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556828    2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556831    2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556837    2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556863    2568 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556866    2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556869    2568 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 15 09:07:04.562369 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556872    2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556874    2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556877    2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556880    2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556883    2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556886    2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556888    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556891    2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556894    2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556896    2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556899    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556901    2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556904    2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556907    2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556909    2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556912    2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556914    2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556917    2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556920    2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556922    2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 15 09:07:04.562868 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556925    2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556927    2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556929    2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556932    2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556935    2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556939    2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556942    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556945    2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556950    2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556953    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556956    2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556959    2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556962    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556964    2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556967    2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556970    2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556972    2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556975    2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556977    2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556980    2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 15 09:07:04.563372 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556982    2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556985    2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556987    2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556990    2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556992    2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556995    2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:04.556998    2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.557003    2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.557098    2568 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.559569    2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.560719    2568 server.go:1019] "Starting client certificate rotation"
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.560821    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 09:07:04.563905 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.560873    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 15 09:07:04.564207 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.563930    2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 09:07:04.570525 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.570504    2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 15 09:07:04.584327 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.584309    2568 log.go:25] "Validated CRI v1 runtime API"
Sep 15 09:07:04.587639 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.587625    2568 log.go:25] "Validated CRI v1 image API"
Sep 15 09:07:04.588541 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.588527    2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 15 09:07:04.592022 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.591996    2568 fs.go:135] Filesystem UUIDs: map[10c7b9e2-81b3-4462-9bc6-836731fc15ec:/dev/nvme0n1p3 55feda29-944c-4084-8129-993da00537a9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2]
Sep 15 09:07:04.592102 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.592018    2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 15 09:07:04.594273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.594252    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 09:07:04.597540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.597425    2568 manager.go:216] Machine: {Timestamp:2026-09-15 09:07:04.596031637 +0000 UTC m=+0.359603076 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099262 MemoryCapacity:32812154880 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26e1336d304883bf68a3c8db88f06d SystemUUID:ec26e133-6d30-4883-bf68-a3c8db88f06d BootID:27dea870-093f-4937-9f9e-8d7d7c98240c Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406077440 Type:vfs Inodes:4005390 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562430976 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406077440 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ff:ef:b9:d5:77 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ff:ef:b9:d5:77 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:de:52:6e:b3:7d:b5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812154880 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 15 09:07:04.597540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.597535    2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 15 09:07:04.597647 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.597622    2568 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 15 09:07:04.602457 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.602175    2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 15 09:07:04.603761 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.602698    2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-185.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 15 09:07:04.604531 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.604519    2568 topology_manager.go:138] "Creating topology manager with none policy"
Sep 15 09:07:04.604565 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.604534    2568 container_manager_linux.go:309] "Creating device plugin manager"
Sep 15 09:07:04.604565 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.604543    2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 09:07:04.605435 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.605420    2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 15 09:07:04.606724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.606712    2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 15 09:07:04.612437 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.612410    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 09:07:04.612600 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.612590    2568 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 15 09:07:04.613416 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.613400    2568 kubelet.go:486] "Attempting to sync node with API server"
Sep 15 09:07:04.613449 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.613429    2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 15 09:07:04.613486 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.613458    2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 15 09:07:04.613486 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.613472    2568 kubelet.go:398] "Adding apiserver pod source"
Sep 15 09:07:04.613542 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.613485    2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 15 09:07:04.613939 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.613927    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 09:07:04.613977 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.613949    2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 15 09:07:04.616538 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.616520    2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 15 09:07:04.619494 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.619478    2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 15 09:07:04.619568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.619510    2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 15 09:07:04.619928 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.619903    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bdfrb"
Sep 15 09:07:04.621507 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621495    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621511    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621525    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621531    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621540    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621546    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621560    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621565    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621572    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 15 09:07:04.621545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621578    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 15 09:07:04.621821 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621598    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 15 09:07:04.621821 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.621603    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 15 09:07:04.622554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.622541    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 15 09:07:04.622554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.622551    2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 15 09:07:04.623647 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.623616    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-185.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 15 09:07:04.623729 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.623648    2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 15 09:07:04.626495 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.626482    2568 server.go:1268] "Started kubelet"
Sep 15 09:07:04.626615 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.626589    2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 15 09:07:04.626663 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.626582    2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 15 09:07:04.626663 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.626636    2568 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 15 09:07:04.631375 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.631161    2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 15 09:07:04.631706 ip-10-0-141-185 systemd[1]: Started Kubernetes Kubelet.
Sep 15 09:07:04.632526 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.632279    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bdfrb"
Sep 15 09:07:04.634794 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.634774    2568 server.go:310] "Adding debug handlers to kubelet server"
Sep 15 09:07:04.636377 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.636356    2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 15 09:07:04.636574 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.636558    2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-185.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 15 09:07:04.637743 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.636627    2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-185.ec2.internal.18d57352627c15d7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-185.ec2.internal,UID:ip-10-0-141-185.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-185.ec2.internal,},FirstTimestamp:2026-09-15 09:07:04.626451927 +0000 UTC m=+0.390023414,LastTimestamp:2026-09-15 09:07:04.626451927 +0000 UTC m=+0.390023414,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-185.ec2.internal,}"
Sep 15 09:07:04.642096 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.642079    2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 15 09:07:04.642799 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.642784    2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 15 09:07:04.642928 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.642909    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:04.643587 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.643572    2568 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 15 09:07:04.643664 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.643590    2568 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 15 09:07:04.643664 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.643571    2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 15 09:07:04.643738 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.643701    2568 reconstruct.go:97] "Volume reconstruction finished"
Sep 15 09:07:04.643738 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.643710    2568 reconciler.go:29] "Reconciler: start to sync state"
Sep 15 09:07:04.643860 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.643824    2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 15 09:07:04.643860 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.643860    2568 factory.go:55] Registering systemd factory
Sep 15 09:07:04.643970 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.643869    2568 factory.go:223] Registration of the systemd container factory successfully
Sep 15 09:07:04.644105 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.644093    2568 factory.go:153] Registering CRI-O factory
Sep 15 09:07:04.644154 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.644107    2568 factory.go:223] Registration of the crio container factory successfully
Sep 15 09:07:04.644154 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.644120    2568 factory.go:103] Registering Raw factory
Sep 15 09:07:04.644154 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.644129    2568 manager.go:1196] Started watching for new ooms in manager
Sep 15 09:07:04.644467 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.644455    2568 manager.go:349] Starting recovery of all containers
Sep 15 09:07:04.644654 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.644637    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:07:04.646864 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.646798    2568 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-185.ec2.internal\" not found" node="ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.654231 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.654213    2568 manager.go:354] Recovery completed
Sep 15 09:07:04.658440 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.658427    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:07:04.660438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.660414    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:07:04.660508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.660451    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:07:04.660508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.660461    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:07:04.661058 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.661046    2568 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 15 09:07:04.661110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.661058    2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 15 09:07:04.661110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.661074    2568 state_mem.go:36] "Initialized new in-memory state store"
Sep 15 09:07:04.661110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.661076    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:07:04.661740 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.661727    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:07:04.661802 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.661752    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:07:04.661802 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.661762    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:07:04.663212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.663190    2568 policy_none.go:49] "None policy: Start"
Sep 15 09:07:04.663212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.663207    2568 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 15 09:07:04.663308 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.663217    2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 15 09:07:04.665178 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.665166    2568 policy_none.go:47] "Start"
Sep 15 09:07:04.709476 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.709460    2568 manager.go:337] "Starting Device Plugin manager"
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.709510    2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.709522    2568 server.go:87] "Starting device plugin registration server"
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.709866    2568 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.709881    2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.709979    2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.710058    2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.710067    2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.710626    2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 15 09:07:04.722217 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.710681    2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:04.777925 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.777888    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 15 09:07:04.779254 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.779229    2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 15 09:07:04.779365 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.779289    2568 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 15 09:07:04.779365 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.779321    2568 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 15 09:07:04.779463 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.779424    2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 15 09:07:04.781450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.781430    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:07:04.810496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.810408    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:07:04.811262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.811243    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:07:04.811351 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.811274    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:07:04.811351 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.811289    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:07:04.811351 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.811314    2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.819144 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.819130    2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.819221 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.819152    2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-185.ec2.internal\": node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:04.828136 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.828120    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:04.879680 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.879661    2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal"]
Sep 15 09:07:04.879770 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.879742    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:07:04.881106 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.881085    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:07:04.881189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.881124    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:07:04.881189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.881139    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:07:04.883456 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.883445    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:07:04.883594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.883569    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.883675 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.883597    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:07:04.884150 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.884133    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:07:04.884222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.884167    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:07:04.884222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.884179    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:07:04.884222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.884139    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:07:04.884309 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.884234    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:07:04.884309 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.884255    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:07:04.886497 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.886482    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.886561 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.886506    2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 15 09:07:04.887200 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.887184    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientMemory"
Sep 15 09:07:04.887285 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.887207    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasNoDiskPressure"
Sep 15 09:07:04.887285 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.887216    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeHasSufficientPID"
Sep 15 09:07:04.905392 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.905375    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-185.ec2.internal\" not found" node="ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.909702 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.909684    2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-185.ec2.internal\" not found" node="ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.928542 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:04.928523    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:04.944906 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.944889    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ae9783e5e544859626d5a53f1ccb92a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal\" (UID: \"7ae9783e5e544859626d5a53f1ccb92a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.944955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.944911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae9783e5e544859626d5a53f1ccb92a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal\" (UID: \"7ae9783e5e544859626d5a53f1ccb92a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:04.944955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:04.944927    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b75d22eafcad6f42168b54bcbeb68b91-config\") pod \"kube-apiserver-proxy-ip-10-0-141-185.ec2.internal\" (UID: \"b75d22eafcad6f42168b54bcbeb68b91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.029193 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.029167    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.045544 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.045515    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae9783e5e544859626d5a53f1ccb92a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal\" (UID: \"7ae9783e5e544859626d5a53f1ccb92a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.045544 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.045547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b75d22eafcad6f42168b54bcbeb68b91-config\") pod \"kube-apiserver-proxy-ip-10-0-141-185.ec2.internal\" (UID: \"b75d22eafcad6f42168b54bcbeb68b91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.045744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.045564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ae9783e5e544859626d5a53f1ccb92a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal\" (UID: \"7ae9783e5e544859626d5a53f1ccb92a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.045744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.045639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b75d22eafcad6f42168b54bcbeb68b91-config\") pod \"kube-apiserver-proxy-ip-10-0-141-185.ec2.internal\" (UID: \"b75d22eafcad6f42168b54bcbeb68b91\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.045744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.045639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7ae9783e5e544859626d5a53f1ccb92a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal\" (UID: \"7ae9783e5e544859626d5a53f1ccb92a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.045744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.045667    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/7ae9783e5e544859626d5a53f1ccb92a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal\" (UID: \"7ae9783e5e544859626d5a53f1ccb92a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.129985 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.129901    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.208388 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.208356    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.212254 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.212234    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:05.230950 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.230925    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.331477 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.331441    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.432011 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.431985    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.532659 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.532630    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.560156 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.560135    2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 15 09:07:05.560577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.560260    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 09:07:05.560577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.560310    2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 15 09:07:05.595848 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.595823    2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:07:05.633542 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.633520    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.638744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.638717    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-14 09:02:05 +0000 UTC" deadline="2028-06-03 16:08:23.934376916 +0000 UTC"
Sep 15 09:07:05.638744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.638744    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15055h1m18.295635703s"
Sep 15 09:07:05.734583 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.734522    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.797904 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:05.797865    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ae9783e5e544859626d5a53f1ccb92a.slice/crio-155214a17aab66cc64a1635c3828ff2d1752454b89753005bfbbda3051ec4625 WatchSource:0}: Error finding container 155214a17aab66cc64a1635c3828ff2d1752454b89753005bfbbda3051ec4625: Status 404 returned error can't find the container with id 155214a17aab66cc64a1635c3828ff2d1752454b89753005bfbbda3051ec4625
Sep 15 09:07:05.800918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:05.800900    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:07:05.834664 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.834638    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:05.925521 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:05.925491    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb75d22eafcad6f42168b54bcbeb68b91.slice/crio-11bb096cad1af34da01698e983315eadef3c45474e8a2c16c790cdcc0a09a6af WatchSource:0}: Error finding container 11bb096cad1af34da01698e983315eadef3c45474e8a2c16c790cdcc0a09a6af: Status 404 returned error can't find the container with id 11bb096cad1af34da01698e983315eadef3c45474e8a2c16c790cdcc0a09a6af
Sep 15 09:07:05.934826 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:05.934806    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:06.035569 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.035469    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:06.136765 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.136718    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:06.243317 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.243280    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:06.348154 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.348058    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:06.446951 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.446920    2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:07:06.449035 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.449007    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:06.549986 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.549950    2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-185.ec2.internal\" not found"
Sep 15 09:07:06.564950 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.564918    2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:07:06.614487 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.614397    2568 apiserver.go:52] "Watching apiserver"
Sep 15 09:07:06.626240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.624460    2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 15 09:07:06.627538 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.627505    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7","openshift-multus/multus-mr97v","openshift-multus/network-metrics-daemon-8rxs2","openshift-network-diagnostics/network-check-target-djh2q","openshift-network-operator/iptables-alerter-sljdw","kube-system/global-pull-secret-syncer-g5zwg","kube-system/konnectivity-agent-jvgdb","openshift-cluster-node-tuning-operator/tuned-4rsfn","openshift-dns/node-resolver-jpcpb","openshift-image-registry/node-ca-xz2vc","openshift-multus/multus-additional-cni-plugins-s9szt","openshift-ovn-kubernetes/ovnkube-node-4xwgs"]
Sep 15 09:07:06.630423 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.630397    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.632694 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.632669    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.633537 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.633515    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 15 09:07:06.633620 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.633558    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 15 09:07:06.633712 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.633688    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 15 09:07:06.633833 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.633777    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-phrmm\""
Sep 15 09:07:06.635044 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.635018    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:06.635147 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.635080    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:06.636012 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.635993    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dhpt6\""
Sep 15 09:07:06.636114 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.636023    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 15 09:07:06.636114 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.636043    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 15 09:07:06.636346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.636327    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 15 09:07:06.636447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.636327    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 15 09:07:06.638111 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.638091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:06.638210 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.638163    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:06.640529 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.640508    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.642782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.642761    2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 15 09:07:06.643035 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.643015    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.643122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.643069    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:06.643122 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.643092    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:06.643243 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.643122    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:07:06.643303 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.643286    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 15 09:07:06.643361 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.643293    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 15 09:07:06.643748 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.643727    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-x29pp\""
Sep 15 09:07:06.645364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.645342    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:06.648137 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.647833    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.648420 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.648401    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 15 09:07:06.648420 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.648416    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 15 09:07:06.648608 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.648582    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pw5mb\""
Sep 15 09:07:06.651943 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.651299    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.651943 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.651809    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:07:06.652188 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.652170    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 15 09:07:06.652280 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.652267    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qpm6l\""
Sep 15 09:07:06.654517 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654140    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-lfc8t\""
Sep 15 09:07:06.654517 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654203    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 15 09:07:06.654680 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654519    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-netns\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.654680 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654555    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-daemon-config\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.654680 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654628    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f03ff181-7ce3-4846-915e-d4575ad8c86d-konnectivity-ca\") pod \"konnectivity-agent-jvgdb\" (UID: \"f03ff181-7ce3-4846-915e-d4575ad8c86d\") " pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:06.654680 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654660    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654697    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654713    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-kubelet-config\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-cni-bin\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654812    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-cni-multus\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654827    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-kubelet\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654841    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-hostroot\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.654908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654888    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-cnibin\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfdbfd7e-641f-4ef4-bcba-a565f7205787-cni-binary-copy\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-conf-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.654964    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-multus-certs\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655001    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/527b91a0-8590-48e3-8a86-3d3ef72321d6-iptables-alerter-script\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655037    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-device-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655038    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655063    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-sys-fs\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655082    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjslx\" (UniqueName: \"kubernetes.io/projected/0100e3f4-c2af-46cd-92f4-4822400b70f2-kube-api-access-tjslx\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-cni-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-socket-dir-parent\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655208    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f03ff181-7ce3-4846-915e-d4575ad8c86d-agent-certs\") pod \"konnectivity-agent-jvgdb\" (UID: \"f03ff181-7ce3-4846-915e-d4575ad8c86d\") " pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655223    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-registration-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655237    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-system-cni-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655273    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jcl5\" (UniqueName: \"kubernetes.io/projected/cfdbfd7e-641f-4ef4-bcba-a565f7205787-kube-api-access-8jcl5\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655302    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sh68t\" (UniqueName: \"kubernetes.io/projected/3affebbf-2c05-4dfc-9102-9c1711221bba-kube-api-access-sh68t\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655321    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/527b91a0-8590-48e3-8a86-3d3ef72321d6-host-slash\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.655364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-etc-kubernetes\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.656283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655383    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:06.656283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655398    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-socket-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.656283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-k8s-cni-cncf-io\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.656283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:06.656283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655441    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-dbus\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.656283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655467    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjgqc\" (UniqueName: \"kubernetes.io/projected/527b91a0-8590-48e3-8a86-3d3ef72321d6-kube-api-access-tjgqc\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.656283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655306    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 09:07:06.656283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.655845    2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal"
Sep 15 09:07:06.657589 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.657562    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.658309 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.657667    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 15 09:07:06.658309 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.658093    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 15 09:07:06.659099 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.659081    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 15 09:07:06.659212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.659190    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vc2lf\""
Sep 15 09:07:06.659281 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.659258    2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 15 09:07:06.660523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.660503    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal"]
Sep 15 09:07:06.660723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.660709    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.662494 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.661647    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-9bc2l\""
Sep 15 09:07:06.662494 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.661711    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 15 09:07:06.662494 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.661753    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 15 09:07:06.663936 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.663893    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 15 09:07:06.664018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.663934    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 15 09:07:06.664160 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.664140    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 15 09:07:06.665176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.665153    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 15 09:07:06.665287 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.665188    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 15 09:07:06.665353 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.665306    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-s8d48\""
Sep 15 09:07:06.665785 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.665602    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 15 09:07:06.665785 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.665733    2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 15 09:07:06.665965 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.665942    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal"]
Sep 15 09:07:06.669077 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.669056    2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 15 09:07:06.688965 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.688888    2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-nj7dz"
Sep 15 09:07:06.697177 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.697153    2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-nj7dz"
Sep 15 09:07:06.744778 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.744660    2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 15 09:07:06.756033 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.755863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-run-netns\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756327    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-systemd\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756367    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-var-lib-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovn-node-metrics-cert\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-sys-fs\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756567    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-system-cni-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756738    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jcl5\" (UniqueName: \"kubernetes.io/projected/cfdbfd7e-641f-4ef4-bcba-a565f7205787-kube-api-access-8jcl5\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sh68t\" (UniqueName: \"kubernetes.io/projected/3affebbf-2c05-4dfc-9102-9c1711221bba-kube-api-access-sh68t\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756812    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/527b91a0-8590-48e3-8a86-3d3ef72321d6-host-slash\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756819    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-system-cni-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756837    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-sys-fs\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.756863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756840    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756929    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/527b91a0-8590-48e3-8a86-3d3ef72321d6-host-slash\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756909    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zbs6v\" (UniqueName: \"kubernetes.io/projected/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-kube-api-access-zbs6v\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.756985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-var-lib-kubelet\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-etc-kubernetes\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-system-cni-dir\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757083    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-kubernetes\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757149    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-sys\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-etc-kubernetes\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-host\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757246    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-tuned\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757278    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-systemd-units\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757306    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-log-socket\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-socket-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757366    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-k8s-cni-cncf-io\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757394    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757421    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysconfig\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.757807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757450    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-dbus\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757478    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3ac22ec-26d7-4931-877b-e458578e0266-host\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757506    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-env-overrides\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757537    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-daemon-config\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757566    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f03ff181-7ce3-4846-915e-d4575ad8c86d-konnectivity-ca\") pod \"konnectivity-agent-jvgdb\" (UID: \"f03ff181-7ce3-4846-915e-d4575ad8c86d\") " pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gfvk\" (UniqueName: \"kubernetes.io/projected/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-kube-api-access-9gfvk\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-node-log\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757652    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovnkube-config\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757684    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757724    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-cni-multus\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757753    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mvqxk\" (UniqueName: \"kubernetes.io/projected/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-kube-api-access-mvqxk\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757781    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-lib-modules\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757809    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-cnibin\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757838    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfdbfd7e-641f-4ef4-bcba-a565f7205787-cni-binary-copy\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757867    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-conf-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757897    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-multus-certs\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757953    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpzhv\" (UniqueName: \"kubernetes.io/projected/99c61bfb-71bd-4d37-b343-89b569e86fd2-kube-api-access-kpzhv\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.758735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.757985    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bf7bv\" (UniqueName: \"kubernetes.io/projected/e3ac22ec-26d7-4931-877b-e458578e0266-kube-api-access-bf7bv\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758013    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-slash\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758042    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-systemd\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-run\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-device-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758152    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjslx\" (UniqueName: \"kubernetes.io/projected/0100e3f4-c2af-46cd-92f4-4822400b70f2-kube-api-access-tjslx\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758181    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-cni-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-socket-dir-parent\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758214    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-socket-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758243    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f03ff181-7ce3-4846-915e-d4575ad8c86d-agent-certs\") pod \"konnectivity-agent-jvgdb\" (UID: \"f03ff181-7ce3-4846-915e-d4575ad8c86d\") " pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758266    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-k8s-cni-cncf-io\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758274    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysctl-conf\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-registration-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758353    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3ac22ec-26d7-4931-877b-e458578e0266-serviceca\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758381    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-kubelet\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758410    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovnkube-script-lib\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758443    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:06.759638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758506    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cni-binary-copy\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758524    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-ovn\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-dbus\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758564    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-cni-netd\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.758612    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjgqc\" (UniqueName: \"kubernetes.io/projected/527b91a0-8590-48e3-8a86-3d3ef72321d6-kube-api-access-tjgqc\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.759116    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759156    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-cni-multus\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.759203    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret podName:ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:07.259158749 +0000 UTC m=+3.022730180 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret") pod "global-pull-secret-syncer-g5zwg" (UID: "ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759238    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-cnibin\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759237    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-daemon-config\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759280    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-socket-dir-parent\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759388    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-modprobe-d\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759421    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-etc-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-cni-bin\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.759492    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759527    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-netns\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.760389 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.759532    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs podName:3affebbf-2c05-4dfc-9102-9c1711221bba nodeName:}" failed. No retries permitted until 2026-09-15 09:07:07.259520001 +0000 UTC m=+3.023091429 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs") pod "network-metrics-daemon-8rxs2" (UID: "3affebbf-2c05-4dfc-9102-9c1711221bba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759569    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-cni-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-netns\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759599    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759630    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-tmp\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759646    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99c61bfb-71bd-4d37-b343-89b569e86fd2-hosts-file\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759661    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c61bfb-71bd-4d37-b343-89b569e86fd2-tmp-dir\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759678    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759714    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759731    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759748    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-kubelet-config\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759763    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-cni-bin\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-kubelet\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759796    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-hostroot\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759795    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/cfdbfd7e-641f-4ef4-bcba-a565f7205787-cni-binary-copy\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759812    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/527b91a0-8590-48e3-8a86-3d3ef72321d6-iptables-alerter-script\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759830    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cnibin\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.761203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759889    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-multus-conf-dir\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-etc-selinux\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759952    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-kubelet-config\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759965    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-run-multus-certs\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.759978    2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760007    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-registration-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760011    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-kubelet\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760047    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-hostroot\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760058    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysctl-d\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760122    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760247    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/0100e3f4-c2af-46cd-92f4-4822400b70f2-device-dir\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760347    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cfdbfd7e-641f-4ef4-bcba-a565f7205787-host-var-lib-cni-bin\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760491    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/527b91a0-8590-48e3-8a86-3d3ef72321d6-iptables-alerter-script\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.761725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.760560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f03ff181-7ce3-4846-915e-d4575ad8c86d-konnectivity-ca\") pod \"konnectivity-agent-jvgdb\" (UID: \"f03ff181-7ce3-4846-915e-d4575ad8c86d\") " pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:06.764385 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.764328    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f03ff181-7ce3-4846-915e-d4575ad8c86d-agent-certs\") pod \"konnectivity-agent-jvgdb\" (UID: \"f03ff181-7ce3-4846-915e-d4575ad8c86d\") " pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:06.770116 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.769973    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:06.770116 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.769997    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:06.770116 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.770026    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rbvvs for pod openshift-network-diagnostics/network-check-target-djh2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:06.770116 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:06.770089    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs podName:9dc528b9-79bc-4122-93cc-06d6e466d3e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:07.270071486 +0000 UTC m=+3.033642920 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-rbvvs" (UniqueName: "kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs") pod "network-check-target-djh2q" (UID: "9dc528b9-79bc-4122-93cc-06d6e466d3e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:06.772677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.772293    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sh68t\" (UniqueName: \"kubernetes.io/projected/3affebbf-2c05-4dfc-9102-9c1711221bba-kube-api-access-sh68t\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:06.773153 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.773098    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jcl5\" (UniqueName: \"kubernetes.io/projected/cfdbfd7e-641f-4ef4-bcba-a565f7205787-kube-api-access-8jcl5\") pod \"multus-mr97v\" (UID: \"cfdbfd7e-641f-4ef4-bcba-a565f7205787\") " pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.775389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.775318    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjgqc\" (UniqueName: \"kubernetes.io/projected/527b91a0-8590-48e3-8a86-3d3ef72321d6-kube-api-access-tjgqc\") pod \"iptables-alerter-sljdw\" (UID: \"527b91a0-8590-48e3-8a86-3d3ef72321d6\") " pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.775863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.775821    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjslx\" (UniqueName: \"kubernetes.io/projected/0100e3f4-c2af-46cd-92f4-4822400b70f2-kube-api-access-tjslx\") pod \"aws-ebs-csi-driver-node-9jfs7\" (UID: \"0100e3f4-c2af-46cd-92f4-4822400b70f2\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.786679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.786635    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal" event={"ID":"b75d22eafcad6f42168b54bcbeb68b91","Type":"ContainerStarted","Data":"11bb096cad1af34da01698e983315eadef3c45474e8a2c16c790cdcc0a09a6af"}
Sep 15 09:07:06.789326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.789300    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal" event={"ID":"7ae9783e5e544859626d5a53f1ccb92a","Type":"ContainerStarted","Data":"155214a17aab66cc64a1635c3828ff2d1752454b89753005bfbbda3051ec4625"}
Sep 15 09:07:06.861329 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861288    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-modprobe-d\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.861510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861337    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-etc-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.861510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861407    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-etc-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.861510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-cni-bin\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.861510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861482    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.861510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-modprobe-d\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.861773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861516    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-tmp\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.861773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861600    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99c61bfb-71bd-4d37-b343-89b569e86fd2-hosts-file\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.861773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861634    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c61bfb-71bd-4d37-b343-89b569e86fd2-tmp-dir\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.861773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.861773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cnibin\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.861773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861721    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysctl-d\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.861773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861744    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-run-netns\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.861773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861768    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-systemd\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861793    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-var-lib-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861819    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861858    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovn-node-metrics-cert\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861901    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861482    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-cni-bin\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861933    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.861995    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-systemd\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862006    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-run-netns\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862037    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-var-lib-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862073    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-openvswitch\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862183    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.862652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-tuning-conf-dir\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.862652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862246    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/99c61bfb-71bd-4d37-b343-89b569e86fd2-hosts-file\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.862652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862568    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/99c61bfb-71bd-4d37-b343-89b569e86fd2-tmp-dir\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.862652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862605    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.862652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862640    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zbs6v\" (UniqueName: \"kubernetes.io/projected/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-kube-api-access-zbs6v\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysctl-d\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-var-lib-kubelet\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862737    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-system-cni-dir\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-kubernetes\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862772    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-sys\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862788    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-host\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-tuned\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862821    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-systemd-units\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862837    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-log-socket\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysconfig\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862884    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3ac22ec-26d7-4931-877b-e458578e0266-host\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-env-overrides\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.862998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862982    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gfvk\" (UniqueName: \"kubernetes.io/projected/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-kube-api-access-9gfvk\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863015    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-node-log\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovnkube-config\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863095    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mvqxk\" (UniqueName: \"kubernetes.io/projected/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-kube-api-access-mvqxk\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863123    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-lib-modules\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kpzhv\" (UniqueName: \"kubernetes.io/projected/99c61bfb-71bd-4d37-b343-89b569e86fd2-kube-api-access-kpzhv\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863185    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bf7bv\" (UniqueName: \"kubernetes.io/projected/e3ac22ec-26d7-4931-877b-e458578e0266-kube-api-access-bf7bv\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863203    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-slash\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863227    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-systemd\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-run\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863264    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysctl-conf\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863293    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3ac22ec-26d7-4931-877b-e458578e0266-serviceca\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-kubelet\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863348    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovnkube-script-lib\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863392    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.862754    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-var-lib-kubelet\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863425    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cni-binary-copy\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.863744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863470    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-ovn\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-kubernetes\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863501    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-cni-netd\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863540    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-sys\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863582    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cnibin\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863595    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-cni-netd\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863636    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-system-cni-dir\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863671    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-systemd-units\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863712    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-log-socket\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863756    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysconfig\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-run-ovn\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863728    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-lib-modules\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.863978    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-cni-binary-copy\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864031    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e3ac22ec-26d7-4931-877b-e458578e0266-host\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864343    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovnkube-config\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864428    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-env-overrides\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.864612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864517    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-node-log\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864619    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-kubelet\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864665    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-sysctl-conf\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864711    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-slash\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864782    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-systemd\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864845    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-run\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864890    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-host-run-ovn-kubernetes\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.864955    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-host\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.865075    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e3ac22ec-26d7-4931-877b-e458578e0266-serviceca\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.865455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.865344    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovnkube-script-lib\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.865945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.865631    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-ovn-node-metrics-cert\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.866985 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.866959    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-etc-tuned\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.872298 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.872271    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-tmp\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.873968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.873839    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zbs6v\" (UniqueName: \"kubernetes.io/projected/9ea37f1c-c822-4eca-b5c3-c9ef40af8a29-kube-api-access-zbs6v\") pod \"multus-additional-cni-plugins-s9szt\" (UID: \"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29\") " pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:06.873968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.873931    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gfvk\" (UniqueName: \"kubernetes.io/projected/bf171d88-ec8e-434c-9e5b-9c3f31f347b1-kube-api-access-9gfvk\") pod \"tuned-4rsfn\" (UID: \"bf171d88-ec8e-434c-9e5b-9c3f31f347b1\") " pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.874638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.874589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mvqxk\" (UniqueName: \"kubernetes.io/projected/54a737bc-1b7e-4179-aa32-25daf9e9a3fb-kube-api-access-mvqxk\") pod \"ovnkube-node-4xwgs\" (UID: \"54a737bc-1b7e-4179-aa32-25daf9e9a3fb\") " pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:06.876392 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.876370    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bf7bv\" (UniqueName: \"kubernetes.io/projected/e3ac22ec-26d7-4931-877b-e458578e0266-kube-api-access-bf7bv\") pod \"node-ca-xz2vc\" (UID: \"e3ac22ec-26d7-4931-877b-e458578e0266\") " pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:06.876589 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.876560    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpzhv\" (UniqueName: \"kubernetes.io/projected/99c61bfb-71bd-4d37-b343-89b569e86fd2-kube-api-access-kpzhv\") pod \"node-resolver-jpcpb\" (UID: \"99c61bfb-71bd-4d37-b343-89b569e86fd2\") " pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:06.944357 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.944319    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7"
Sep 15 09:07:06.951192 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.950935    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-mr97v"
Sep 15 09:07:06.965821 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.965778    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-sljdw"
Sep 15 09:07:06.974920 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.974897    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:06.984850 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.984826    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-4rsfn"
Sep 15 09:07:06.994997 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:06.994970    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jpcpb"
Sep 15 09:07:07.003521 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.003499    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xz2vc"
Sep 15 09:07:07.012527 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.012506    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-s9szt"
Sep 15 09:07:07.020005 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.019936    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:07.267618 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.267583    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:07.267844 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.267629    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:07.267844 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.267762    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:07.267844 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.267773    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:07.267844 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.267831    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs podName:3affebbf-2c05-4dfc-9102-9c1711221bba nodeName:}" failed. No retries permitted until 2026-09-15 09:07:08.267810744 +0000 UTC m=+4.031382182 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs") pod "network-metrics-daemon-8rxs2" (UID: "3affebbf-2c05-4dfc-9102-9c1711221bba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:07.267844 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.267847    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret podName:ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:08.267840167 +0000 UTC m=+4.031411593 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret") pod "global-pull-secret-syncer-g5zwg" (UID: "ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:07.368955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.368916    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:07.369134 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.369094    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:07.369134 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.369121    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:07.369134 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.369134    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rbvvs for pod openshift-network-diagnostics/network-check-target-djh2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:07.369263 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.369200    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs podName:9dc528b9-79bc-4122-93cc-06d6e466d3e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:08.369184251 +0000 UTC m=+4.132755678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbvvs" (UniqueName: "kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs") pod "network-check-target-djh2q" (UID: "9dc528b9-79bc-4122-93cc-06d6e466d3e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:07.700731 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.700692    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:02:07 +0000 UTC" deadline="2028-06-16 21:49:57.033856122 +0000 UTC"
Sep 15 09:07:07.700731 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.700726    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15372h42m49.333135463s"
Sep 15 09:07:07.780159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:07.780128    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:07.780300 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:07.780277    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:08.091712 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:08.091554    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf171d88_ec8e_434c_9e5b_9c3f31f347b1.slice/crio-091515862db07cfa9ed5fba34da34481e63ddab9bcf9041740a6477aa70389d3 WatchSource:0}: Error finding container 091515862db07cfa9ed5fba34da34481e63ddab9bcf9041740a6477aa70389d3: Status 404 returned error can't find the container with id 091515862db07cfa9ed5fba34da34481e63ddab9bcf9041740a6477aa70389d3
Sep 15 09:07:08.120092 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:08.120062    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54a737bc_1b7e_4179_aa32_25daf9e9a3fb.slice/crio-0b43b69c3a4a4a552db4f303c4a6dd240b551e5531836c84302e90b1b5248f68 WatchSource:0}: Error finding container 0b43b69c3a4a4a552db4f303c4a6dd240b551e5531836c84302e90b1b5248f68: Status 404 returned error can't find the container with id 0b43b69c3a4a4a552db4f303c4a6dd240b551e5531836c84302e90b1b5248f68
Sep 15 09:07:08.121092 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:08.121069    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea37f1c_c822_4eca_b5c3_c9ef40af8a29.slice/crio-f8ee3f610cd8ab10f8ae114828d446659bf1dc58cca973d3d063d755be0248ad WatchSource:0}: Error finding container f8ee3f610cd8ab10f8ae114828d446659bf1dc58cca973d3d063d755be0248ad: Status 404 returned error can't find the container with id f8ee3f610cd8ab10f8ae114828d446659bf1dc58cca973d3d063d755be0248ad
Sep 15 09:07:08.127521 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:08.127497    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod99c61bfb_71bd_4d37_b343_89b569e86fd2.slice/crio-4e2da419b2eacc9c606ffb63ff6a4f717c602e1b7d505aa97c6b8459db6e05cd WatchSource:0}: Error finding container 4e2da419b2eacc9c606ffb63ff6a4f717c602e1b7d505aa97c6b8459db6e05cd: Status 404 returned error can't find the container with id 4e2da419b2eacc9c606ffb63ff6a4f717c602e1b7d505aa97c6b8459db6e05cd
Sep 15 09:07:08.132987 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:08.132962    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3ac22ec_26d7_4931_877b_e458578e0266.slice/crio-0aa9d48f2d18a46c32878860688d18feb66a10ce7d9040ae7db6bf5213c4baa7 WatchSource:0}: Error finding container 0aa9d48f2d18a46c32878860688d18feb66a10ce7d9040ae7db6bf5213c4baa7: Status 404 returned error can't find the container with id 0aa9d48f2d18a46c32878860688d18feb66a10ce7d9040ae7db6bf5213c4baa7
Sep 15 09:07:08.134533 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:08.134438    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf03ff181_7ce3_4846_915e_d4575ad8c86d.slice/crio-664a892266960e2a8de7dc83a507e3cb801bfc6bbabbfe6938c92e590313b25c WatchSource:0}: Error finding container 664a892266960e2a8de7dc83a507e3cb801bfc6bbabbfe6938c92e590313b25c: Status 404 returned error can't find the container with id 664a892266960e2a8de7dc83a507e3cb801bfc6bbabbfe6938c92e590313b25c
Sep 15 09:07:08.135622 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:08.135577    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfdbfd7e_641f_4ef4_bcba_a565f7205787.slice/crio-6611d1a2456f05a4e9174d33cf279fb7a0d53b7fb4939852cded9e72bf95623a WatchSource:0}: Error finding container 6611d1a2456f05a4e9174d33cf279fb7a0d53b7fb4939852cded9e72bf95623a: Status 404 returned error can't find the container with id 6611d1a2456f05a4e9174d33cf279fb7a0d53b7fb4939852cded9e72bf95623a
Sep 15 09:07:08.276463 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.276420    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:08.276600 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.276511    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:08.276600 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.276566    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:08.276685 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.276625    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:08.276685 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.276644    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs podName:3affebbf-2c05-4dfc-9102-9c1711221bba nodeName:}" failed. No retries permitted until 2026-09-15 09:07:10.276625982 +0000 UTC m=+6.040197424 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs") pod "network-metrics-daemon-8rxs2" (UID: "3affebbf-2c05-4dfc-9102-9c1711221bba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:08.276685 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.276673    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret podName:ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:10.276660846 +0000 UTC m=+6.040232288 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret") pod "global-pull-secret-syncer-g5zwg" (UID: "ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:08.379779 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.377669    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:08.379779 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.377983    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:08.379779 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.378008    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:08.379779 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.378023    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rbvvs for pod openshift-network-diagnostics/network-check-target-djh2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:08.379779 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.378120    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs podName:9dc528b9-79bc-4122-93cc-06d6e466d3e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:10.378074391 +0000 UTC m=+6.141645836 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbvvs" (UniqueName: "kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs") pod "network-check-target-djh2q" (UID: "9dc528b9-79bc-4122-93cc-06d6e466d3e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:08.701959 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.701885    2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-14 09:02:07 +0000 UTC" deadline="2028-02-11 09:09:37.097783246 +0000 UTC"
Sep 15 09:07:08.701959 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.701950    2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12336h2m28.395837721s"
Sep 15 09:07:08.782232 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.781361    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:08.782232 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.781507    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:08.782753 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.782592    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:08.782753 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:08.782706    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:08.797487 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.797416    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sljdw" event={"ID":"527b91a0-8590-48e3-8a86-3d3ef72321d6","Type":"ContainerStarted","Data":"6395ec2326ba439ed24ac0b933bdf18bcfd1bf22088db01482b61e3ab7e225f1"}
Sep 15 09:07:08.800980 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.800944    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jvgdb" event={"ID":"f03ff181-7ce3-4846-915e-d4575ad8c86d","Type":"ContainerStarted","Data":"664a892266960e2a8de7dc83a507e3cb801bfc6bbabbfe6938c92e590313b25c"}
Sep 15 09:07:08.806336 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.806259    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpcpb" event={"ID":"99c61bfb-71bd-4d37-b343-89b569e86fd2","Type":"ContainerStarted","Data":"4e2da419b2eacc9c606ffb63ff6a4f717c602e1b7d505aa97c6b8459db6e05cd"}
Sep 15 09:07:08.808368 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.808293    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerStarted","Data":"f8ee3f610cd8ab10f8ae114828d446659bf1dc58cca973d3d063d755be0248ad"}
Sep 15 09:07:08.810521 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.810491    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4rsfn" event={"ID":"bf171d88-ec8e-434c-9e5b-9c3f31f347b1","Type":"ContainerStarted","Data":"091515862db07cfa9ed5fba34da34481e63ddab9bcf9041740a6477aa70389d3"}
Sep 15 09:07:08.814641 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.814611    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal" event={"ID":"b75d22eafcad6f42168b54bcbeb68b91","Type":"ContainerStarted","Data":"67e19e4556a5a183a5aeff8ec9dfe615395538ba467d0b43b1036790bf44f215"}
Sep 15 09:07:08.818253 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.818226    2568 generic.go:356] "Generic (PLEG): container finished" podID="7ae9783e5e544859626d5a53f1ccb92a" containerID="2fbc138bc5e2db91541b45afc386a717670db29ec223005bb8bc8eac932e9963" exitCode=0
Sep 15 09:07:08.818363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.818300    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal" event={"ID":"7ae9783e5e544859626d5a53f1ccb92a","Type":"ContainerDied","Data":"2fbc138bc5e2db91541b45afc386a717670db29ec223005bb8bc8eac932e9963"}
Sep 15 09:07:08.822002 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.821914    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7" event={"ID":"0100e3f4-c2af-46cd-92f4-4822400b70f2","Type":"ContainerStarted","Data":"d6142d68771bd0dad8dab3c75547d516be31dfb2a529952bca7dbe60d8bb4740"}
Sep 15 09:07:08.825091 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.825018    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr97v" event={"ID":"cfdbfd7e-641f-4ef4-bcba-a565f7205787","Type":"ContainerStarted","Data":"6611d1a2456f05a4e9174d33cf279fb7a0d53b7fb4939852cded9e72bf95623a"}
Sep 15 09:07:08.832524 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.832461    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xz2vc" event={"ID":"e3ac22ec-26d7-4931-877b-e458578e0266","Type":"ContainerStarted","Data":"0aa9d48f2d18a46c32878860688d18feb66a10ce7d9040ae7db6bf5213c4baa7"}
Sep 15 09:07:08.835781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.835040    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"0b43b69c3a4a4a552db4f303c4a6dd240b551e5531836c84302e90b1b5248f68"}
Sep 15 09:07:08.848232 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:08.847622    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-185.ec2.internal" podStartSLOduration=1.847604702 podStartE2EDuration="1.847604702s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:08.831912322 +0000 UTC m=+4.595483775" watchObservedRunningTime="2026-09-15 09:07:08.847604702 +0000 UTC m=+4.611176155"
Sep 15 09:07:09.780431 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:09.780394    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:09.781135 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:09.780536    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:09.868067 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:09.867970    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal" event={"ID":"7ae9783e5e544859626d5a53f1ccb92a","Type":"ContainerStarted","Data":"fa648d1bfec2c9b13976e18e211eaced693d6c54bbf90f7e000340fb6c314ac2"}
Sep 15 09:07:09.887374 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:09.886951    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-185.ec2.internal" podStartSLOduration=2.886910642 podStartE2EDuration="2.886910642s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:09.886102006 +0000 UTC m=+5.649673470" watchObservedRunningTime="2026-09-15 09:07:09.886910642 +0000 UTC m=+5.650482096"
Sep 15 09:07:10.295673 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:10.295635    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:10.295855 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:10.295695    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:10.295855 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.295816    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:10.295855 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.295822    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:10.296063 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.295903    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs podName:3affebbf-2c05-4dfc-9102-9c1711221bba nodeName:}" failed. No retries permitted until 2026-09-15 09:07:14.295860924 +0000 UTC m=+10.059432367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs") pod "network-metrics-daemon-8rxs2" (UID: "3affebbf-2c05-4dfc-9102-9c1711221bba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:10.296063 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.295941    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret podName:ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:14.295913531 +0000 UTC m=+10.059484965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret") pod "global-pull-secret-syncer-g5zwg" (UID: "ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:10.396278 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:10.396234    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:10.396489 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.396469    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:10.396550 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.396505    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:10.396550 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.396521    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rbvvs for pod openshift-network-diagnostics/network-check-target-djh2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:10.396672 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.396589    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs podName:9dc528b9-79bc-4122-93cc-06d6e466d3e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:14.39656768 +0000 UTC m=+10.160139129 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbvvs" (UniqueName: "kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs") pod "network-check-target-djh2q" (UID: "9dc528b9-79bc-4122-93cc-06d6e466d3e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:10.783123 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:10.782607    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:10.783123 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.782751    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:10.783123 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:10.782607    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:10.783123 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:10.782970    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:11.779628 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:11.779588    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:11.779832 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:11.779773    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:12.781088 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:12.781053    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:12.781088 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:12.781091    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:12.781606 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:12.781203    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:12.781606 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:12.781325    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:13.780367 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:13.780329    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:13.780577 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:13.780472    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:14.331174 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:14.331138    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:14.331577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:14.331189    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:14.331577 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.331323    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:14.331577 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.331394    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs podName:3affebbf-2c05-4dfc-9102-9c1711221bba nodeName:}" failed. No retries permitted until 2026-09-15 09:07:22.331372646 +0000 UTC m=+18.094944097 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs") pod "network-metrics-daemon-8rxs2" (UID: "3affebbf-2c05-4dfc-9102-9c1711221bba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:14.331872 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.331834    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:14.331959 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.331900    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret podName:ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:22.331881561 +0000 UTC m=+18.095453011 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret") pod "global-pull-secret-syncer-g5zwg" (UID: "ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:14.431908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:14.431855    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:14.432123 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.432102    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:14.432123 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.432128    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:14.432271 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.432143    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rbvvs for pod openshift-network-diagnostics/network-check-target-djh2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:14.432271 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.432205    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs podName:9dc528b9-79bc-4122-93cc-06d6e466d3e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:22.432186816 +0000 UTC m=+18.195758249 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbvvs" (UniqueName: "kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs") pod "network-check-target-djh2q" (UID: "9dc528b9-79bc-4122-93cc-06d6e466d3e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:14.780742 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:14.780702    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:14.780962 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.780809    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:14.780962 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:14.780891    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:14.781077 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:14.780984    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:15.780418 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:15.780376    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:15.780857 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:15.780531    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:16.781099 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:16.780555    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:16.781099 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:16.780700    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:16.781614 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:16.781202    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:16.781614 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:16.781291    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:17.780296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:17.780262    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:17.780459 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:17.780380    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:18.780227 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:18.780189    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:18.780662 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:18.780345    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:18.780662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:18.780404    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:18.780662 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:18.780522    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:19.780262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:19.780228    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:19.780630 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:19.780332    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:20.779943 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:20.779905    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:20.780130 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:20.779919    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:20.780130 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:20.780059    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:20.780130 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:20.780116    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:21.780495 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:21.780451    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:21.781058 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:21.780583    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:22.396002 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:22.395958    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:22.396240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:22.396020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:22.396240 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.396119    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:22.396240 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.396152    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:22.396240 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.396193    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret podName:ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:38.396173986 +0000 UTC m=+34.159745421 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret") pod "global-pull-secret-syncer-g5zwg" (UID: "ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:22.396240 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.396210    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs podName:3affebbf-2c05-4dfc-9102-9c1711221bba nodeName:}" failed. No retries permitted until 2026-09-15 09:07:38.396202731 +0000 UTC m=+34.159774157 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs") pod "network-metrics-daemon-8rxs2" (UID: "3affebbf-2c05-4dfc-9102-9c1711221bba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:22.497059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:22.497017    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:22.497262 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.497215    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:22.497262 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.497242    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:22.497262 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.497255    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rbvvs for pod openshift-network-diagnostics/network-check-target-djh2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:22.497407 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.497322    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs podName:9dc528b9-79bc-4122-93cc-06d6e466d3e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:38.497303172 +0000 UTC m=+34.260874612 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbvvs" (UniqueName: "kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs") pod "network-check-target-djh2q" (UID: "9dc528b9-79bc-4122-93cc-06d6e466d3e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:22.779961 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:22.779926    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:22.780152 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.780045    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:22.780152 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:22.780097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:22.780266 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:22.780207    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:23.780533 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:23.780345    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:23.780991 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:23.780614    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:24.780688 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:24.780654    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:24.781105 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:24.780785    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:24.781105 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:24.780868    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:24.781105 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:24.780988    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:25.779790 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:25.779746    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:25.779998 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:25.779903    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:26.780418 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:26.780381    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:26.780922 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:26.780387    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:26.780922 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:26.780520    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:26.780922 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:26.780588    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:27.780436 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.780245    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:27.780966 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:27.780515    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:27.911961 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.911882    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"537601096a8d887d82503a693066b62f3fc215a2dfbc758255d6ff04abc0d0c5"}
Sep 15 09:07:27.912106 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.911982    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"dfd10c375b1309db40cbdba5af42aa696b2dc2cf757188aa01647174b0c4049b"}
Sep 15 09:07:27.912106 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.912032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"0a5c37bba57a4266aae6ce72ff253ef923f269f5ab270bfc93fd583f604887ff"}
Sep 15 09:07:27.912106 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.912078    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"08d54b81b5cd3c686a4039b33183509fb038ca20ecd2411608123267e384da92"}
Sep 15 09:07:27.912248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.912129    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"ca40efa75e5226505c6f45ad4ca57e11f5b5cf05cdba69345822893915d3700d"}
Sep 15 09:07:27.912248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.912177    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"41a3aa3a6c2dbc45ef66166b3173d2aca48f3d0bc23564c27cc681de3274bfb8"}
Sep 15 09:07:27.913907 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.913882    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-jvgdb" event={"ID":"f03ff181-7ce3-4846-915e-d4575ad8c86d","Type":"ContainerStarted","Data":"f3930b5cf77d36d2f14dc7c78908ea1b615eaa953fbb7d355bedba0a6dafda95"}
Sep 15 09:07:27.915381 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.915357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jpcpb" event={"ID":"99c61bfb-71bd-4d37-b343-89b569e86fd2","Type":"ContainerStarted","Data":"a44487c99662320f4e432bb5b16325438c5ad59bc50207dfd2df081162e6879f"}
Sep 15 09:07:27.916968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.916942    2568 generic.go:356] "Generic (PLEG): container finished" podID="9ea37f1c-c822-4eca-b5c3-c9ef40af8a29" containerID="0c836fc371bbc6fe106059378cf23e5683f6610e482fd2326475f4234106e25c" exitCode=0
Sep 15 09:07:27.917074 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.917022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerDied","Data":"0c836fc371bbc6fe106059378cf23e5683f6610e482fd2326475f4234106e25c"}
Sep 15 09:07:27.918729 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.918690    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-4rsfn" event={"ID":"bf171d88-ec8e-434c-9e5b-9c3f31f347b1","Type":"ContainerStarted","Data":"8f6831e03f59725a24acc50cb1f2ca22d35cd1169c3d4f37ceca9660cc4fadf1"}
Sep 15 09:07:27.920619 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.920598    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7" event={"ID":"0100e3f4-c2af-46cd-92f4-4822400b70f2","Type":"ContainerStarted","Data":"ea72c011d5d4f343a8995db6e7a83cf1885578f0046bb2317fa903f3f071f09a"}
Sep 15 09:07:27.922186 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.922151    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-mr97v" event={"ID":"cfdbfd7e-641f-4ef4-bcba-a565f7205787","Type":"ContainerStarted","Data":"1493b924a73edc7e9d950924dbed3eb2dcdc715fa72491a328326704cbd08507"}
Sep 15 09:07:27.925177 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.925154    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xz2vc" event={"ID":"e3ac22ec-26d7-4931-877b-e458578e0266","Type":"ContainerStarted","Data":"604e4bfc2470f9ab78c9d12abd12601066c883bdac018f215e3e53c6cd3c3823"}
Sep 15 09:07:27.928623 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.928590    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-jvgdb" podStartSLOduration=3.921942413 podStartE2EDuration="22.928578049s" totalImagesPullingTime="19.006635636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:27.928209247 +0000 UTC m=+23.691780696" watchObservedRunningTime="2026-09-15 09:07:27.928578049 +0000 UTC m=+23.692149497"
Sep 15 09:07:27.948881 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.948820    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-mr97v" podStartSLOduration=3.898998331 podStartE2EDuration="22.948804221s" totalImagesPullingTime="19.04980589s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:27.948254391 +0000 UTC m=+23.711825841" watchObservedRunningTime="2026-09-15 09:07:27.948804221 +0000 UTC m=+23.712375667"
Sep 15 09:07:27.966246 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.966202    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-4rsfn" podStartSLOduration=3.902765031 podStartE2EDuration="22.966187739s" totalImagesPullingTime="19.063422708s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:27.965712384 +0000 UTC m=+23.729283828" watchObservedRunningTime="2026-09-15 09:07:27.966187739 +0000 UTC m=+23.729759189"
Sep 15 09:07:27.980276 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.980212    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jpcpb" podStartSLOduration=3.967491446 podStartE2EDuration="22.980199923s" totalImagesPullingTime="19.012708477s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:27.979889897 +0000 UTC m=+23.743461345" watchObservedRunningTime="2026-09-15 09:07:27.980199923 +0000 UTC m=+23.743771370"
Sep 15 09:07:27.995030 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:27.994992    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xz2vc" podStartSLOduration=3.9941806140000002 podStartE2EDuration="22.994979682s" totalImagesPullingTime="19.000799068s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:27.994837175 +0000 UTC m=+23.758408634" watchObservedRunningTime="2026-09-15 09:07:27.994979682 +0000 UTC m=+23.758551130"
Sep 15 09:07:28.660026 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.660004    2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 15 09:07:28.723880 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.723783    2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-15T09:07:28.660021492Z","UUID":"095c40ad-8413-4ae6-8bd8-aa59bd360339","Handler":null,"Name":"","Endpoint":""}
Sep 15 09:07:28.727697 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.725696    2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 15 09:07:28.727697 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.725738    2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 15 09:07:28.780368 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.780344    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:28.780482 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:28.780460    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:28.781007 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.780496    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:28.781007 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:28.780585    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:28.929651 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.929614    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7" event={"ID":"0100e3f4-c2af-46cd-92f4-4822400b70f2","Type":"ContainerStarted","Data":"6942386c73132a829b077652b6f4514c6dfe293e23f3e00ab15523ff6d0e5fff"}
Sep 15 09:07:28.931443 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.931410    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-sljdw" event={"ID":"527b91a0-8590-48e3-8a86-3d3ef72321d6","Type":"ContainerStarted","Data":"a81faca5a0714eddbfdf6a024375bf3a72b1d85fb8effcac22fc273ec24928d7"}
Sep 15 09:07:28.945702 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:28.945652    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-sljdw" podStartSLOduration=4.933148829 podStartE2EDuration="23.945638468s" totalImagesPullingTime="19.012489639s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:28.945323662 +0000 UTC m=+24.708895115" watchObservedRunningTime="2026-09-15 09:07:28.945638468 +0000 UTC m=+24.709209940"
Sep 15 09:07:29.780280 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:29.780235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:29.780456 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:29.780414    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:29.939189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:29.939153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"db130f7f76e98fb7a0d2297b7e0973b215670b87310013bd150426644e46dadd"}
Sep 15 09:07:30.006029 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:30.005948    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:30.007085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:30.007058    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:30.779856 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:30.779806    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:30.780018 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:30.779940    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:30.780018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:30.779997    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:30.780102 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:30.780085    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:30.944599 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:30.944524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7" event={"ID":"0100e3f4-c2af-46cd-92f4-4822400b70f2","Type":"ContainerStarted","Data":"dc4d071f2081b6f87d697cd7946166dcce1f28008736662610147d248161c0c9"}
Sep 15 09:07:30.945024 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:30.944952    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:30.945508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:30.945481    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-jvgdb"
Sep 15 09:07:30.963818 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:30.963762    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9jfs7" podStartSLOduration=4.260208419 podStartE2EDuration="25.963743262s" totalImagesPullingTime="21.703534843s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:30.963083748 +0000 UTC m=+26.726655220" watchObservedRunningTime="2026-09-15 09:07:30.963743262 +0000 UTC m=+26.727314711"
Sep 15 09:07:31.780806 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:31.780581    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:31.781016 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:31.780929    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:32.783757 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:32.783730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:32.783757 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:32.783751    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:32.784163 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:32.783898    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:32.784163 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:32.783950    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:32.952323 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:32.952286    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" event={"ID":"54a737bc-1b7e-4179-aa32-25daf9e9a3fb","Type":"ContainerStarted","Data":"1b333fde88116d350789d38236d31826a679b37aade4cb4de9cc46e0af9ada5c"}
Sep 15 09:07:32.992636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:32.991910    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs" podStartSLOduration=8.871952765 podStartE2EDuration="27.991891543s" totalImagesPullingTime="19.119938778s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:32.991671262 +0000 UTC m=+28.755242710" watchObservedRunningTime="2026-09-15 09:07:32.991891543 +0000 UTC m=+28.755463004"
Sep 15 09:07:33.780079 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:33.779902    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:33.780236 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:33.780156    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:33.956319 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:33.956286    2568 generic.go:356] "Generic (PLEG): container finished" podID="9ea37f1c-c822-4eca-b5c3-c9ef40af8a29" containerID="9672f7604ab5fbaf6ca5ceb1ee0e4aa5eaa33b217638bb7efa19a543a1c92876" exitCode=0
Sep 15 09:07:33.956715 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:33.956374    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerDied","Data":"9672f7604ab5fbaf6ca5ceb1ee0e4aa5eaa33b217638bb7efa19a543a1c92876"}
Sep 15 09:07:33.956896 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:33.956858    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:33.956973 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:33.956938    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:33.957043 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:33.956989    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:33.972691 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:33.972663    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:33.976257 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:33.976238    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:07:34.713975 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:34.713934    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g5zwg"]
Sep 15 09:07:34.714112 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:34.714093    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:34.714235 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:34.714212    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:34.718864 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:34.717710    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8rxs2"]
Sep 15 09:07:34.718864 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:34.717917    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:34.718864 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:34.718153    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:34.718864 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:34.718432    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-djh2q"]
Sep 15 09:07:34.718864 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:34.718524    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:34.718864 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:34.718602    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:34.961999 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:34.961968    2568 generic.go:356] "Generic (PLEG): container finished" podID="9ea37f1c-c822-4eca-b5c3-c9ef40af8a29" containerID="9e6468f4d96bd424de24baf3e8d7f92fcc7775f6648eaa171d235ac2ec81a8d0" exitCode=0
Sep 15 09:07:34.962679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:34.962043    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerDied","Data":"9e6468f4d96bd424de24baf3e8d7f92fcc7775f6648eaa171d235ac2ec81a8d0"}
Sep 15 09:07:35.779523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:35.779500    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:35.779632 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:35.779595    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:35.967469 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:35.967437    2568 generic.go:356] "Generic (PLEG): container finished" podID="9ea37f1c-c822-4eca-b5c3-c9ef40af8a29" containerID="a454a395d7d148ccc9dde7c825807ec635fc9f65663db7817d0de97c35f8ce0d" exitCode=0
Sep 15 09:07:35.967816 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:35.967511    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerDied","Data":"a454a395d7d148ccc9dde7c825807ec635fc9f65663db7817d0de97c35f8ce0d"}
Sep 15 09:07:36.779746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:36.779522    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:36.779914 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:36.779580    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:36.779914 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:36.779781    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:36.779914 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:36.779835    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:37.779803 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:37.779761    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:37.780285 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:37.779925    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:38.414676 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:38.414406    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:38.414676 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:38.414504    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:38.414676 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.414546    2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:38.414676 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.414609    2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:38.414676 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.414618    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs podName:3affebbf-2c05-4dfc-9102-9c1711221bba nodeName:}" failed. No retries permitted until 2026-09-15 09:08:10.414600024 +0000 UTC m=+66.178171467 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs") pod "network-metrics-daemon-8rxs2" (UID: "3affebbf-2c05-4dfc-9102-9c1711221bba") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 15 09:07:38.414676 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.414655    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret podName:ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75 nodeName:}" failed. No retries permitted until 2026-09-15 09:08:10.414642703 +0000 UTC m=+66.178214128 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret") pod "global-pull-secret-syncer-g5zwg" (UID: "ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75") : object "kube-system"/"original-pull-secret" not registered
Sep 15 09:07:38.515296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:38.515263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:38.515469 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.515413    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 15 09:07:38.515469 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.515446    2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 15 09:07:38.515469 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.515459    2568 projected.go:196] Error preparing data for projected volume kube-api-access-rbvvs for pod openshift-network-diagnostics/network-check-target-djh2q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:38.515642 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.515520    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs podName:9dc528b9-79bc-4122-93cc-06d6e466d3e7 nodeName:}" failed. No retries permitted until 2026-09-15 09:08:10.515502248 +0000 UTC m=+66.279073676 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-rbvvs" (UniqueName: "kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs") pod "network-check-target-djh2q" (UID: "9dc528b9-79bc-4122-93cc-06d6e466d3e7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 15 09:07:38.786003 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:38.785928    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:38.786003 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:38.785974    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:38.786459 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.786064    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-8rxs2" podUID="3affebbf-2c05-4dfc-9102-9c1711221bba"
Sep 15 09:07:38.786459 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:38.786200    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-djh2q" podUID="9dc528b9-79bc-4122-93cc-06d6e466d3e7"
Sep 15 09:07:39.780275 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:39.780248    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:39.780420 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:39.780343    2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-g5zwg" podUID="ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75"
Sep 15 09:07:40.037932 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.037904    2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-185.ec2.internal" event="NodeReady"
Sep 15 09:07:40.038333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.038035    2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 15 09:07:40.087335 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.087303    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-tb9nd"]
Sep 15 09:07:40.107915 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.106699    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-k4gpd"]
Sep 15 09:07:40.107915 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.107677    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.110756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.110730    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 15 09:07:40.111363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.111004    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lb4vr\""
Sep 15 09:07:40.111363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.111168    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 15 09:07:40.115803 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.115787    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpcpb_99c61bfb-71bd-4d37-b343-89b569e86fd2/dns-node-resolver/0.log"
Sep 15 09:07:40.119649 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.119631    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tb9nd"]
Sep 15 09:07:40.119776 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.119669    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k4gpd"]
Sep 15 09:07:40.119776 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.119707    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xh9pz"]
Sep 15 09:07:40.119918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.119810    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.122788 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.122769    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 15 09:07:40.122927 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.122772    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 15 09:07:40.123106 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.123085    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 15 09:07:40.123506 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.123485    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rwr78\""
Sep 15 09:07:40.123613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.123526    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 15 09:07:40.133771 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.133750    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xh9pz"]
Sep 15 09:07:40.133891 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.133857    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xh9pz"
Sep 15 09:07:40.136682 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.136658    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 15 09:07:40.136782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.136728    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 15 09:07:40.136836 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.136788    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-2z5lh\""
Sep 15 09:07:40.137033 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.137015    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 15 09:07:40.228134 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228052    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d84ca7c-c39f-4083-986e-39aae6f63b36-config-volume\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.228134 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228100    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kfjct\" (UniqueName: \"kubernetes.io/projected/8d84ca7c-c39f-4083-986e-39aae6f63b36-kube-api-access-kfjct\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.228134 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228129    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/034d6e55-ea9d-4daa-beee-79acc09b4c8b-data-volume\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.228360 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228155    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.228360 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228222    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/034d6e55-ea9d-4daa-beee-79acc09b4c8b-crio-socket\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.228360 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228256    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-546wk\" (UniqueName: \"kubernetes.io/projected/034d6e55-ea9d-4daa-beee-79acc09b4c8b-kube-api-access-546wk\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.228360 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228297    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqq9g\" (UniqueName: \"kubernetes.io/projected/1fc6bc2b-a480-45e8-b599-7a7047c22563-kube-api-access-nqq9g\") pod \"ingress-canary-xh9pz\" (UID: \"1fc6bc2b-a480-45e8-b599-7a7047c22563\") " pod="openshift-ingress-canary/ingress-canary-xh9pz"
Sep 15 09:07:40.228360 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228331    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/034d6e55-ea9d-4daa-beee-79acc09b4c8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.228360 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228354    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d84ca7c-c39f-4083-986e-39aae6f63b36-tmp-dir\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.228545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228433    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fc6bc2b-a480-45e8-b599-7a7047c22563-cert\") pod \"ingress-canary-xh9pz\" (UID: \"1fc6bc2b-a480-45e8-b599-7a7047c22563\") " pod="openshift-ingress-canary/ingress-canary-xh9pz"
Sep 15 09:07:40.228545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.228466    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.329425 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329387    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/034d6e55-ea9d-4daa-beee-79acc09b4c8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.329425 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329429    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d84ca7c-c39f-4083-986e-39aae6f63b36-tmp-dir\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.329678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329478    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fc6bc2b-a480-45e8-b599-7a7047c22563-cert\") pod \"ingress-canary-xh9pz\" (UID: \"1fc6bc2b-a480-45e8-b599-7a7047c22563\") " pod="openshift-ingress-canary/ingress-canary-xh9pz"
Sep 15 09:07:40.329678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329498    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.329678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d84ca7c-c39f-4083-986e-39aae6f63b36-config-volume\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.329678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329564    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kfjct\" (UniqueName: \"kubernetes.io/projected/8d84ca7c-c39f-4083-986e-39aae6f63b36-kube-api-access-kfjct\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.329678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329587    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/034d6e55-ea9d-4daa-beee-79acc09b4c8b-data-volume\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.329678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329610    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.329678 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:40.329677    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:40.330050 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:40.329750    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls podName:8d84ca7c-c39f-4083-986e-39aae6f63b36 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:40.829730815 +0000 UTC m=+36.593302261 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls") pod "dns-default-tb9nd" (UID: "8d84ca7c-c39f-4083-986e-39aae6f63b36") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:40.330050 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:40.329680    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:40.330050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329894    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/034d6e55-ea9d-4daa-beee-79acc09b4c8b-crio-socket\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.330050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329930    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-546wk\" (UniqueName: \"kubernetes.io/projected/034d6e55-ea9d-4daa-beee-79acc09b4c8b-kube-api-access-546wk\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.330050 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:40.329958    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls podName:034d6e55-ea9d-4daa-beee-79acc09b4c8b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:40.829938455 +0000 UTC m=+36.593509899 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4gpd" (UID: "034d6e55-ea9d-4daa-beee-79acc09b4c8b") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:40.330050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.329962    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8d84ca7c-c39f-4083-986e-39aae6f63b36-tmp-dir\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.330050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.330004    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/034d6e55-ea9d-4daa-beee-79acc09b4c8b-data-volume\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.330050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.330021    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqq9g\" (UniqueName: \"kubernetes.io/projected/1fc6bc2b-a480-45e8-b599-7a7047c22563-kube-api-access-nqq9g\") pod \"ingress-canary-xh9pz\" (UID: \"1fc6bc2b-a480-45e8-b599-7a7047c22563\") " pod="openshift-ingress-canary/ingress-canary-xh9pz"
Sep 15 09:07:40.330328 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.330099    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/034d6e55-ea9d-4daa-beee-79acc09b4c8b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.330328 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.330145    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/034d6e55-ea9d-4daa-beee-79acc09b4c8b-crio-socket\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.330387 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.330372    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/8d84ca7c-c39f-4083-986e-39aae6f63b36-config-volume\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.334392 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.334372    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1fc6bc2b-a480-45e8-b599-7a7047c22563-cert\") pod \"ingress-canary-xh9pz\" (UID: \"1fc6bc2b-a480-45e8-b599-7a7047c22563\") " pod="openshift-ingress-canary/ingress-canary-xh9pz"
Sep 15 09:07:40.339705 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.339684    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-546wk\" (UniqueName: \"kubernetes.io/projected/034d6e55-ea9d-4daa-beee-79acc09b4c8b-kube-api-access-546wk\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.340581 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.340558    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kfjct\" (UniqueName: \"kubernetes.io/projected/8d84ca7c-c39f-4083-986e-39aae6f63b36-kube-api-access-kfjct\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.340683 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.340619    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqq9g\" (UniqueName: \"kubernetes.io/projected/1fc6bc2b-a480-45e8-b599-7a7047c22563-kube-api-access-nqq9g\") pod \"ingress-canary-xh9pz\" (UID: \"1fc6bc2b-a480-45e8-b599-7a7047c22563\") " pod="openshift-ingress-canary/ingress-canary-xh9pz"
Sep 15 09:07:40.443778 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.443747    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xh9pz"
Sep 15 09:07:40.779697 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.779615    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:07:40.779879 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.779821    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:07:40.784281 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.784257    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 09:07:40.784438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.784314    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 09:07:40.784438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.784362    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sxrmh\""
Sep 15 09:07:40.784566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.784481    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 09:07:40.784566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.784508    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwjtr\""
Sep 15 09:07:40.793345 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.793322    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-xtfnr"]
Sep 15 09:07:40.814689 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.814667    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-xtfnr"]
Sep 15 09:07:40.814807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.814762    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:40.817878 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.817855    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Sep 15 09:07:40.818182 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.818163    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-lpx64\""
Sep 15 09:07:40.818182 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.818179    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Sep 15 09:07:40.818315 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.818302    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Sep 15 09:07:40.818373 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.818361    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Sep 15 09:07:40.839732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.839678    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:40.839830 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.839794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:40.839881 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:40.839827    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:40.839917 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:40.839908    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls podName:8d84ca7c-c39f-4083-986e-39aae6f63b36 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:41.839892063 +0000 UTC m=+37.603463488 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls") pod "dns-default-tb9nd" (UID: "8d84ca7c-c39f-4083-986e-39aae6f63b36") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:40.839964 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:40.839919    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:40.839964 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:40.839956    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls podName:034d6e55-ea9d-4daa-beee-79acc09b4c8b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:41.839945793 +0000 UTC m=+37.603517219 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4gpd" (UID: "034d6e55-ea9d-4daa-beee-79acc09b4c8b") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:40.940764 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.940724    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x5pvg\" (UniqueName: \"kubernetes.io/projected/3e3f1648-4237-418d-9f77-2785267b6bdf-kube-api-access-x5pvg\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:40.940963 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.940937    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e3f1648-4237-418d-9f77-2785267b6bdf-signing-cabundle\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:40.941105 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:40.941063    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e3f1648-4237-418d-9f77-2785267b6bdf-signing-key\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:41.042141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.042060    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e3f1648-4237-418d-9f77-2785267b6bdf-signing-cabundle\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:41.042141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.042113    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e3f1648-4237-418d-9f77-2785267b6bdf-signing-key\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:41.042141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.042139    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x5pvg\" (UniqueName: \"kubernetes.io/projected/3e3f1648-4237-418d-9f77-2785267b6bdf-kube-api-access-x5pvg\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:41.042803 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.042778    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/3e3f1648-4237-418d-9f77-2785267b6bdf-signing-cabundle\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:41.045072 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.045045    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/3e3f1648-4237-418d-9f77-2785267b6bdf-signing-key\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:41.054765 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.054743    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x5pvg\" (UniqueName: \"kubernetes.io/projected/3e3f1648-4237-418d-9f77-2785267b6bdf-kube-api-access-x5pvg\") pod \"service-ca-568869fdc5-xtfnr\" (UID: \"3e3f1648-4237-418d-9f77-2785267b6bdf\") " pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:41.124109 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.124070    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-568869fdc5-xtfnr"
Sep 15 09:07:41.287593 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.287564    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xz2vc_e3ac22ec-26d7-4931-877b-e458578e0266/node-ca/0.log"
Sep 15 09:07:41.713538 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.713461    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xh9pz"]
Sep 15 09:07:41.718278 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:41.718250    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fc6bc2b_a480_45e8_b599_7a7047c22563.slice/crio-cabde9a383a2a5c9eb37dc0256c25c9e6cc3f43860242250f25bb13fa29ef13e WatchSource:0}: Error finding container cabde9a383a2a5c9eb37dc0256c25c9e6cc3f43860242250f25bb13fa29ef13e: Status 404 returned error can't find the container with id cabde9a383a2a5c9eb37dc0256c25c9e6cc3f43860242250f25bb13fa29ef13e
Sep 15 09:07:41.720694 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.720657    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-568869fdc5-xtfnr"]
Sep 15 09:07:41.723400 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:41.723377    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3f1648_4237_418d_9f77_2785267b6bdf.slice/crio-460641745d3a03f40d371553377f010d99365eb0c126f027bb17934673ba348b WatchSource:0}: Error finding container 460641745d3a03f40d371553377f010d99365eb0c126f027bb17934673ba348b: Status 404 returned error can't find the container with id 460641745d3a03f40d371553377f010d99365eb0c126f027bb17934673ba348b
Sep 15 09:07:41.779650 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.779621    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:07:41.783467 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.783442    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 09:07:41.848921 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.848715    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:41.849011 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:41.848884    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:41.849074 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.848983    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:41.849112 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:41.849070    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:41.849112 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:41.849086    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls podName:034d6e55-ea9d-4daa-beee-79acc09b4c8b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:43.849040911 +0000 UTC m=+39.612612776 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4gpd" (UID: "034d6e55-ea9d-4daa-beee-79acc09b4c8b") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:41.849112 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:41.849107    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls podName:8d84ca7c-c39f-4083-986e-39aae6f63b36 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:43.84909618 +0000 UTC m=+39.612667626 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls") pod "dns-default-tb9nd" (UID: "8d84ca7c-c39f-4083-986e-39aae6f63b36") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:41.984259 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.984231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xh9pz" event={"ID":"1fc6bc2b-a480-45e8-b599-7a7047c22563","Type":"ContainerStarted","Data":"cabde9a383a2a5c9eb37dc0256c25c9e6cc3f43860242250f25bb13fa29ef13e"}
Sep 15 09:07:41.986749 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.986724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerStarted","Data":"40089be34a1d5b94f51043d606be33fe06c7dc281de9b1e07bc13de4ad1a71ef"}
Sep 15 09:07:41.987807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:41.987783    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-xtfnr" event={"ID":"3e3f1648-4237-418d-9f77-2785267b6bdf","Type":"ContainerStarted","Data":"460641745d3a03f40d371553377f010d99365eb0c126f027bb17934673ba348b"}
Sep 15 09:07:42.996602 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:42.996566    2568 generic.go:356] "Generic (PLEG): container finished" podID="9ea37f1c-c822-4eca-b5c3-c9ef40af8a29" containerID="40089be34a1d5b94f51043d606be33fe06c7dc281de9b1e07bc13de4ad1a71ef" exitCode=0
Sep 15 09:07:42.996602 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:42.996593    2568 generic.go:356] "Generic (PLEG): container finished" podID="9ea37f1c-c822-4eca-b5c3-c9ef40af8a29" containerID="492cb0fb0772c3414372c92c1f414d1933efacef5331bc8ab756b4a5f2d91049" exitCode=0
Sep 15 09:07:42.997110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:42.996616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerDied","Data":"40089be34a1d5b94f51043d606be33fe06c7dc281de9b1e07bc13de4ad1a71ef"}
Sep 15 09:07:42.997110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:42.996689    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerDied","Data":"492cb0fb0772c3414372c92c1f414d1933efacef5331bc8ab756b4a5f2d91049"}
Sep 15 09:07:43.866865 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:43.866804    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:43.867030 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:43.866937    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:43.867030 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:43.866987    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:43.867141 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:43.867061    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls podName:8d84ca7c-c39f-4083-986e-39aae6f63b36 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:47.867039789 +0000 UTC m=+43.630611232 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls") pod "dns-default-tb9nd" (UID: "8d84ca7c-c39f-4083-986e-39aae6f63b36") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:43.867141 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:43.867077    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:43.867141 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:43.867134    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls podName:034d6e55-ea9d-4daa-beee-79acc09b4c8b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:47.867117366 +0000 UTC m=+43.630688815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4gpd" (UID: "034d6e55-ea9d-4daa-beee-79acc09b4c8b") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:44.006869 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:44.004391    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-s9szt" event={"ID":"9ea37f1c-c822-4eca-b5c3-c9ef40af8a29","Type":"ContainerStarted","Data":"d2919efd7a4907e0fad342c6053792a91fd4bf86ff361668e774c622b30e6300"}
Sep 15 09:07:44.043572 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:44.043508    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-s9szt" podStartSLOduration=7.780564853 podStartE2EDuration="39.04348848s" totalImagesPullingTime="31.262923627s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:44.040292033 +0000 UTC m=+39.803863481" watchObservedRunningTime="2026-09-15 09:07:44.04348848 +0000 UTC m=+39.807059930"
Sep 15 09:07:46.011588 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:46.010986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-568869fdc5-xtfnr" event={"ID":"3e3f1648-4237-418d-9f77-2785267b6bdf","Type":"ContainerStarted","Data":"9bce7015e9e7f6db0dddf7fc1c2de60ee1fdcd9329055b65260d3e225f761631"}
Sep 15 09:07:46.016160 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:46.016129    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xh9pz" event={"ID":"1fc6bc2b-a480-45e8-b599-7a7047c22563","Type":"ContainerStarted","Data":"9a49b96e4c99dd4e4a77834130dcd2898be80e459719b1acf489ba10b249b13a"}
Sep 15 09:07:46.030189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:46.030148    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-568869fdc5-xtfnr" podStartSLOduration=2.286118126 podStartE2EDuration="6.030134459s" totalImagesPullingTime="3.744016333s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:46.029942354 +0000 UTC m=+41.793513801" watchObservedRunningTime="2026-09-15 09:07:46.030134459 +0000 UTC m=+41.793705965"
Sep 15 09:07:46.047635 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:46.047598    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xh9pz" podStartSLOduration=2.292878793 podStartE2EDuration="6.047586843s" totalImagesPullingTime="3.75470805s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:46.046832802 +0000 UTC m=+41.810404249" watchObservedRunningTime="2026-09-15 09:07:46.047586843 +0000 UTC m=+41.811158288"
Sep 15 09:07:47.899543 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:47.899501    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:47.899931 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:47.899571    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:47.899931 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:47.899660    2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:47.899931 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:47.899678    2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 15 09:07:47.899931 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:47.899736    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls podName:034d6e55-ea9d-4daa-beee-79acc09b4c8b nodeName:}" failed. No retries permitted until 2026-09-15 09:07:55.899718419 +0000 UTC m=+51.663289868 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-k4gpd" (UID: "034d6e55-ea9d-4daa-beee-79acc09b4c8b") : secret "insights-runtime-extractor-tls" not found
Sep 15 09:07:47.899931 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:07:47.899750    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls podName:8d84ca7c-c39f-4083-986e-39aae6f63b36 nodeName:}" failed. No retries permitted until 2026-09-15 09:07:55.899744058 +0000 UTC m=+51.663315483 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls") pod "dns-default-tb9nd" (UID: "8d84ca7c-c39f-4083-986e-39aae6f63b36") : secret "dns-default-metrics-tls" not found
Sep 15 09:07:55.957364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:55.957323    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:55.957801 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:55.957384    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:55.960628 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:55.960601    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/034d6e55-ea9d-4daa-beee-79acc09b4c8b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-k4gpd\" (UID: \"034d6e55-ea9d-4daa-beee-79acc09b4c8b\") " pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:55.960750 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:55.960655    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d84ca7c-c39f-4083-986e-39aae6f63b36-metrics-tls\") pod \"dns-default-tb9nd\" (UID: \"8d84ca7c-c39f-4083-986e-39aae6f63b36\") " pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:56.019632 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:56.019598    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:56.029763 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:56.029738    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-k4gpd"
Sep 15 09:07:56.305178 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:56.305082    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-tb9nd"]
Sep 15 09:07:56.309343 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:56.309315    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d84ca7c_c39f_4083_986e_39aae6f63b36.slice/crio-16911b4c5fac6fec0c672fe193299241d3e23e94e6b185faafb2de8c977da98b WatchSource:0}: Error finding container 16911b4c5fac6fec0c672fe193299241d3e23e94e6b185faafb2de8c977da98b: Status 404 returned error can't find the container with id 16911b4c5fac6fec0c672fe193299241d3e23e94e6b185faafb2de8c977da98b
Sep 15 09:07:56.331017 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:56.330993    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-k4gpd"]
Sep 15 09:07:56.333622 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:07:56.333602    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod034d6e55_ea9d_4daa_beee_79acc09b4c8b.slice/crio-0055a3d0438be93236dadec02503408c431778defaf38b3c10b3ad0a6be9f66d WatchSource:0}: Error finding container 0055a3d0438be93236dadec02503408c431778defaf38b3c10b3ad0a6be9f66d: Status 404 returned error can't find the container with id 0055a3d0438be93236dadec02503408c431778defaf38b3c10b3ad0a6be9f66d
Sep 15 09:07:57.046009 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:57.045957    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tb9nd" event={"ID":"8d84ca7c-c39f-4083-986e-39aae6f63b36","Type":"ContainerStarted","Data":"16911b4c5fac6fec0c672fe193299241d3e23e94e6b185faafb2de8c977da98b"}
Sep 15 09:07:57.047753 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:57.047724    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4gpd" event={"ID":"034d6e55-ea9d-4daa-beee-79acc09b4c8b","Type":"ContainerStarted","Data":"ba6280528fa018aa3ecc179c2389d66ac67d0550db616c235fed6f221f53b316"}
Sep 15 09:07:57.047887 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:57.047774    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4gpd" event={"ID":"034d6e55-ea9d-4daa-beee-79acc09b4c8b","Type":"ContainerStarted","Data":"0055a3d0438be93236dadec02503408c431778defaf38b3c10b3ad0a6be9f66d"}
Sep 15 09:07:59.055013 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:59.054975    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4gpd" event={"ID":"034d6e55-ea9d-4daa-beee-79acc09b4c8b","Type":"ContainerStarted","Data":"9ed385d4c971c8f67a8c7a855f73645570bf6a84e291dbb7ef9fe58b6484615b"}
Sep 15 09:07:59.056993 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:59.056965    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tb9nd" event={"ID":"8d84ca7c-c39f-4083-986e-39aae6f63b36","Type":"ContainerStarted","Data":"3fffb068a219ca73cd041f108dc37342f9cf465507286bf53b816948edc00d98"}
Sep 15 09:07:59.057125 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:59.057017    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-tb9nd" event={"ID":"8d84ca7c-c39f-4083-986e-39aae6f63b36","Type":"ContainerStarted","Data":"8a517e9ba7fa93bab424daed6c6917f4e00920b010e5202ec72add5315c0223e"}
Sep 15 09:07:59.057202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:59.057130    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:07:59.078501 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:07:59.078448    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-tb9nd" podStartSLOduration=17.336937411 podStartE2EDuration="19.078429848s" totalImagesPullingTime="1.741492437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:07:59.076446859 +0000 UTC m=+54.840018318" watchObservedRunningTime="2026-09-15 09:07:59.078429848 +0000 UTC m=+54.842001297"
Sep 15 09:08:00.062923 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:00.062885    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-k4gpd" event={"ID":"034d6e55-ea9d-4daa-beee-79acc09b4c8b","Type":"ContainerStarted","Data":"a454b906329d411dbe3ce98f44a78da9f157c371e6b0409e12c2a23712354c52"}
Sep 15 09:08:00.084714 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:00.084660    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-k4gpd" podStartSLOduration=17.834571944 podStartE2EDuration="20.084643308s" totalImagesPullingTime="2.250071364s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:00.083329043 +0000 UTC m=+55.846900490" watchObservedRunningTime="2026-09-15 09:08:00.084643308 +0000 UTC m=+55.848214756"
Sep 15 09:08:03.759747 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.759712    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"]
Sep 15 09:08:03.787151 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.787122    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"]
Sep 15 09:08:03.787305 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.787235    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"
Sep 15 09:08:03.789936 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.789916    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-527n9\""
Sep 15 09:08:03.791187 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.791160    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 15 09:08:03.791187 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.791175    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Sep 15 09:08:03.791345 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.791164    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 15 09:08:03.791345 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.791229    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 15 09:08:03.801119 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.801100    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"]
Sep 15 09:08:03.801229 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.801203    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:03.803639 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.803623    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Sep 15 09:08:03.812433 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.812414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmd2\" (UniqueName: \"kubernetes.io/projected/405da4c4-ce8d-479a-8ff5-257469883038-kube-api-access-dkmd2\") pod \"managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz\" (UID: \"405da4c4-ce8d-479a-8ff5-257469883038\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"
Sep 15 09:08:03.812524 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.812442    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/405da4c4-ce8d-479a-8ff5-257469883038-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz\" (UID: \"405da4c4-ce8d-479a-8ff5-257469883038\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"
Sep 15 09:08:03.815568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.815551    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"]
Sep 15 09:08:03.815626 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.815583    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"]
Sep 15 09:08:03.815626 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.815611    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"]
Sep 15 09:08:03.815714 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.815702    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:03.818270 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.818249    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 15 09:08:03.818769 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.818745    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 15 09:08:03.818943 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.818927    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 15 09:08:03.819670 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.819653    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 15 09:08:03.913346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815ca5ea-7d1f-44de-a8e2-a19a27043b60-tmp\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:03.913346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913350    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/815ca5ea-7d1f-44de-a8e2-a19a27043b60-klusterlet-config\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:03.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913369    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vx7r\" (UniqueName: \"kubernetes.io/projected/815ca5ea-7d1f-44de-a8e2-a19a27043b60-kube-api-access-4vx7r\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:03.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913387    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:03.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913404    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:03.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913422    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b2bm\" (UniqueName: \"kubernetes.io/projected/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-kube-api-access-6b2bm\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:03.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913490    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-ca\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:03.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913525    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-hub\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:03.913732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913557    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmd2\" (UniqueName: \"kubernetes.io/projected/405da4c4-ce8d-479a-8ff5-257469883038-kube-api-access-dkmd2\") pod \"managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz\" (UID: \"405da4c4-ce8d-479a-8ff5-257469883038\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"
Sep 15 09:08:03.913732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913587    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:03.913732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.913627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/405da4c4-ce8d-479a-8ff5-257469883038-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz\" (UID: \"405da4c4-ce8d-479a-8ff5-257469883038\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"
Sep 15 09:08:03.916368 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.916336    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/405da4c4-ce8d-479a-8ff5-257469883038-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz\" (UID: \"405da4c4-ce8d-479a-8ff5-257469883038\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"
Sep 15 09:08:03.927128 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:03.927109    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmd2\" (UniqueName: \"kubernetes.io/projected/405da4c4-ce8d-479a-8ff5-257469883038-kube-api-access-dkmd2\") pod \"managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz\" (UID: \"405da4c4-ce8d-479a-8ff5-257469883038\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"
Sep 15 09:08:04.014864 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.014756    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-ca\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.014864 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.014794    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-hub\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.015080 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.014967    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.015080 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.015071    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815ca5ea-7d1f-44de-a8e2-a19a27043b60-tmp\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:04.015189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.015102    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/815ca5ea-7d1f-44de-a8e2-a19a27043b60-klusterlet-config\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:04.015189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.015129    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vx7r\" (UniqueName: \"kubernetes.io/projected/815ca5ea-7d1f-44de-a8e2-a19a27043b60-kube-api-access-4vx7r\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:04.015189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.015155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.015189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.015181    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.015395 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.015213    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b2bm\" (UniqueName: \"kubernetes.io/projected/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-kube-api-access-6b2bm\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.015535 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.015462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/815ca5ea-7d1f-44de-a8e2-a19a27043b60-tmp\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:04.015789 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.015752    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.017450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.017426    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-ca\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.017520 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.017430    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-hub\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.018194 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.018172    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/815ca5ea-7d1f-44de-a8e2-a19a27043b60-klusterlet-config\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:04.018194 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.018190    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.018321 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.018227    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.024505 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.024485    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vx7r\" (UniqueName: \"kubernetes.io/projected/815ca5ea-7d1f-44de-a8e2-a19a27043b60-kube-api-access-4vx7r\") pod \"klusterlet-addon-workmgr-64cd87579-9xx6l\" (UID: \"815ca5ea-7d1f-44de-a8e2-a19a27043b60\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:04.024949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.024931    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b2bm\" (UniqueName: \"kubernetes.io/projected/03c2c309-4eb4-45e9-9ee2-0adf88407f6c-kube-api-access-6b2bm\") pod \"cluster-proxy-proxy-agent-5bb7d486b7-lvmt8\" (UID: \"03c2c309-4eb4-45e9-9ee2-0adf88407f6c\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.116440 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.116402    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"
Sep 15 09:08:04.124961 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.124940    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:04.130078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.130061    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"
Sep 15 09:08:04.431782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.431748    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz"]
Sep 15 09:08:04.434429 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:08:04.434401    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod405da4c4_ce8d_479a_8ff5_257469883038.slice/crio-097c1fe40b0affeff9e915abc78cdefd3fb8c7e4e41712f5398d186e447d78f0 WatchSource:0}: Error finding container 097c1fe40b0affeff9e915abc78cdefd3fb8c7e4e41712f5398d186e447d78f0: Status 404 returned error can't find the container with id 097c1fe40b0affeff9e915abc78cdefd3fb8c7e4e41712f5398d186e447d78f0
Sep 15 09:08:04.454818 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.454794    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"]
Sep 15 09:08:04.458252 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:08:04.458224    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod815ca5ea_7d1f_44de_a8e2_a19a27043b60.slice/crio-afa5f464e018ceef615d171bc83fc79cb2058632958d3d10db8a9a5e43a67b97 WatchSource:0}: Error finding container afa5f464e018ceef615d171bc83fc79cb2058632958d3d10db8a9a5e43a67b97: Status 404 returned error can't find the container with id afa5f464e018ceef615d171bc83fc79cb2058632958d3d10db8a9a5e43a67b97
Sep 15 09:08:04.468826 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:04.468803    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8"]
Sep 15 09:08:04.471560 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:08:04.471528    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03c2c309_4eb4_45e9_9ee2_0adf88407f6c.slice/crio-ecdac590ff0e22df7268edc83e4dc8fa5bf24a0f1f2b19a46e022615520e9c59 WatchSource:0}: Error finding container ecdac590ff0e22df7268edc83e4dc8fa5bf24a0f1f2b19a46e022615520e9c59: Status 404 returned error can't find the container with id ecdac590ff0e22df7268edc83e4dc8fa5bf24a0f1f2b19a46e022615520e9c59
Sep 15 09:08:05.079389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:05.079357    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz" event={"ID":"405da4c4-ce8d-479a-8ff5-257469883038","Type":"ContainerStarted","Data":"097c1fe40b0affeff9e915abc78cdefd3fb8c7e4e41712f5398d186e447d78f0"}
Sep 15 09:08:05.080403 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:05.080377    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8" event={"ID":"03c2c309-4eb4-45e9-9ee2-0adf88407f6c","Type":"ContainerStarted","Data":"ecdac590ff0e22df7268edc83e4dc8fa5bf24a0f1f2b19a46e022615520e9c59"}
Sep 15 09:08:05.081403 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:05.081382    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l" event={"ID":"815ca5ea-7d1f-44de-a8e2-a19a27043b60","Type":"ContainerStarted","Data":"afa5f464e018ceef615d171bc83fc79cb2058632958d3d10db8a9a5e43a67b97"}
Sep 15 09:08:05.992679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:05.992645    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-4xwgs"
Sep 15 09:08:09.065753 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:09.065715    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-tb9nd"
Sep 15 09:08:10.471629 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.471462    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:08:10.471629 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.471526    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:08:10.478060 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.478034    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 15 09:08:10.478201 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.478034    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 15 09:08:10.484683 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.484660    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3affebbf-2c05-4dfc-9102-9c1711221bba-metrics-certs\") pod \"network-metrics-daemon-8rxs2\" (UID: \"3affebbf-2c05-4dfc-9102-9c1711221bba\") " pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:08:10.485486 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.485462    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75-original-pull-secret\") pod \"global-pull-secret-syncer-g5zwg\" (UID: \"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75\") " pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:08:10.493751 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.493729    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fwjtr\""
Sep 15 09:08:10.501907 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.501880    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-8rxs2"
Sep 15 09:08:10.572752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.572709    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:08:10.576005 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.575974    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 15 09:08:10.585762 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.585738    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 15 09:08:10.591000 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.590973    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-g5zwg"
Sep 15 09:08:10.597063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.597042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rbvvs\" (UniqueName: \"kubernetes.io/projected/9dc528b9-79bc-4122-93cc-06d6e466d3e7-kube-api-access-rbvvs\") pod \"network-check-target-djh2q\" (UID: \"9dc528b9-79bc-4122-93cc-06d6e466d3e7\") " pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:08:10.800078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.800009    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-sxrmh\""
Sep 15 09:08:10.807486 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:10.807469    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:08:11.640355 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:11.640331    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-8rxs2"]
Sep 15 09:08:11.643775 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:11.643736    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-djh2q"]
Sep 15 09:08:11.644661 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:08:11.644634    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3affebbf_2c05_4dfc_9102_9c1711221bba.slice/crio-008a2fdc6624593fdd9662a7a34b8f315ffa463467f88adc34307ec5c9500d89 WatchSource:0}: Error finding container 008a2fdc6624593fdd9662a7a34b8f315ffa463467f88adc34307ec5c9500d89: Status 404 returned error can't find the container with id 008a2fdc6624593fdd9662a7a34b8f315ffa463467f88adc34307ec5c9500d89
Sep 15 09:08:11.646892 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:11.646872    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-g5zwg"]
Sep 15 09:08:11.647195 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:08:11.647176    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9dc528b9_79bc_4122_93cc_06d6e466d3e7.slice/crio-99e9b94bf6c54297f0fb36b536e69d26c30235818feae9da1cfa069d24bf1ac1 WatchSource:0}: Error finding container 99e9b94bf6c54297f0fb36b536e69d26c30235818feae9da1cfa069d24bf1ac1: Status 404 returned error can't find the container with id 99e9b94bf6c54297f0fb36b536e69d26c30235818feae9da1cfa069d24bf1ac1
Sep 15 09:08:11.650679 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:08:11.650655    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba958dd0_84bc_46c3_b5d8_e2cbb5c49b75.slice/crio-66f26975c50c853915966aa59ac74a5854e9a477a1644d9cd4ad391e723a1873 WatchSource:0}: Error finding container 66f26975c50c853915966aa59ac74a5854e9a477a1644d9cd4ad391e723a1873: Status 404 returned error can't find the container with id 66f26975c50c853915966aa59ac74a5854e9a477a1644d9cd4ad391e723a1873
Sep 15 09:08:12.111864 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.111806    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8" event={"ID":"03c2c309-4eb4-45e9-9ee2-0adf88407f6c","Type":"ContainerStarted","Data":"3780fa2a675d50ca6b423fbf5cbd61f64f203b86d09630491fd8cad474f99014"}
Sep 15 09:08:12.112061 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.111887    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8" event={"ID":"03c2c309-4eb4-45e9-9ee2-0adf88407f6c","Type":"ContainerStarted","Data":"5d182d226a23187e8572b77af057b2f9d2319d98935cf1d55a1e088b7e53ac62"}
Sep 15 09:08:12.112061 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.111910    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8" event={"ID":"03c2c309-4eb4-45e9-9ee2-0adf88407f6c","Type":"ContainerStarted","Data":"954f1ac454435bbd828d067de695d238bd05e3c7c700cba926fcaf34d6569e1a"}
Sep 15 09:08:12.113346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.113324    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l" event={"ID":"815ca5ea-7d1f-44de-a8e2-a19a27043b60","Type":"ContainerStarted","Data":"746e0df6ff781676a7230632120142435c33950610eb147b83744e742c8100a7"}
Sep 15 09:08:12.113495 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.113370    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:12.114532 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.114513    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g5zwg" event={"ID":"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75","Type":"ContainerStarted","Data":"66f26975c50c853915966aa59ac74a5854e9a477a1644d9cd4ad391e723a1873"}
Sep 15 09:08:12.115447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.115426    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l"
Sep 15 09:08:12.115893 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.115816    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-djh2q" event={"ID":"9dc528b9-79bc-4122-93cc-06d6e466d3e7","Type":"ContainerStarted","Data":"99e9b94bf6c54297f0fb36b536e69d26c30235818feae9da1cfa069d24bf1ac1"}
Sep 15 09:08:12.116969 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.116947    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rxs2" event={"ID":"3affebbf-2c05-4dfc-9102-9c1711221bba","Type":"ContainerStarted","Data":"008a2fdc6624593fdd9662a7a34b8f315ffa463467f88adc34307ec5c9500d89"}
Sep 15 09:08:12.118935 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.118916    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz" event={"ID":"405da4c4-ce8d-479a-8ff5-257469883038","Type":"ContainerStarted","Data":"94988bea3efcdcab8a8bec7248cf7be1c1dd15836d0d29eca2689a141552eab2"}
Sep 15 09:08:12.131571 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.131527    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5bb7d486b7-lvmt8" podStartSLOduration=2.228010083 podStartE2EDuration="9.131515095s" totalImagesPullingTime="6.903505012s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:12.130775139 +0000 UTC m=+67.894346586" watchObservedRunningTime="2026-09-15 09:08:12.131515095 +0000 UTC m=+67.895086543"
Sep 15 09:08:12.147544 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.147496    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-64cd87579-9xx6l" podStartSLOduration=2.241002673 podStartE2EDuration="9.147480811s" totalImagesPullingTime="6.906478138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:12.146949606 +0000 UTC m=+67.910521240" watchObservedRunningTime="2026-09-15 09:08:12.147480811 +0000 UTC m=+67.911052258"
Sep 15 09:08:12.164294 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:12.164248    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-76cc65d7f4-wvzkz" podStartSLOduration=2.233714389 podStartE2EDuration="9.164231253s" totalImagesPullingTime="6.930516864s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:08:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:12.163812145 +0000 UTC m=+67.927383593" watchObservedRunningTime="2026-09-15 09:08:12.164231253 +0000 UTC m=+67.927802717"
Sep 15 09:08:13.125258 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:13.125161    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rxs2" event={"ID":"3affebbf-2c05-4dfc-9102-9c1711221bba","Type":"ContainerStarted","Data":"a1d9821eaf5a1952f1641907397d4636fdf080704eeb7154b7f1efec8dc29db7"}
Sep 15 09:08:13.125258 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:13.125223    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-8rxs2" event={"ID":"3affebbf-2c05-4dfc-9102-9c1711221bba","Type":"ContainerStarted","Data":"7a789810338d0310e14fbada7646ed474d806cc450ff51a2b471abd4fb9913a4"}
Sep 15 09:08:13.144038 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:13.143983    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-8rxs2" podStartSLOduration=66.961594342 podStartE2EDuration="1m8.143969015s" totalImagesPullingTime="1.182374673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:13.143319099 +0000 UTC m=+68.906890539" watchObservedRunningTime="2026-09-15 09:08:13.143969015 +0000 UTC m=+68.907540463"
Sep 15 09:08:17.141724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.141683    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-g5zwg" event={"ID":"ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75","Type":"ContainerStarted","Data":"6c8753c89c5e839b1c20179dec5d4dfbabe7affc0e647844c5b34ea95797bd47"}
Sep 15 09:08:17.143282 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.143260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-djh2q" event={"ID":"9dc528b9-79bc-4122-93cc-06d6e466d3e7","Type":"ContainerStarted","Data":"b60e5c5f432fae513f623831e249e2709d34aca581fe4e4612d9dffb101a327b"}
Sep 15 09:08:17.143398 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.143310    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:08:17.159349 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.159299    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-g5zwg" podStartSLOduration=67.336191198 podStartE2EDuration="1m12.15928132s" totalImagesPullingTime="4.823090122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:17.158500575 +0000 UTC m=+72.922072028" watchObservedRunningTime="2026-09-15 09:08:17.15928132 +0000 UTC m=+72.922852772"
Sep 15 09:08:17.175034 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.174982    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-djh2q" podStartSLOduration=67.354078599 podStartE2EDuration="1m12.17496687s" totalImagesPullingTime="4.820888271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:17.174186136 +0000 UTC m=+72.937757586" watchObservedRunningTime="2026-09-15 09:08:17.17496687 +0000 UTC m=+72.938538317"
Sep 15 09:08:17.532466 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.532426    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-m4dsh"]
Sep 15 09:08:17.535899 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.535883    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.539074 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.539038    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 15 09:08:17.539404 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.539081    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 15 09:08:17.539404 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.539240    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 15 09:08:17.540080 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.540061    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 15 09:08:17.540174 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.540068    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 15 09:08:17.540435 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.540419    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-2gqnx\""
Sep 15 09:08:17.540542 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.540476    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 15 09:08:17.629425 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629391    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c145344-f8e6-427f-a5c0-b4387b63cc60-metrics-client-ca\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.629613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629433    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.629613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629481    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-wtmp\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.629613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-tls\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.629613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-root\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.629613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629543    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.629613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629558    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-sys\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.629932 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629674    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2vxv\" (UniqueName: \"kubernetes.io/projected/2c145344-f8e6-427f-a5c0-b4387b63cc60-kube-api-access-t2vxv\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.629932 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.629715    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-textfile\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.730561 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730508    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c145344-f8e6-427f-a5c0-b4387b63cc60-metrics-client-ca\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.730756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730570    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.730756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-wtmp\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.730756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730633    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-tls\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.730756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730663    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-root\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.730756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730690    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.730756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730715    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-sys\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.730756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730751    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2vxv\" (UniqueName: \"kubernetes.io/projected/2c145344-f8e6-427f-a5c0-b4387b63cc60-kube-api-access-t2vxv\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.731145 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730757    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-root\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.731145 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730782    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-textfile\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.731145 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.730827    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-sys\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.731145 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:08:17.731067    2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 15 09:08:17.731145 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:08:17.731132    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-tls podName:2c145344-f8e6-427f-a5c0-b4387b63cc60 nodeName:}" failed. No retries permitted until 2026-09-15 09:08:18.231112116 +0000 UTC m=+73.994683568 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-tls") pod "node-exporter-m4dsh" (UID: "2c145344-f8e6-427f-a5c0-b4387b63cc60") : secret "node-exporter-tls" not found
Sep 15 09:08:17.731356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.731195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-wtmp\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.731356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.731225    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c145344-f8e6-427f-a5c0-b4387b63cc60-metrics-client-ca\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.731612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.731589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-accelerators-collector-config\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.731811 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.731794    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-textfile\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.733589 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.733567    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:17.740914 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:17.740816    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2vxv\" (UniqueName: \"kubernetes.io/projected/2c145344-f8e6-427f-a5c0-b4387b63cc60-kube-api-access-t2vxv\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:18.234008 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:18.233975    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-tls\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:18.236471 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:18.236448    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/2c145344-f8e6-427f-a5c0-b4387b63cc60-node-exporter-tls\") pod \"node-exporter-m4dsh\" (UID: \"2c145344-f8e6-427f-a5c0-b4387b63cc60\") " pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:18.446269 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:18.446233    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-m4dsh"
Sep 15 09:08:18.486255 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:08:18.486196    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c145344_f8e6_427f_a5c0_b4387b63cc60.slice/crio-c6a63eefee641f0ca8265f6b08b8b7c5c8194b2bf9fbc9dbfee280f9dc138ad3 WatchSource:0}: Error finding container c6a63eefee641f0ca8265f6b08b8b7c5c8194b2bf9fbc9dbfee280f9dc138ad3: Status 404 returned error can't find the container with id c6a63eefee641f0ca8265f6b08b8b7c5c8194b2bf9fbc9dbfee280f9dc138ad3
Sep 15 09:08:19.150392 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:19.150354    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4dsh" event={"ID":"2c145344-f8e6-427f-a5c0-b4387b63cc60","Type":"ContainerStarted","Data":"c6a63eefee641f0ca8265f6b08b8b7c5c8194b2bf9fbc9dbfee280f9dc138ad3"}
Sep 15 09:08:20.157239 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:20.157206    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c145344-f8e6-427f-a5c0-b4387b63cc60" containerID="cf7c000f3955c734874ab41dd0c0024efee7582634be8c5ef7acf4bfda87676b" exitCode=0
Sep 15 09:08:20.157685 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:20.157275    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4dsh" event={"ID":"2c145344-f8e6-427f-a5c0-b4387b63cc60","Type":"ContainerDied","Data":"cf7c000f3955c734874ab41dd0c0024efee7582634be8c5ef7acf4bfda87676b"}
Sep 15 09:08:21.162377 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:21.162336    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4dsh" event={"ID":"2c145344-f8e6-427f-a5c0-b4387b63cc60","Type":"ContainerStarted","Data":"3770afc9e6363bdc292d20baf11ea70ce802ea9a697f2be5918bdcea76b98c71"}
Sep 15 09:08:21.162728 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:21.162398    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-m4dsh" event={"ID":"2c145344-f8e6-427f-a5c0-b4387b63cc60","Type":"ContainerStarted","Data":"9272e734c2bb8b99e5760b6fbed68b56e33cb195b67cbfff0a1f9e091e38f500"}
Sep 15 09:08:21.183032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:21.182984    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-m4dsh" podStartSLOduration=2.692665182 podStartE2EDuration="4.182967122s" totalImagesPullingTime="1.421985278s" totalInitContainerRuntime="68.316662ms" isStatefulPod=true podCreationTimestamp="2026-09-15 09:08:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:08:21.18111808 +0000 UTC m=+76.944689528" watchObservedRunningTime="2026-09-15 09:08:21.182967122 +0000 UTC m=+76.946538568"
Sep 15 09:08:48.149202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:08:48.149167    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-djh2q"
Sep 15 09:11:51.157123 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.157080    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"]
Sep 15 09:11:51.160202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.160181    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.164143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.164122    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Sep 15 09:11:51.164282 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.164161    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-8vtc5\""
Sep 15 09:11:51.164282 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.164170    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 15 09:11:51.164282 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.164216    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Sep 15 09:11:51.164282 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.164258    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 15 09:11:51.164451 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.164435    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Sep 15 09:11:51.173989 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.173963    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"]
Sep 15 09:11:51.276439 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.276407    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-manager-config\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.276617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.276450    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-metrics-cert\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.276617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.276468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jkxw\" (UniqueName: \"kubernetes.io/projected/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-kube-api-access-5jkxw\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.276617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.276499    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-cert\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.377262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.377226    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-manager-config\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.377262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.377274    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-metrics-cert\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.377513 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.377294    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jkxw\" (UniqueName: \"kubernetes.io/projected/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-kube-api-access-5jkxw\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.377513 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.377317    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-cert\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.377930 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.377913    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-manager-config\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.379897 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.379877    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-cert\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.379976 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.379903    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-metrics-cert\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.386371 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.386351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jkxw\" (UniqueName: \"kubernetes.io/projected/eeb8b038-cad4-491c-b23d-c6ecf8f60bd4-kube-api-access-5jkxw\") pod \"lws-controller-manager-5f667c6f8-zf5fv\" (UID: \"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4\") " pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.472489 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.472406    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:51.743253 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.743027    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"]
Sep 15 09:11:51.745795 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:11:51.745766    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeb8b038_cad4_491c_b23d_c6ecf8f60bd4.slice/crio-4e1c9f36ba70e17227cd6947d0e1e17b403ee56673a4c66553a4d7fd79b0f077 WatchSource:0}: Error finding container 4e1c9f36ba70e17227cd6947d0e1e17b403ee56673a4c66553a4d7fd79b0f077: Status 404 returned error can't find the container with id 4e1c9f36ba70e17227cd6947d0e1e17b403ee56673a4c66553a4d7fd79b0f077
Sep 15 09:11:51.840124 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:51.840088    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv" event={"ID":"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4","Type":"ContainerStarted","Data":"4e1c9f36ba70e17227cd6947d0e1e17b403ee56673a4c66553a4d7fd79b0f077"}
Sep 15 09:11:54.852405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:54.852372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv" event={"ID":"eeb8b038-cad4-491c-b23d-c6ecf8f60bd4","Type":"ContainerStarted","Data":"96d3ade844566f81097617b1fbfbc223d283146fbe0539f5c9f4364302db92c4"}
Sep 15 09:11:54.852800 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:54.852431    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:11:54.869549 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:54.869441    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv" podStartSLOduration=1.531850968 podStartE2EDuration="3.869422652s" totalImagesPullingTime="2.337571684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:11:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:11:54.869265237 +0000 UTC m=+290.632836687" watchObservedRunningTime="2026-09-15 09:11:54.869422652 +0000 UTC m=+290.632994100"
Sep 15 09:11:58.275233 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.275191    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"]
Sep 15 09:11:58.278146 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.278130    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.280829 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.280807    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 15 09:11:58.281037 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.280878    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 15 09:11:58.281153 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.281135    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 15 09:11:58.281206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.281175    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-9l42l\""
Sep 15 09:11:58.281244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.281225    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 15 09:11:58.294145 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.294125    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"]
Sep 15 09:11:58.331954 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.331923    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cee1e606-68c8-4093-b76c-0801295cb76b-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.332098 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.331976    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cee1e606-68c8-4093-b76c-0801295cb76b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.332098 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.332033    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cee1e606-68c8-4093-b76c-0801295cb76b-tmp\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.332098 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.332075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqc7s\" (UniqueName: \"kubernetes.io/projected/cee1e606-68c8-4093-b76c-0801295cb76b-kube-api-access-nqc7s\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.332098 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.332097    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cee1e606-68c8-4093-b76c-0801295cb76b-manifests\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.432946 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.432913    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cee1e606-68c8-4093-b76c-0801295cb76b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.432946 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.432953    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cee1e606-68c8-4093-b76c-0801295cb76b-tmp\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.433143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.432980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqc7s\" (UniqueName: \"kubernetes.io/projected/cee1e606-68c8-4093-b76c-0801295cb76b-kube-api-access-nqc7s\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.433143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.432999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cee1e606-68c8-4093-b76c-0801295cb76b-manifests\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.433143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.433014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cee1e606-68c8-4093-b76c-0801295cb76b-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.433484 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.433465    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cee1e606-68c8-4093-b76c-0801295cb76b-manifests\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.435475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.435447    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cee1e606-68c8-4093-b76c-0801295cb76b-tmp\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.435652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.435635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cee1e606-68c8-4093-b76c-0801295cb76b-webhook-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.435693 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.435678    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cee1e606-68c8-4093-b76c-0801295cb76b-apiservice-cert\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.441967 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.441945    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqc7s\" (UniqueName: \"kubernetes.io/projected/cee1e606-68c8-4093-b76c-0801295cb76b-kube-api-access-nqc7s\") pod \"opendatahub-operator-controller-manager-77dcfd7f98-h2q96\" (UID: \"cee1e606-68c8-4093-b76c-0801295cb76b\") " pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.588819 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.588726    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:11:58.907172 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:58.907149    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"]
Sep 15 09:11:58.911105 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:11:58.911080    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee1e606_68c8_4093_b76c_0801295cb76b.slice/crio-cab1721e4acbbc5d5e9ef8ee5a8948cd913754cfa813ed690c5042ffc52efa24 WatchSource:0}: Error finding container cab1721e4acbbc5d5e9ef8ee5a8948cd913754cfa813ed690c5042ffc52efa24: Status 404 returned error can't find the container with id cab1721e4acbbc5d5e9ef8ee5a8948cd913754cfa813ed690c5042ffc52efa24
Sep 15 09:11:59.874391 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:11:59.874353    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96" event={"ID":"cee1e606-68c8-4093-b76c-0801295cb76b","Type":"ContainerStarted","Data":"cab1721e4acbbc5d5e9ef8ee5a8948cd913754cfa813ed690c5042ffc52efa24"}
Sep 15 09:12:02.892560 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:02.892529    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96" event={"ID":"cee1e606-68c8-4093-b76c-0801295cb76b","Type":"ContainerStarted","Data":"f4c40994d0f0f74c0fdd79b2ba0283aa28efcd8ffe1c7a5dd9f3cc13beff0d7c"}
Sep 15 09:12:03.897469 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:03.897435    2568 generic.go:356] "Generic (PLEG): container finished" podID="cee1e606-68c8-4093-b76c-0801295cb76b" containerID="f4c40994d0f0f74c0fdd79b2ba0283aa28efcd8ffe1c7a5dd9f3cc13beff0d7c" exitCode=0
Sep 15 09:12:03.897913 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:03.897524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96" event={"ID":"cee1e606-68c8-4093-b76c-0801295cb76b","Type":"ContainerDied","Data":"f4c40994d0f0f74c0fdd79b2ba0283aa28efcd8ffe1c7a5dd9f3cc13beff0d7c"}
Sep 15 09:12:04.664082 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:04.664060    2568 kubelet.go:1648] "Image garbage collection succeeded"
Sep 15 09:12:04.902613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:04.902413    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96" event={"ID":"cee1e606-68c8-4093-b76c-0801295cb76b","Type":"ContainerStarted","Data":"9a94c426f794ef16741ea431a25ce2625bf7c7eea495bcfcedb1a489b97fc70f"}
Sep 15 09:12:04.902613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:04.902501    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:12:04.926889 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:04.926832    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96" podStartSLOduration=1.880048712 podStartE2EDuration="6.926814564s" totalImagesPullingTime="3.985152888s" totalInitContainerRuntime="1.061612964s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:11:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:04.924786857 +0000 UTC m=+300.688358343" watchObservedRunningTime="2026-09-15 09:12:04.926814564 +0000 UTC m=+300.690386013"
Sep 15 09:12:05.860251 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:05.860215    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f667c6f8-zf5fv"
Sep 15 09:12:15.908799 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:15.908769    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-77dcfd7f98-h2q96"
Sep 15 09:12:25.072473 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.072439    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"]
Sep 15 09:12:25.086545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.086523    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.089657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.089630    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"]
Sep 15 09:12:25.090061 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.090035    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 15 09:12:25.090061 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.090048    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 15 09:12:25.090238 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.090070    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 15 09:12:25.090238 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.090124    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-z6vt4\""
Sep 15 09:12:25.226983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.226948    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.226983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.226984    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.227241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.227010    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.227241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.227071    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.227241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.227114    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgcbz\" (UniqueName: \"kubernetes.io/projected/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-kube-api-access-wgcbz\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.227241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.227154    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.227241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.227193    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.227241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.227224    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.227469 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.227294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.327706 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327621    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.327706 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327656    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.327706 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327673    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.327706 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327694    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.328049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327784    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.328049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327828    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgcbz\" (UniqueName: \"kubernetes.io/projected/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-kube-api-access-wgcbz\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.328049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327886    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.328049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327924    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.328049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.327948    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.328285 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.328105    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.328285 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.328184    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.328285 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.328236    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.329855 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.329819    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.330429 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.330411    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.330613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.330595    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.332636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.332615    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.337019 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.336996    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.337172 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.337157    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgcbz\" (UniqueName: \"kubernetes.io/projected/3d34d984-e2d1-4d61-bf78-027e6a11e3bd-kube-api-access-wgcbz\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cxlkds\" (UID: \"3d34d984-e2d1-4d61-bf78-027e6a11e3bd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.398803 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.398773    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:25.671111 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.671082    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"]
Sep 15 09:12:25.673976 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:12:25.673947    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d34d984_e2d1_4d61_bf78_027e6a11e3bd.slice/crio-6c8d0e2458e01c123af2df821e1bc58f34f388b7bf7c55971371861a0ae57415 WatchSource:0}: Error finding container 6c8d0e2458e01c123af2df821e1bc58f34f388b7bf7c55971371861a0ae57415: Status 404 returned error can't find the container with id 6c8d0e2458e01c123af2df821e1bc58f34f388b7bf7c55971371861a0ae57415
Sep 15 09:12:25.675836 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.675818    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:12:25.972661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:25.972577    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds" event={"ID":"3d34d984-e2d1-4d61-bf78-027e6a11e3bd","Type":"ContainerStarted","Data":"6c8d0e2458e01c123af2df821e1bc58f34f388b7bf7c55971371861a0ae57415"}
Sep 15 09:12:28.431460 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.431418    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:12:28.431821 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.431513    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:12:28.431821 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.431560    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:12:28.613262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.613227    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m8wp4"]
Sep 15 09:12:28.616358 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.616336    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:28.619184 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.619166    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 15 09:12:28.619313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.619169    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-gvmdg\""
Sep 15 09:12:28.629210 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.629134    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m8wp4"]
Sep 15 09:12:28.761863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.761777    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mx6b\" (UniqueName: \"kubernetes.io/projected/9df41f09-282a-4017-a5c0-50840a09b58a-kube-api-access-5mx6b\") pod \"odh-model-controller-7998c67dc4-m8wp4\" (UID: \"9df41f09-282a-4017-a5c0-50840a09b58a\") " pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:28.761997 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.761863    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df41f09-282a-4017-a5c0-50840a09b58a-cert\") pod \"odh-model-controller-7998c67dc4-m8wp4\" (UID: \"9df41f09-282a-4017-a5c0-50840a09b58a\") " pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:28.862466 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.862436    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df41f09-282a-4017-a5c0-50840a09b58a-cert\") pod \"odh-model-controller-7998c67dc4-m8wp4\" (UID: \"9df41f09-282a-4017-a5c0-50840a09b58a\") " pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:28.862641 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.862497    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mx6b\" (UniqueName: \"kubernetes.io/projected/9df41f09-282a-4017-a5c0-50840a09b58a-kube-api-access-5mx6b\") pod \"odh-model-controller-7998c67dc4-m8wp4\" (UID: \"9df41f09-282a-4017-a5c0-50840a09b58a\") " pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:28.862641 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:12:28.862597    2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 15 09:12:28.862756 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:12:28.862658    2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9df41f09-282a-4017-a5c0-50840a09b58a-cert podName:9df41f09-282a-4017-a5c0-50840a09b58a nodeName:}" failed. No retries permitted until 2026-09-15 09:12:29.36263886 +0000 UTC m=+325.126210300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/9df41f09-282a-4017-a5c0-50840a09b58a-cert") pod "odh-model-controller-7998c67dc4-m8wp4" (UID: "9df41f09-282a-4017-a5c0-50840a09b58a") : secret "odh-model-controller-webhook-cert" not found
Sep 15 09:12:28.871983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.871961    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mx6b\" (UniqueName: \"kubernetes.io/projected/9df41f09-282a-4017-a5c0-50840a09b58a-kube-api-access-5mx6b\") pod \"odh-model-controller-7998c67dc4-m8wp4\" (UID: \"9df41f09-282a-4017-a5c0-50840a09b58a\") " pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:28.983931 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:28.983899    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds" event={"ID":"3d34d984-e2d1-4d61-bf78-027e6a11e3bd","Type":"ContainerStarted","Data":"3dce06607c793605aa1fe0a28884b2fbd2ddcf48728a6b8bcb782cd746e60599"}
Sep 15 09:12:29.006004 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.005950    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds" podStartSLOduration=1.250729731 podStartE2EDuration="4.005931304s" totalImagesPullingTime="2.755201573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:12:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:29.00568062 +0000 UTC m=+324.769252068" watchObservedRunningTime="2026-09-15 09:12:29.005931304 +0000 UTC m=+324.769502768"
Sep 15 09:12:29.220230 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.220195    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cltxs"]
Sep 15 09:12:29.223411 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.223395    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:29.227289 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.227265    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-8bc5j\""
Sep 15 09:12:29.227974 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.227959    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 15 09:12:29.237370 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.237348    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cltxs"]
Sep 15 09:12:29.367197 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.367157    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcrwg\" (UniqueName: \"kubernetes.io/projected/6031c05a-26b0-437f-acb8-2e9abed11026-kube-api-access-lcrwg\") pod \"model-serving-api-54d89bd5fc-cltxs\" (UID: \"6031c05a-26b0-437f-acb8-2e9abed11026\") " pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:29.367197 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.367197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6031c05a-26b0-437f-acb8-2e9abed11026-tls-certs\") pod \"model-serving-api-54d89bd5fc-cltxs\" (UID: \"6031c05a-26b0-437f-acb8-2e9abed11026\") " pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:29.367422 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.367239    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df41f09-282a-4017-a5c0-50840a09b58a-cert\") pod \"odh-model-controller-7998c67dc4-m8wp4\" (UID: \"9df41f09-282a-4017-a5c0-50840a09b58a\") " pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:29.369786 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.369757    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/9df41f09-282a-4017-a5c0-50840a09b58a-cert\") pod \"odh-model-controller-7998c67dc4-m8wp4\" (UID: \"9df41f09-282a-4017-a5c0-50840a09b58a\") " pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:29.399862 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.399810    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:29.404509 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.404488    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:29.468099 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.468064    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcrwg\" (UniqueName: \"kubernetes.io/projected/6031c05a-26b0-437f-acb8-2e9abed11026-kube-api-access-lcrwg\") pod \"model-serving-api-54d89bd5fc-cltxs\" (UID: \"6031c05a-26b0-437f-acb8-2e9abed11026\") " pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:29.468099 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.468101    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6031c05a-26b0-437f-acb8-2e9abed11026-tls-certs\") pod \"model-serving-api-54d89bd5fc-cltxs\" (UID: \"6031c05a-26b0-437f-acb8-2e9abed11026\") " pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:29.470643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.470599    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6031c05a-26b0-437f-acb8-2e9abed11026-tls-certs\") pod \"model-serving-api-54d89bd5fc-cltxs\" (UID: \"6031c05a-26b0-437f-acb8-2e9abed11026\") " pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:29.475752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.475734    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcrwg\" (UniqueName: \"kubernetes.io/projected/6031c05a-26b0-437f-acb8-2e9abed11026-kube-api-access-lcrwg\") pod \"model-serving-api-54d89bd5fc-cltxs\" (UID: \"6031c05a-26b0-437f-acb8-2e9abed11026\") " pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:29.530642 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.530617    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:29.532698 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.532679    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:29.804507 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.804482    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-cltxs"]
Sep 15 09:12:29.807414 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:12:29.807379    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6031c05a_26b0_437f_acb8_2e9abed11026.slice/crio-1c6be1896ed9885683f7d94826024610746441a9db18696634f7a2eb042ce2ab WatchSource:0}: Error finding container 1c6be1896ed9885683f7d94826024610746441a9db18696634f7a2eb042ce2ab: Status 404 returned error can't find the container with id 1c6be1896ed9885683f7d94826024610746441a9db18696634f7a2eb042ce2ab
Sep 15 09:12:29.808158 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.808123    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-m8wp4"]
Sep 15 09:12:29.810544 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:12:29.810520    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df41f09_282a_4017_a5c0_50840a09b58a.slice/crio-64df50ba247ce6c659f78b5fdca164ad7aa40507c41b2b2c4436bb664ff67b3f WatchSource:0}: Error finding container 64df50ba247ce6c659f78b5fdca164ad7aa40507c41b2b2c4436bb664ff67b3f: Status 404 returned error can't find the container with id 64df50ba247ce6c659f78b5fdca164ad7aa40507c41b2b2c4436bb664ff67b3f
Sep 15 09:12:29.988818 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.988777    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cltxs" event={"ID":"6031c05a-26b0-437f-acb8-2e9abed11026","Type":"ContainerStarted","Data":"1c6be1896ed9885683f7d94826024610746441a9db18696634f7a2eb042ce2ab"}
Sep 15 09:12:29.989808 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.989788    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4" event={"ID":"9df41f09-282a-4017-a5c0-50840a09b58a","Type":"ContainerStarted","Data":"64df50ba247ce6c659f78b5fdca164ad7aa40507c41b2b2c4436bb664ff67b3f"}
Sep 15 09:12:29.990142 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.990119    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:29.991009 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:29.990995    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cxlkds"
Sep 15 09:12:34.011021 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:34.010970    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4" event={"ID":"9df41f09-282a-4017-a5c0-50840a09b58a","Type":"ContainerStarted","Data":"d47272821b7b8d9bad7ec4ad4263276299838a223e0496d91714a04ab376dde0"}
Sep 15 09:12:34.011496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:34.011102    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:34.012865 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:34.012819    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-cltxs" event={"ID":"6031c05a-26b0-437f-acb8-2e9abed11026","Type":"ContainerStarted","Data":"9cf39c33572011b78af641f66accaf759c924906caa50d0ed63274b1f401b6c5"}
Sep 15 09:12:34.012984 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:34.012902    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:12:34.034859 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:34.034807    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4" podStartSLOduration=2.277327155 podStartE2EDuration="6.034793746s" totalImagesPullingTime="3.757466591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:12:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:34.033515558 +0000 UTC m=+329.797087013" watchObservedRunningTime="2026-09-15 09:12:34.034793746 +0000 UTC m=+329.798365208"
Sep 15 09:12:34.054059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:34.054013    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-cltxs" podStartSLOduration=1.298449634 podStartE2EDuration="5.053998362s" totalImagesPullingTime="3.755548728s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:12:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:34.05245715 +0000 UTC m=+329.816028600" watchObservedRunningTime="2026-09-15 09:12:34.053998362 +0000 UTC m=+329.817569831"
Sep 15 09:12:35.231654 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.231613    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"]
Sep 15 09:12:35.234952 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.234932    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.238135 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.238115    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 15 09:12:35.238135 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.238127    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-2fcvz\""
Sep 15 09:12:35.238314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.238127    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 15 09:12:35.238430 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.238416    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 15 09:12:35.248104 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.248084    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"]
Sep 15 09:12:35.316365 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.316331    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4de6ff6-417e-4fe2-9764-757a46945108-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.316541 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.316376    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pcxb\" (UniqueName: \"kubernetes.io/projected/a4de6ff6-417e-4fe2-9764-757a46945108-kube-api-access-5pcxb\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.316541 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.316414    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4de6ff6-417e-4fe2-9764-757a46945108-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.316541 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.316454    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.316541 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.316518    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4de6ff6-417e-4fe2-9764-757a46945108-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.316712 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.316546    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.316712 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.316568    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.417944 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.417898    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.418135 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.417968    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4de6ff6-417e-4fe2-9764-757a46945108-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.418135 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.418003    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pcxb\" (UniqueName: \"kubernetes.io/projected/a4de6ff6-417e-4fe2-9764-757a46945108-kube-api-access-5pcxb\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.418135 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.418044    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4de6ff6-417e-4fe2-9764-757a46945108-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.418267 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.418170    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.418267 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.418237    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4de6ff6-417e-4fe2-9764-757a46945108-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.418370 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.418277    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.419052 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.419024    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/a4de6ff6-417e-4fe2-9764-757a46945108-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.420533 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.420505    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/a4de6ff6-417e-4fe2-9764-757a46945108-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.420618 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.420554    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.420618 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.420593    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.420687 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.420624    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/a4de6ff6-417e-4fe2-9764-757a46945108-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.426748 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.426723    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a4de6ff6-417e-4fe2-9764-757a46945108-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.427328 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.427307    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pcxb\" (UniqueName: \"kubernetes.io/projected/a4de6ff6-417e-4fe2-9764-757a46945108-kube-api-access-5pcxb\") pod \"istiod-openshift-gateway-5677ccb49b-nkwh5\" (UID: \"a4de6ff6-417e-4fe2-9764-757a46945108\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.543555 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.543468    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:35.822725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:35.822654    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"]
Sep 15 09:12:35.825745 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:12:35.825719    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4de6ff6_417e_4fe2_9764_757a46945108.slice/crio-1c687d80047bd4f8e837e0d19aab349ce4ddd04d6f82df3f685b2104cac705b0 WatchSource:0}: Error finding container 1c687d80047bd4f8e837e0d19aab349ce4ddd04d6f82df3f685b2104cac705b0: Status 404 returned error can't find the container with id 1c687d80047bd4f8e837e0d19aab349ce4ddd04d6f82df3f685b2104cac705b0
Sep 15 09:12:36.020944 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:36.020910    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5" event={"ID":"a4de6ff6-417e-4fe2-9764-757a46945108","Type":"ContainerStarted","Data":"1c687d80047bd4f8e837e0d19aab349ce4ddd04d6f82df3f685b2104cac705b0"}
Sep 15 09:12:38.297610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:38.297572    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:12:38.297908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:38.297638    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:12:39.036156 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:39.036123    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5" event={"ID":"a4de6ff6-417e-4fe2-9764-757a46945108","Type":"ContainerStarted","Data":"04db077c5abf624e760e45884909c1d8e6f37abfe50b714b16beae2a2ba971d1"}
Sep 15 09:12:39.036323 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:39.036298    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:39.037833 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:39.037800    2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-nkwh5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:12:39.037973 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:39.037861    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5" podUID="a4de6ff6-417e-4fe2-9764-757a46945108" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:12:39.081004 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:39.080950    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5" podStartSLOduration=1.611165395 podStartE2EDuration="4.080936927s" totalImagesPullingTime="2.469771532s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:12:39.080077449 +0000 UTC m=+334.843648900" watchObservedRunningTime="2026-09-15 09:12:39.080936927 +0000 UTC m=+334.844508385"
Sep 15 09:12:40.040642 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:40.040613    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-nkwh5"
Sep 15 09:12:45.018395 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:45.018363    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-m8wp4"
Sep 15 09:12:45.020564 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:12:45.020542    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-cltxs"
Sep 15 09:15:30.416324 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.416288    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7594f95958-pg2hv"]
Sep 15 09:15:30.419607 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.419587    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.422781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.422762    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tsfjp\""
Sep 15 09:15:30.422919 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.422805    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 09:15:30.423939 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.423923    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 09:15:30.424027 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.423947    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 09:15:30.428787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.428763    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7594f95958-pg2hv"]
Sep 15 09:15:30.554677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.554641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxz2c\" (UniqueName: \"kubernetes.io/projected/46878f80-0dd9-483e-a0b0-7682dc097220-kube-api-access-dxz2c\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.554677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.554684    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-webhook-cert\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.554915 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.554748    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-metrics-certs\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.655782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.655740    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxz2c\" (UniqueName: \"kubernetes.io/projected/46878f80-0dd9-483e-a0b0-7682dc097220-kube-api-access-dxz2c\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.655782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.655791    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-webhook-cert\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.655979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.655881    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-metrics-certs\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.658516 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.658486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-webhook-cert\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.658667 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.658645    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-metrics-certs\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.665918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.665892    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxz2c\" (UniqueName: \"kubernetes.io/projected/46878f80-0dd9-483e-a0b0-7682dc097220-kube-api-access-dxz2c\") pod \"maas-controller-7594f95958-pg2hv\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") " pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.730042 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.729965    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:30.997989 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:30.997965    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7594f95958-pg2hv"]
Sep 15 09:15:31.000398 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:15:31.000373    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46878f80_0dd9_483e_a0b0_7682dc097220.slice/crio-c83c36caa36971214c2bb0d0ac6412564752c5cdb6b61bb68b0e1f9f20e5a083 WatchSource:0}: Error finding container c83c36caa36971214c2bb0d0ac6412564752c5cdb6b61bb68b0e1f9f20e5a083: Status 404 returned error can't find the container with id c83c36caa36971214c2bb0d0ac6412564752c5cdb6b61bb68b0e1f9f20e5a083
Sep 15 09:15:31.703080 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:31.703047    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-pg2hv" event={"ID":"46878f80-0dd9-483e-a0b0-7682dc097220","Type":"ContainerStarted","Data":"c83c36caa36971214c2bb0d0ac6412564752c5cdb6b61bb68b0e1f9f20e5a083"}
Sep 15 09:15:33.713938 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:33.713896    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-pg2hv" event={"ID":"46878f80-0dd9-483e-a0b0-7682dc097220","Type":"ContainerStarted","Data":"928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993"}
Sep 15 09:15:33.714390 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:33.713985    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:15:33.749752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:33.749697    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7594f95958-pg2hv" podStartSLOduration=1.394842594 podStartE2EDuration="3.749678929s" totalImagesPullingTime="2.354836335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:15:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:15:33.745866242 +0000 UTC m=+509.509437680" watchObservedRunningTime="2026-09-15 09:15:33.749678929 +0000 UTC m=+509.513250431"
Sep 15 09:15:44.721341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:15:44.721307    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:16:05.528577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.528543    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"]
Sep 15 09:16:05.531633 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.531614    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:05.534330 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.534309    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-vblgr\""
Sep 15 09:16:05.534471 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.534455    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 15 09:16:05.541415 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.541389    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"]
Sep 15 09:16:05.619380 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.619347    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hk6b\" (UniqueName: \"kubernetes.io/projected/f8518e94-5fcf-4716-9b97-eb29e84d7fdc-kube-api-access-6hk6b\") pod \"payload-processing-5b54b7fbb7-2t2zf\" (UID: \"f8518e94-5fcf-4716-9b97-eb29e84d7fdc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:05.619546 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.619396    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8518e94-5fcf-4716-9b97-eb29e84d7fdc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2t2zf\" (UID: \"f8518e94-5fcf-4716-9b97-eb29e84d7fdc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:05.720643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.720603    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hk6b\" (UniqueName: \"kubernetes.io/projected/f8518e94-5fcf-4716-9b97-eb29e84d7fdc-kube-api-access-6hk6b\") pod \"payload-processing-5b54b7fbb7-2t2zf\" (UID: \"f8518e94-5fcf-4716-9b97-eb29e84d7fdc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:05.720819 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.720679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8518e94-5fcf-4716-9b97-eb29e84d7fdc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2t2zf\" (UID: \"f8518e94-5fcf-4716-9b97-eb29e84d7fdc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:05.721503 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.721484    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8518e94-5fcf-4716-9b97-eb29e84d7fdc-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-2t2zf\" (UID: \"f8518e94-5fcf-4716-9b97-eb29e84d7fdc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:05.732131 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.732111    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hk6b\" (UniqueName: \"kubernetes.io/projected/f8518e94-5fcf-4716-9b97-eb29e84d7fdc-kube-api-access-6hk6b\") pod \"payload-processing-5b54b7fbb7-2t2zf\" (UID: \"f8518e94-5fcf-4716-9b97-eb29e84d7fdc\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:05.842705 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:05.842619    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:06.117001 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:06.116975    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"]
Sep 15 09:16:06.119342 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:16:06.119311    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8518e94_5fcf_4716_9b97_eb29e84d7fdc.slice/crio-ad3dd431fcefabaebf3676aececdae3d4e11719542c2659d112058ec5d93ed09 WatchSource:0}: Error finding container ad3dd431fcefabaebf3676aececdae3d4e11719542c2659d112058ec5d93ed09: Status 404 returned error can't find the container with id ad3dd431fcefabaebf3676aececdae3d4e11719542c2659d112058ec5d93ed09
Sep 15 09:16:06.845600 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:06.845557    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf" event={"ID":"f8518e94-5fcf-4716-9b97-eb29e84d7fdc","Type":"ContainerStarted","Data":"ad3dd431fcefabaebf3676aececdae3d4e11719542c2659d112058ec5d93ed09"}
Sep 15 09:16:08.855529 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:08.855438    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf" event={"ID":"f8518e94-5fcf-4716-9b97-eb29e84d7fdc","Type":"ContainerStarted","Data":"4affaf3aae42185c703d4d7ddb29a7ca4789f45bdde41563b17a3bcc631da7ea"}
Sep 15 09:16:08.855910 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:08.855542    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:08.874303 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:08.874260    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf" podStartSLOduration=1.5391311779999999 podStartE2EDuration="3.874244298s" totalImagesPullingTime="2.33511312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:08.871592485 +0000 UTC m=+544.635163932" watchObservedRunningTime="2026-09-15 09:16:08.874244298 +0000 UTC m=+544.637815745"
Sep 15 09:16:19.862187 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:19.862157    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-2t2zf"
Sep 15 09:16:50.809218 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.809186    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"]
Sep 15 09:16:50.816238 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.816217    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:50.819114 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.819091    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 15 09:16:50.819217 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.819137    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 15 09:16:50.820380 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.820359    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 15 09:16:50.820490 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.820383    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c6slb\""
Sep 15 09:16:50.822035 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.822008    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"]
Sep 15 09:16:50.990921 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.990873    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:50.991095 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.990980    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:50.991095 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.991049    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:50.991095 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.991074    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r529l\" (UniqueName: \"kubernetes.io/projected/2891d30f-588b-47a2-8046-b04ea4aafd8d-kube-api-access-r529l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:50.991195 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.991135    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:50.991195 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:50.991169    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2891d30f-588b-47a2-8046-b04ea4aafd8d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.091617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.091534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.091617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.091588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.091617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.091606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r529l\" (UniqueName: \"kubernetes.io/projected/2891d30f-588b-47a2-8046-b04ea4aafd8d-kube-api-access-r529l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.091912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.091642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.091912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.091658    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2891d30f-588b-47a2-8046-b04ea4aafd8d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.091912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.091686    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.092069 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.091972    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.092069 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.092042    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.092153 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.092135    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.094142 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.094121    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/2891d30f-588b-47a2-8046-b04ea4aafd8d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.094395 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.094375    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/2891d30f-588b-47a2-8046-b04ea4aafd8d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.100782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.100754    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r529l\" (UniqueName: \"kubernetes.io/projected/2891d30f-588b-47a2-8046-b04ea4aafd8d-kube-api-access-r529l\") pod \"e2e-distinct-simulated-kserve-59975d69f9-dcdjg\" (UID: \"2891d30f-588b-47a2-8046-b04ea4aafd8d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.129784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.129747    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:16:51.403105 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:51.403030    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"]
Sep 15 09:16:51.405247 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:16:51.405212    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2891d30f_588b_47a2_8046_b04ea4aafd8d.slice/crio-d81d46f19792712e3babdacafce9961453b7092b96068e7dad98922cb40febcb WatchSource:0}: Error finding container d81d46f19792712e3babdacafce9961453b7092b96068e7dad98922cb40febcb: Status 404 returned error can't find the container with id d81d46f19792712e3babdacafce9961453b7092b96068e7dad98922cb40febcb
Sep 15 09:16:52.030433 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:52.030396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg" event={"ID":"2891d30f-588b-47a2-8046-b04ea4aafd8d","Type":"ContainerStarted","Data":"d81d46f19792712e3babdacafce9961453b7092b96068e7dad98922cb40febcb"}
Sep 15 09:16:53.035333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:53.035295    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg" event={"ID":"2891d30f-588b-47a2-8046-b04ea4aafd8d","Type":"ContainerStarted","Data":"7732c3dbf6364f34ef6b0ec3a9bd68a139cc0ca9ccf18b50184cbc87d16a3352"}
Sep 15 09:16:53.052617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:16:53.052568    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg" podStartSLOduration=2.102935688 podStartE2EDuration="3.052549776s" totalImagesPullingTime="949.614088ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:16:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:16:53.052075632 +0000 UTC m=+588.815647081" watchObservedRunningTime="2026-09-15 09:16:53.052549776 +0000 UTC m=+588.816121225"
Sep 15 09:17:01.130817 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:01.130754    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:17:01.131295 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:01.130877    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:17:01.143689 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:01.143659    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:17:02.085708 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:02.085682    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-dcdjg"
Sep 15 09:17:19.411737 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.411702    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"]
Sep 15 09:17:19.415306 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.415284    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.417947 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.417925    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 15 09:17:19.424487 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.424461    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"]
Sep 15 09:17:19.505120 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.505089    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.505314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.505152    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.505314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.505173    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.505314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.505207    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3d27ab2-227a-4eec-bd97-915a2fe84dee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.505314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.505230    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9vs2f\" (UniqueName: \"kubernetes.io/projected/b3d27ab2-227a-4eec-bd97-915a2fe84dee-kube-api-access-9vs2f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.505314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.505258    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606038 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.605999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606038 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.606039    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606292 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.606062    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3d27ab2-227a-4eec-bd97-915a2fe84dee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606292 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.606079    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9vs2f\" (UniqueName: \"kubernetes.io/projected/b3d27ab2-227a-4eec-bd97-915a2fe84dee-kube-api-access-9vs2f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606292 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.606108    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606292 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.606153    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606480 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.606395    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606480 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.606450    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.606563 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.606494    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.608521 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.608494    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3d27ab2-227a-4eec-bd97-915a2fe84dee-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.608680 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.608661    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3d27ab2-227a-4eec-bd97-915a2fe84dee-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.615272 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.615252    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9vs2f\" (UniqueName: \"kubernetes.io/projected/b3d27ab2-227a-4eec-bd97-915a2fe84dee-kube-api-access-9vs2f\") pod \"e2e-trlp-test-simulated-kserve-598466548d-7zh66\" (UID: \"b3d27ab2-227a-4eec-bd97-915a2fe84dee\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:19.728976 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:19.728890    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:20.003387 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:20.003362    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"]
Sep 15 09:17:20.005540 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:17:20.005513    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3d27ab2_227a_4eec_bd97_915a2fe84dee.slice/crio-b4c2fb91d63dbd21ccce52380ab509608a89f15b1e6aa6e8aab13ed3df009190 WatchSource:0}: Error finding container b4c2fb91d63dbd21ccce52380ab509608a89f15b1e6aa6e8aab13ed3df009190: Status 404 returned error can't find the container with id b4c2fb91d63dbd21ccce52380ab509608a89f15b1e6aa6e8aab13ed3df009190
Sep 15 09:17:20.147624 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:20.147588    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66" event={"ID":"b3d27ab2-227a-4eec-bd97-915a2fe84dee","Type":"ContainerStarted","Data":"b4c2fb91d63dbd21ccce52380ab509608a89f15b1e6aa6e8aab13ed3df009190"}
Sep 15 09:17:21.153087 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:21.153054    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66" event={"ID":"b3d27ab2-227a-4eec-bd97-915a2fe84dee","Type":"ContainerStarted","Data":"6b44994357579e6bc6840af2dd9063a3166655618024e878717daa8473060710"}
Sep 15 09:17:21.173531 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:21.173446    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66" podStartSLOduration=1.991651433 podStartE2EDuration="2.173428391s" totalImagesPullingTime="181.776958ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:17:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:17:21.172397574 +0000 UTC m=+616.935969045" watchObservedRunningTime="2026-09-15 09:17:21.173428391 +0000 UTC m=+616.936999840"
Sep 15 09:17:29.730101 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:29.730013    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:29.730101 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:29.730080    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:29.742687 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:29.742658    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:17:30.200823 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:17:30.200795    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-7zh66"
Sep 15 09:19:42.481296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.481246    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"]
Sep 15 09:19:42.484704 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.484684    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.487566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.487539    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-a23d9f-openshift-default-dockercfg-46mkl\""
Sep 15 09:19:42.496553 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.496530    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"]
Sep 15 09:19:42.591660 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.591629    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-certs\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.591820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.591693    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/813b4a28-d0ea-4b3e-81c4-bd9734658846-istiod-ca-cert\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.591820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.591782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-podinfo\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.591999 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.591819    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-token\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.591999 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.591897    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-envoy\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.591999 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.591921    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-data\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.592104 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.592003    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-credential-socket\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.592104 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.592041    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-socket\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.592104 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.592075    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hntpt\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-kube-api-access-hntpt\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.623347 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.623315    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"]
Sep 15 09:19:42.626901 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.626884    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.630575 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.630553    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-worker-w0-ffb593-openshift-default-dockercfg-z8vk6\""
Sep 15 09:19:42.664341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.664318    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"]
Sep 15 09:19:42.692748 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.692718    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-data\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.692748 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.692750    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-istio-token\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.692979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.692783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/813b4a28-d0ea-4b3e-81c4-bd9734658846-istiod-ca-cert\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.692979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.692811    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-envoy\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.692979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.692829    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-credential-socket\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.692979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.692867    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nntv6\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-kube-api-access-nntv6\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.692979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.692901    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-podinfo\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.692979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.692932    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-token\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693016    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-envoy\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693052    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-data\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693080    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-certs\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693111    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-credential-socket\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-socket\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693162    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c557059-43be-45ae-afc3-09489b3d264a-istio-podinfo\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693192    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-socket\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693230    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hntpt\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-kube-api-access-hntpt\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693265    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c557059-43be-45ae-afc3-09489b3d264a-istiod-ca-cert\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.693698 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-certs\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693698 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693550    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/813b4a28-d0ea-4b3e-81c4-bd9734658846-istiod-ca-cert\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693698 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693571    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-certs\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.693918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693892    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-socket\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.694048 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693921    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-data\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.694048 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.693976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-credential-socket\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.695607 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.695587    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-podinfo\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.695997 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.695976    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-envoy\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.708117 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.708089    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hntpt\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-kube-api-access-hntpt\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.709178 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.709159    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-token\") pod \"e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") " pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.794471 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794377    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-data\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.794471 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-istio-token\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.794471 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794441    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-envoy\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.794745 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794646    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-credential-socket\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.794745 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794701    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nntv6\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-kube-api-access-nntv6\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.794888 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794759    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-certs\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.794888 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794790    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-socket\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.794888 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c557059-43be-45ae-afc3-09489b3d264a-istio-podinfo\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.794888 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794880    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c557059-43be-45ae-afc3-09489b3d264a-istiod-ca-cert\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.795059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.794917    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-data\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.795626 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.795604    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-credential-socket\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.795791 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.795684    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-socket\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.795995 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.795971    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-certs\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.796778 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.796750    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c557059-43be-45ae-afc3-09489b3d264a-istiod-ca-cert\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.796976 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.796941    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:42.797115 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.797096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-envoy\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.797527 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.797510    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c557059-43be-45ae-afc3-09489b3d264a-istio-podinfo\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.803333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.802780    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-istio-token\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.803333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.803155    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nntv6\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-kube-api-access-nntv6\") pod \"e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") " pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:42.937261 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:42.937217    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:43.080656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.080570    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"]
Sep 15 09:19:43.082827 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:19:43.082792    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod813b4a28_d0ea_4b3e_81c4_bd9734658846.slice/crio-ef3fc66027c71d277b152290ee76177744ca8c74b1a55dd574cf3ac215ca0f41 WatchSource:0}: Error finding container ef3fc66027c71d277b152290ee76177744ca8c74b1a55dd574cf3ac215ca0f41: Status 404 returned error can't find the container with id ef3fc66027c71d277b152290ee76177744ca8c74b1a55dd574cf3ac215ca0f41
Sep 15 09:19:43.084959 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.084927    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:19:43.085017 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.084993    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:19:43.085050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.085021    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:19:43.222465 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.222434    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"]
Sep 15 09:19:43.226247 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:19:43.226219    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c557059_43be_45ae_afc3_09489b3d264a.slice/crio-46df280587b2edcf21f4675e92ec16be9fca8bed5e2512bca3c04203f159a8d9 WatchSource:0}: Error finding container 46df280587b2edcf21f4675e92ec16be9fca8bed5e2512bca3c04203f159a8d9: Status 404 returned error can't find the container with id 46df280587b2edcf21f4675e92ec16be9fca8bed5e2512bca3c04203f159a8d9
Sep 15 09:19:43.228659 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.228626    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:19:43.228790 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.228692    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:19:43.228790 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.228719    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:19:43.728507 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.728475    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" event={"ID":"813b4a28-d0ea-4b3e-81c4-bd9734658846","Type":"ContainerStarted","Data":"22707c45bf038f89a7dd0241c85bcef048e5b0d15c7eab5c298cd3a987aa733f"}
Sep 15 09:19:43.728987 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.728536    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" event={"ID":"813b4a28-d0ea-4b3e-81c4-bd9734658846","Type":"ContainerStarted","Data":"ef3fc66027c71d277b152290ee76177744ca8c74b1a55dd574cf3ac215ca0f41"}
Sep 15 09:19:43.730057 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.730033    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" event={"ID":"2c557059-43be-45ae-afc3-09489b3d264a","Type":"ContainerStarted","Data":"21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c"}
Sep 15 09:19:43.730184 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.730081    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" event={"ID":"2c557059-43be-45ae-afc3-09489b3d264a","Type":"ContainerStarted","Data":"46df280587b2edcf21f4675e92ec16be9fca8bed5e2512bca3c04203f159a8d9"}
Sep 15 09:19:43.752717 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.752672    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" podStartSLOduration=1.75265399 podStartE2EDuration="1.75265399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:43.751449884 +0000 UTC m=+759.515021345" watchObservedRunningTime="2026-09-15 09:19:43.75265399 +0000 UTC m=+759.516225436"
Sep 15 09:19:43.783687 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.783637    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podStartSLOduration=1.783619856 podStartE2EDuration="1.783619856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:43.782236738 +0000 UTC m=+759.545808200" watchObservedRunningTime="2026-09-15 09:19:43.783619856 +0000 UTC m=+759.547191304"
Sep 15 09:19:43.797465 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.797430    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:43.937780 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:43.937742    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:44.803050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:44.803022    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:44.942797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:44.942758    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:45.738582 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:45.738547    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:45.738761 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:45.738724    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:45.739477 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:45.739456    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:19:45.739587 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:45.739505    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:19:47.991903 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:47.991864    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"]
Sep 15 09:19:47.995749 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:47.995730    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:47.998895 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:47.998870    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w0-ffb593\""
Sep 15 09:19:47.999017 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:47.998930    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w0-ffb593-dockercfg-v9xjc\""
Sep 15 09:19:48.004151 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.004129    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"]
Sep 15 09:19:48.026702 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.026680    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"]
Sep 15 09:19:48.029783 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.029768    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.040546 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.040516    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"]
Sep 15 09:19:48.148701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.148663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k5mxj\" (UniqueName: \"kubernetes.io/projected/08ad40ba-7a64-4d54-b89a-9b527847a240-kube-api-access-k5mxj\") pod \"payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll\" (UID: \"08ad40ba-7a64-4d54-b89a-9b527847a240\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.148900 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.148732    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd\" (UID: \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:48.148900 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.148786    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08ad40ba-7a64-4d54-b89a-9b527847a240-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll\" (UID: \"08ad40ba-7a64-4d54-b89a-9b527847a240\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.148981 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.148915    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w9gwl\" (UniqueName: \"kubernetes.io/projected/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-kube-api-access-w9gwl\") pod \"payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd\" (UID: \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:48.250405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.250309    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k5mxj\" (UniqueName: \"kubernetes.io/projected/08ad40ba-7a64-4d54-b89a-9b527847a240-kube-api-access-k5mxj\") pod \"payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll\" (UID: \"08ad40ba-7a64-4d54-b89a-9b527847a240\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.250569 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.250405    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd\" (UID: \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:48.250569 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.250464    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08ad40ba-7a64-4d54-b89a-9b527847a240-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll\" (UID: \"08ad40ba-7a64-4d54-b89a-9b527847a240\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.250569 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.250520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w9gwl\" (UniqueName: \"kubernetes.io/projected/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-kube-api-access-w9gwl\") pod \"payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd\" (UID: \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:48.251194 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.251173    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08ad40ba-7a64-4d54-b89a-9b527847a240-plugins-config-volume\") pod \"payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll\" (UID: \"08ad40ba-7a64-4d54-b89a-9b527847a240\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.251271 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.251253    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd\" (UID: \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:48.259257 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.259232    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k5mxj\" (UniqueName: \"kubernetes.io/projected/08ad40ba-7a64-4d54-b89a-9b527847a240-kube-api-access-k5mxj\") pod \"payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll\" (UID: \"08ad40ba-7a64-4d54-b89a-9b527847a240\") " pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.259499 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.259479    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w9gwl\" (UniqueName: \"kubernetes.io/projected/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-kube-api-access-w9gwl\") pod \"payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd\" (UID: \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:48.307759 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.307727    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:48.340074 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.340040    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.591583 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.591560    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"]
Sep 15 09:19:48.593939 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:19:48.593913    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c958b7d_6826_4a5f_b3f7_3e6871faedbe.slice/crio-955ce58dfef978e1899ef8b3d121fefa3a92e5091a85a9aede56c90bbe05f5ec WatchSource:0}: Error finding container 955ce58dfef978e1899ef8b3d121fefa3a92e5091a85a9aede56c90bbe05f5ec: Status 404 returned error can't find the container with id 955ce58dfef978e1899ef8b3d121fefa3a92e5091a85a9aede56c90bbe05f5ec
Sep 15 09:19:48.632234 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.632204    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"]
Sep 15 09:19:48.634334 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:19:48.634308    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08ad40ba_7a64_4d54_b89a_9b527847a240.slice/crio-d4363f16bef63de083a2ab29160d4519dc76c672c7f8c9f0b5695df779028c04 WatchSource:0}: Error finding container d4363f16bef63de083a2ab29160d4519dc76c672c7f8c9f0b5695df779028c04: Status 404 returned error can't find the container with id d4363f16bef63de083a2ab29160d4519dc76c672c7f8c9f0b5695df779028c04
Sep 15 09:19:48.754282 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.754248    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll" event={"ID":"08ad40ba-7a64-4d54-b89a-9b527847a240","Type":"ContainerStarted","Data":"2c042846ba2a11a43e5caef3ad2d2661b8f53df4b56a48b83651adbf11f02dac"}
Sep 15 09:19:48.754447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.754313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll" event={"ID":"08ad40ba-7a64-4d54-b89a-9b527847a240","Type":"ContainerStarted","Data":"d4363f16bef63de083a2ab29160d4519dc76c672c7f8c9f0b5695df779028c04"}
Sep 15 09:19:48.754447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.754342    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:48.756122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.756097    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd" event={"ID":"9c958b7d-6826-4a5f-b3f7-3e6871faedbe","Type":"ContainerStarted","Data":"a1a1245d19af1a7f55c51c9b50f53fbd400368f974b9b21af8e76c5b4f613b5e"}
Sep 15 09:19:48.756227 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.756142    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd" event={"ID":"9c958b7d-6826-4a5f-b3f7-3e6871faedbe","Type":"ContainerStarted","Data":"955ce58dfef978e1899ef8b3d121fefa3a92e5091a85a9aede56c90bbe05f5ec"}
Sep 15 09:19:48.756287 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.756228    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:48.774791 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.774744    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll" podStartSLOduration=0.774728046 podStartE2EDuration="774.728046ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:48.773641797 +0000 UTC m=+764.537213245" watchObservedRunningTime="2026-09-15 09:19:48.774728046 +0000 UTC m=+764.538299484"
Sep 15 09:19:48.789078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:48.789029    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd" podStartSLOduration=1.789009853 podStartE2EDuration="1.789009853s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:48.788726904 +0000 UTC m=+764.552298364" watchObservedRunningTime="2026-09-15 09:19:48.789009853 +0000 UTC m=+764.552581302"
Sep 15 09:19:49.108169 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.108132    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"]
Sep 15 09:19:49.112025 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.112004    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:49.114705 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.114688    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-worker-w4-890f3e\""
Sep 15 09:19:49.114811 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.114711    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-worker-w4-890f3e-dockercfg-mcv9d\""
Sep 15 09:19:49.122862 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.122800    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"]
Sep 15 09:19:49.257462 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.257421    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2csc\" (UniqueName: \"kubernetes.io/projected/52e5e249-ceeb-410f-aea4-4f1de1d31e91-kube-api-access-h2csc\") pod \"payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd\" (UID: \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:49.257622 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.257477    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52e5e249-ceeb-410f-aea4-4f1de1d31e91-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd\" (UID: \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:49.358332 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.358249    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2csc\" (UniqueName: \"kubernetes.io/projected/52e5e249-ceeb-410f-aea4-4f1de1d31e91-kube-api-access-h2csc\") pod \"payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd\" (UID: \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:49.358332 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.358296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52e5e249-ceeb-410f-aea4-4f1de1d31e91-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd\" (UID: \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:49.359050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.359022    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52e5e249-ceeb-410f-aea4-4f1de1d31e91-plugins-config-volume\") pod \"payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd\" (UID: \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:49.366632 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.366611    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2csc\" (UniqueName: \"kubernetes.io/projected/52e5e249-ceeb-410f-aea4-4f1de1d31e91-kube-api-access-h2csc\") pod \"payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd\" (UID: \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\") " pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:49.423323 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.423289    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:49.698978 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.698947    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"]
Sep 15 09:19:49.701822 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:19:49.701797    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52e5e249_ceeb_410f_aea4_4f1de1d31e91.slice/crio-d667a31a8230603f1a354cf9a466f6d48202966fbbe643e00e39cbf48a71acc0 WatchSource:0}: Error finding container d667a31a8230603f1a354cf9a466f6d48202966fbbe643e00e39cbf48a71acc0: Status 404 returned error can't find the container with id d667a31a8230603f1a354cf9a466f6d48202966fbbe643e00e39cbf48a71acc0
Sep 15 09:19:49.769250 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:49.769185    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd" event={"ID":"52e5e249-ceeb-410f-aea4-4f1de1d31e91","Type":"ContainerStarted","Data":"d667a31a8230603f1a354cf9a466f6d48202966fbbe643e00e39cbf48a71acc0"}
Sep 15 09:19:50.775562 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:50.775524    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd" event={"ID":"52e5e249-ceeb-410f-aea4-4f1de1d31e91","Type":"ContainerStarted","Data":"1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f"}
Sep 15 09:19:50.775977 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:50.775662    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:19:50.795040 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:50.794989    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd" podStartSLOduration=1.794969563 podStartE2EDuration="1.794969563s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:50.792856383 +0000 UTC m=+766.556427830" watchObservedRunningTime="2026-09-15 09:19:50.794969563 +0000 UTC m=+766.558541014"
Sep 15 09:19:50.975442 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:50.975408    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"]
Sep 15 09:19:50.978720 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:50.978705    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:50.981376 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:50.981356    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-a-a23d9f\""
Sep 15 09:19:50.992408 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:50.992383    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"]
Sep 15 09:19:51.019799 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.019771    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"]
Sep 15 09:19:51.023042 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.023026    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.027270 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.027218    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-a-a23d9f-dockercfg-wdrbm\""
Sep 15 09:19:51.037095 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.037072    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"]
Sep 15 09:19:51.074573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.074547    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5fdj\" (UniqueName: \"kubernetes.io/projected/6f1882c1-8069-4c9d-9832-a9774d5cf886-kube-api-access-c5fdj\") pod \"payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh\" (UID: \"6f1882c1-8069-4c9d-9832-a9774d5cf886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:51.074735 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.074624    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f1882c1-8069-4c9d-9832-a9774d5cf886-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh\" (UID: \"6f1882c1-8069-4c9d-9832-a9774d5cf886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:51.175410 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.175374    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5fdj\" (UniqueName: \"kubernetes.io/projected/6f1882c1-8069-4c9d-9832-a9774d5cf886-kube-api-access-c5fdj\") pod \"payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh\" (UID: \"6f1882c1-8069-4c9d-9832-a9774d5cf886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:51.175596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.175440    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lwfnp\" (UniqueName: \"kubernetes.io/projected/4f50f649-b813-475d-91fb-c78f156823ce-kube-api-access-lwfnp\") pod \"payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs\" (UID: \"4f50f649-b813-475d-91fb-c78f156823ce\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.175596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.175465    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f50f649-b813-475d-91fb-c78f156823ce-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs\" (UID: \"4f50f649-b813-475d-91fb-c78f156823ce\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.175596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.175488    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f1882c1-8069-4c9d-9832-a9774d5cf886-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh\" (UID: \"6f1882c1-8069-4c9d-9832-a9774d5cf886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:51.176233 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.176211    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f1882c1-8069-4c9d-9832-a9774d5cf886-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh\" (UID: \"6f1882c1-8069-4c9d-9832-a9774d5cf886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:51.184238 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.184211    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5fdj\" (UniqueName: \"kubernetes.io/projected/6f1882c1-8069-4c9d-9832-a9774d5cf886-kube-api-access-c5fdj\") pod \"payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh\" (UID: \"6f1882c1-8069-4c9d-9832-a9774d5cf886\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:51.276868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.276805    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lwfnp\" (UniqueName: \"kubernetes.io/projected/4f50f649-b813-475d-91fb-c78f156823ce-kube-api-access-lwfnp\") pod \"payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs\" (UID: \"4f50f649-b813-475d-91fb-c78f156823ce\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.276868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.276865    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f50f649-b813-475d-91fb-c78f156823ce-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs\" (UID: \"4f50f649-b813-475d-91fb-c78f156823ce\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.277630 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.277589    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f50f649-b813-475d-91fb-c78f156823ce-plugins-config-volume\") pod \"payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs\" (UID: \"4f50f649-b813-475d-91fb-c78f156823ce\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.286450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.286423    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lwfnp\" (UniqueName: \"kubernetes.io/projected/4f50f649-b813-475d-91fb-c78f156823ce-kube-api-access-lwfnp\") pod \"payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs\" (UID: \"4f50f649-b813-475d-91fb-c78f156823ce\") " pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.289159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.289138    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:51.333990 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.333957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.570589 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.570564    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"]
Sep 15 09:19:51.572950 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:19:51.572928    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f1882c1_8069_4c9d_9832_a9774d5cf886.slice/crio-74eb6244b64acd760388d74d2d6f4c1fd15e2e99ed9ae1503ae40a2de18d9177 WatchSource:0}: Error finding container 74eb6244b64acd760388d74d2d6f4c1fd15e2e99ed9ae1503ae40a2de18d9177: Status 404 returned error can't find the container with id 74eb6244b64acd760388d74d2d6f4c1fd15e2e99ed9ae1503ae40a2de18d9177
Sep 15 09:19:51.616174 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.616146    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"]
Sep 15 09:19:51.620569 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:19:51.620547    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f50f649_b813_475d_91fb_c78f156823ce.slice/crio-6b85d464aac5a19484bf6683818b0494b811b287e99965471b93333bc65ded8a WatchSource:0}: Error finding container 6b85d464aac5a19484bf6683818b0494b811b287e99965471b93333bc65ded8a: Status 404 returned error can't find the container with id 6b85d464aac5a19484bf6683818b0494b811b287e99965471b93333bc65ded8a
Sep 15 09:19:51.782161 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.782117    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs" event={"ID":"4f50f649-b813-475d-91fb-c78f156823ce","Type":"ContainerStarted","Data":"ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee"}
Sep 15 09:19:51.782608 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.782175    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs" event={"ID":"4f50f649-b813-475d-91fb-c78f156823ce","Type":"ContainerStarted","Data":"6b85d464aac5a19484bf6683818b0494b811b287e99965471b93333bc65ded8a"}
Sep 15 09:19:51.782608 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.782204    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:19:51.783867 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.783831    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh" event={"ID":"6f1882c1-8069-4c9d-9832-a9774d5cf886","Type":"ContainerStarted","Data":"92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24"}
Sep 15 09:19:51.784069 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.784029    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:19:51.784165 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.784083    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh" event={"ID":"6f1882c1-8069-4c9d-9832-a9774d5cf886","Type":"ContainerStarted","Data":"74eb6244b64acd760388d74d2d6f4c1fd15e2e99ed9ae1503ae40a2de18d9177"}
Sep 15 09:19:51.800014 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.799933    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs" podStartSLOduration=1.799913423 podStartE2EDuration="1.799913423s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:51.798102895 +0000 UTC m=+767.561674348" watchObservedRunningTime="2026-09-15 09:19:51.799913423 +0000 UTC m=+767.563484890"
Sep 15 09:19:51.815989 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:51.815940    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh" podStartSLOduration=1.815920501 podStartE2EDuration="1.815920501s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:19:51.813591979 +0000 UTC m=+767.577163428" watchObservedRunningTime="2026-09-15 09:19:51.815920501 +0000 UTC m=+767.579491953"
Sep 15 09:19:59.096280 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.096234    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"]
Sep 15 09:19:59.100348 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.100303    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:19:59.105644 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.105616    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ca71c041\""
Sep 15 09:19:59.106179 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.106159    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ca71c041-dockercfg-9kkgr\""
Sep 15 09:19:59.115341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.115315    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"]
Sep 15 09:19:59.160498 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.160344    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/265e3add-f3d9-46d8-8e2c-ab655a17628d-plugins-config-volume\") pod \"payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd\" (UID: \"265e3add-f3d9-46d8-8e2c-ab655a17628d\") " pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:19:59.160498 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.160453    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m75k7\" (UniqueName: \"kubernetes.io/projected/265e3add-f3d9-46d8-8e2c-ab655a17628d-kube-api-access-m75k7\") pod \"payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd\" (UID: \"265e3add-f3d9-46d8-8e2c-ab655a17628d\") " pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:19:59.261246 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.261197    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m75k7\" (UniqueName: \"kubernetes.io/projected/265e3add-f3d9-46d8-8e2c-ab655a17628d-kube-api-access-m75k7\") pod \"payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd\" (UID: \"265e3add-f3d9-46d8-8e2c-ab655a17628d\") " pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:19:59.261414 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.261291    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/265e3add-f3d9-46d8-8e2c-ab655a17628d-plugins-config-volume\") pod \"payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd\" (UID: \"265e3add-f3d9-46d8-8e2c-ab655a17628d\") " pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:19:59.262214 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.262195    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/265e3add-f3d9-46d8-8e2c-ab655a17628d-plugins-config-volume\") pod \"payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd\" (UID: \"265e3add-f3d9-46d8-8e2c-ab655a17628d\") " pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:19:59.274496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.274464    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m75k7\" (UniqueName: \"kubernetes.io/projected/265e3add-f3d9-46d8-8e2c-ab655a17628d-kube-api-access-m75k7\") pod \"payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd\" (UID: \"265e3add-f3d9-46d8-8e2c-ab655a17628d\") " pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:19:59.423446 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.423398    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:19:59.720989 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.720892    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"]
Sep 15 09:19:59.742415 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:19:59.742369    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod265e3add_f3d9_46d8_8e2c_ab655a17628d.slice/crio-ff999e14acd28088e57e2096c396caf620e50c9918df657011c2a9cc5114e84d WatchSource:0}: Error finding container ff999e14acd28088e57e2096c396caf620e50c9918df657011c2a9cc5114e84d: Status 404 returned error can't find the container with id ff999e14acd28088e57e2096c396caf620e50c9918df657011c2a9cc5114e84d
Sep 15 09:19:59.772242 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.772221    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:19:59.772582 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.772557    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:19:59.848657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:19:59.848585    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd" event={"ID":"265e3add-f3d9-46d8-8e2c-ab655a17628d","Type":"ContainerStarted","Data":"ff999e14acd28088e57e2096c396caf620e50c9918df657011c2a9cc5114e84d"}
Sep 15 09:20:00.504316 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.504273    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"]
Sep 15 09:20:00.508398 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.508375    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:00.513315 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.513296    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-abf07f-dockercfg-sz86z\""
Sep 15 09:20:00.513859 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.513828    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-abf07f\""
Sep 15 09:20:00.517916 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.517887    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"]
Sep 15 09:20:00.573679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.573185    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33cf363-90ee-4dba-966b-51ff353fdd48-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl\" (UID: \"e33cf363-90ee-4dba-966b-51ff353fdd48\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:00.573679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.573260    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dr9qh\" (UniqueName: \"kubernetes.io/projected/e33cf363-90ee-4dba-966b-51ff353fdd48-kube-api-access-dr9qh\") pod \"payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl\" (UID: \"e33cf363-90ee-4dba-966b-51ff353fdd48\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:00.584948 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.584922    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"]
Sep 15 09:20:00.588522 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.588502    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:00.602055 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.601550    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"]
Sep 15 09:20:00.674752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.674717    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33cf363-90ee-4dba-966b-51ff353fdd48-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl\" (UID: \"e33cf363-90ee-4dba-966b-51ff353fdd48\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:00.674752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.674752    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dr9qh\" (UniqueName: \"kubernetes.io/projected/e33cf363-90ee-4dba-966b-51ff353fdd48-kube-api-access-dr9qh\") pod \"payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl\" (UID: \"e33cf363-90ee-4dba-966b-51ff353fdd48\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:00.675013 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.674782    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-plugins-config-volume\") pod \"payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86\" (UID: \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\") " pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:00.675013 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.674804    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr9hm\" (UniqueName: \"kubernetes.io/projected/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-kube-api-access-qr9hm\") pod \"payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86\" (UID: \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\") " pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:00.675492 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.675469    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33cf363-90ee-4dba-966b-51ff353fdd48-plugins-config-volume\") pod \"payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl\" (UID: \"e33cf363-90ee-4dba-966b-51ff353fdd48\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:00.683165 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.683140    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dr9qh\" (UniqueName: \"kubernetes.io/projected/e33cf363-90ee-4dba-966b-51ff353fdd48-kube-api-access-dr9qh\") pod \"payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl\" (UID: \"e33cf363-90ee-4dba-966b-51ff353fdd48\") " pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:00.775814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.775731    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-plugins-config-volume\") pod \"payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86\" (UID: \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\") " pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:00.775814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.775773    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr9hm\" (UniqueName: \"kubernetes.io/projected/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-kube-api-access-qr9hm\") pod \"payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86\" (UID: \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\") " pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:00.776812 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.776793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-plugins-config-volume\") pod \"payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86\" (UID: \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\") " pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:00.785454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.785433    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr9hm\" (UniqueName: \"kubernetes.io/projected/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-kube-api-access-qr9hm\") pod \"payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86\" (UID: \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\") " pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:00.826573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.826532    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:00.857432 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.857387    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd" event={"ID":"265e3add-f3d9-46d8-8e2c-ab655a17628d","Type":"ContainerStarted","Data":"6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24"}
Sep 15 09:20:00.857612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.857599    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:20:00.877144 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.877078    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd" podStartSLOduration=1.8770588940000001 podStartE2EDuration="1.877058894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:19:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:00.874575653 +0000 UTC m=+776.638147111" watchObservedRunningTime="2026-09-15 09:20:00.877058894 +0000 UTC m=+776.640630342"
Sep 15 09:20:00.919319 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:00.919294    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:01.121611 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.121588    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"]
Sep 15 09:20:01.124384 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:20:01.124344    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode33cf363_90ee_4dba_966b_51ff353fdd48.slice/crio-21fd40045c05690d9a3169d3b586d502fac09f248e31d60bc4295f01c7ff3578 WatchSource:0}: Error finding container 21fd40045c05690d9a3169d3b586d502fac09f248e31d60bc4295f01c7ff3578: Status 404 returned error can't find the container with id 21fd40045c05690d9a3169d3b586d502fac09f248e31d60bc4295f01c7ff3578
Sep 15 09:20:01.215882 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.215860    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"]
Sep 15 09:20:01.218347 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:20:01.218316    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4de8270a_a8ea_4c3a_a53e_b5351b865f9c.slice/crio-e6148dcb2402b94d59d58662d909ae5156712b5fe142da973f7c587cc2ba1b76 WatchSource:0}: Error finding container e6148dcb2402b94d59d58662d909ae5156712b5fe142da973f7c587cc2ba1b76: Status 404 returned error can't find the container with id e6148dcb2402b94d59d58662d909ae5156712b5fe142da973f7c587cc2ba1b76
Sep 15 09:20:01.789018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.788985    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:20:01.868516 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.867711    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86" event={"ID":"4de8270a-a8ea-4c3a-a53e-b5351b865f9c","Type":"ContainerStarted","Data":"a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9"}
Sep 15 09:20:01.868867 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.868717    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86" event={"ID":"4de8270a-a8ea-4c3a-a53e-b5351b865f9c","Type":"ContainerStarted","Data":"e6148dcb2402b94d59d58662d909ae5156712b5fe142da973f7c587cc2ba1b76"}
Sep 15 09:20:01.869653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.869604    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:01.872421 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.872037    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl" event={"ID":"e33cf363-90ee-4dba-966b-51ff353fdd48","Type":"ContainerStarted","Data":"9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40"}
Sep 15 09:20:01.872421 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.872079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl" event={"ID":"e33cf363-90ee-4dba-966b-51ff353fdd48","Type":"ContainerStarted","Data":"21fd40045c05690d9a3169d3b586d502fac09f248e31d60bc4295f01c7ff3578"}
Sep 15 09:20:01.872421 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.872106    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:01.897335 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.896268    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86" podStartSLOduration=1.896244363 podStartE2EDuration="1.896244363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:01.893922647 +0000 UTC m=+777.657494097" watchObservedRunningTime="2026-09-15 09:20:01.896244363 +0000 UTC m=+777.659815816"
Sep 15 09:20:01.914659 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:01.914580    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl" podStartSLOduration=1.914562967 podStartE2EDuration="1.914562967s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:01.91274932 +0000 UTC m=+777.676320771" watchObservedRunningTime="2026-09-15 09:20:01.914562967 +0000 UTC m=+777.678134417"
Sep 15 09:20:02.791077 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:02.791046    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:20:02.792084 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:02.791923    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:20:04.889997 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.889960    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c557059-43be-45ae-afc3-09489b3d264a" containerID="21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c" exitCode=0
Sep 15 09:20:04.890477 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.890032    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" event={"ID":"2c557059-43be-45ae-afc3-09489b3d264a","Type":"ContainerDied","Data":"21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c"}
Sep 15 09:20:04.890550 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.890529    2568 scope.go:117] "RemoveContainer" containerID="21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c"
Sep 15 09:20:04.892064 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.892025    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:20:04.892189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.892115    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:20:04.892189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.892159    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:20:04.892481 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.892457    2568 generic.go:356] "Generic (PLEG): container finished" podID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerID="22707c45bf038f89a7dd0241c85bcef048e5b0d15c7eab5c298cd3a987aa733f" exitCode=0
Sep 15 09:20:04.892652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.892549    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" event={"ID":"813b4a28-d0ea-4b3e-81c4-bd9734658846","Type":"ContainerDied","Data":"22707c45bf038f89a7dd0241c85bcef048e5b0d15c7eab5c298cd3a987aa733f"}
Sep 15 09:20:04.893111 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.893094    2568 scope.go:117] "RemoveContainer" containerID="22707c45bf038f89a7dd0241c85bcef048e5b0d15c7eab5c298cd3a987aa733f"
Sep 15 09:20:04.894305 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.894272    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:20:04.894398 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.894354    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:20:04.894460 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:04.894403    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:20:05.903143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:05.903099    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" event={"ID":"2c557059-43be-45ae-afc3-09489b3d264a","Type":"ContainerStarted","Data":"23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc"}
Sep 15 09:20:05.906311 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:05.906276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" event={"ID":"813b4a28-d0ea-4b3e-81c4-bd9734658846","Type":"ContainerStarted","Data":"1c70cfbd6a905c8bcc5bdabb4785d72215da7a621eb71a57127e610068f6a7a8"}
Sep 15 09:20:05.938575 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:05.938537    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:20:05.938780 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:05.938611    2568 patch_prober.go:28] interesting pod/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 15 09:20:05.938780 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:05.938690    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 15 09:20:06.799261 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:06.799220    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:20:06.799461 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:06.799342    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 15 09:20:06.799461 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:06.799388    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 15 09:20:06.938155 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:06.938115    2568 patch_prober.go:28] interesting pod/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 15 09:20:06.938723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:06.938692    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 15 09:20:07.798108 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:07.798070    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 15 09:20:07.798413 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:07.798379    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 15 09:20:07.938271 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:07.938233    2568 patch_prober.go:28] interesting pod/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 15 09:20:07.938863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:07.938808    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 15 09:20:08.798235 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:08.798198    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 15 09:20:08.798526 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:08.798497    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 15 09:20:08.939423 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:08.939391    2568 patch_prober.go:28] interesting pod/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 15 09:20:08.940007 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:08.939977    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 15 09:20:09.799039 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:09.798557    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 15 09:20:09.799039 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:09.798622    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 15 09:20:09.938814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:09.938324    2568 patch_prober.go:28] interesting pod/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 15 09:20:09.938814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:09.938392    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 15 09:20:10.798169 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:10.798132    2568 patch_prober.go:28] interesting pod/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused" start-of-body=
Sep 15 09:20:10.798751 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:10.798719    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.23:15021/healthz/ready\": dial tcp 10.134.0.23:15021: connect: connection refused"
Sep 15 09:20:10.938287 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:10.938250    2568 patch_prober.go:28] interesting pod/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused" start-of-body=
Sep 15 09:20:10.938567 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:10.938540    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.24:15021/healthz/ready\": dial tcp 10.134.0.24:15021: connect: connection refused"
Sep 15 09:20:11.802319 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:11.802289    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:20:11.802797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:11.802550    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:20:11.803413 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:11.803394    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:20:11.874296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:11.874266    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:20:11.942671 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:11.942642    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:20:11.943028 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:11.943004    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:20:11.943767 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:11.943752    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:20:12.878558 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:12.878523    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:20:13.885488 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:13.885460    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:20:14.534689 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.534652    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"]
Sep 15 09:20:14.539679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.539654    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"
Sep 15 09:20:14.542429 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.542408    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:20:14.542429 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.542423    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:20:14.546272 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.546246    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"]
Sep 15 09:20:14.641516 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.641468    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf06add-563e-464d-a826-9f98c56629a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b\" (UID: \"8cf06add-563e-464d-a826-9f98c56629a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"
Sep 15 09:20:14.742556 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.742525    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf06add-563e-464d-a826-9f98c56629a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b\" (UID: \"8cf06add-563e-464d-a826-9f98c56629a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"
Sep 15 09:20:14.743232 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.743210    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf06add-563e-464d-a826-9f98c56629a1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b\" (UID: \"8cf06add-563e-464d-a826-9f98c56629a1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"
Sep 15 09:20:14.853225 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:14.853137    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"
Sep 15 09:20:15.129104 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:15.129034    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"]
Sep 15 09:20:15.131513 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:20:15.131490    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf06add_563e_464d_a826_9f98c56629a1.slice/crio-f325a34e8c0c746f5c5f24c6681eed78d4722d56e0af4918551b172e5c8e0ecb WatchSource:0}: Error finding container f325a34e8c0c746f5c5f24c6681eed78d4722d56e0af4918551b172e5c8e0ecb: Status 404 returned error can't find the container with id f325a34e8c0c746f5c5f24c6681eed78d4722d56e0af4918551b172e5c8e0ecb
Sep 15 09:20:15.133990 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:15.133971    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:20:15.972099 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:15.972069    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b" event={"ID":"8cf06add-563e-464d-a826-9f98c56629a1","Type":"ContainerStarted","Data":"f325a34e8c0c746f5c5f24c6681eed78d4722d56e0af4918551b172e5c8e0ecb"}
Sep 15 09:20:17.988971 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:17.988833    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b" event={"ID":"8cf06add-563e-464d-a826-9f98c56629a1","Type":"ContainerStarted","Data":"6ececdffb14631d006359cb0bb3c81d94e84d04caca1aa33f72b0896da45bc15"}
Sep 15 09:20:18.004416 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.004353    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b" podStartSLOduration=1.444463214 podStartE2EDuration="4.004263351s" totalImagesPullingTime="2.559800137s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:18.003955477 +0000 UTC m=+793.767526955" watchObservedRunningTime="2026-09-15 09:20:18.004263351 +0000 UTC m=+793.767834800"
Sep 15 09:20:18.574566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.574529    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"]
Sep 15 09:20:18.578550 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.578530    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:18.581598 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.581576    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-2430e2\""
Sep 15 09:20:18.587427 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.587371    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"]
Sep 15 09:20:18.678122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.678086    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jg66t\" (UniqueName: \"kubernetes.io/projected/3420b4bd-11d5-4aee-9b2b-a1614cae3865-kube-api-access-jg66t\") pod \"payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828\" (UID: \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:18.678288 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.678160    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3420b4bd-11d5-4aee-9b2b-a1614cae3865-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828\" (UID: \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:18.778995 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.778913    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jg66t\" (UniqueName: \"kubernetes.io/projected/3420b4bd-11d5-4aee-9b2b-a1614cae3865-kube-api-access-jg66t\") pod \"payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828\" (UID: \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:18.778995 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.778980    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3420b4bd-11d5-4aee-9b2b-a1614cae3865-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828\" (UID: \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:18.779774 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.779753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3420b4bd-11d5-4aee-9b2b-a1614cae3865-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828\" (UID: \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:18.787214 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.787189    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jg66t\" (UniqueName: \"kubernetes.io/projected/3420b4bd-11d5-4aee-9b2b-a1614cae3865-kube-api-access-jg66t\") pod \"payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828\" (UID: \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:18.892297 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.892261    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:18.994031 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.993996    2568 generic.go:356] "Generic (PLEG): container finished" podID="8cf06add-563e-464d-a826-9f98c56629a1" containerID="6ececdffb14631d006359cb0bb3c81d94e84d04caca1aa33f72b0896da45bc15" exitCode=0
Sep 15 09:20:18.994438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:18.994044    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b" event={"ID":"8cf06add-563e-464d-a826-9f98c56629a1","Type":"ContainerDied","Data":"6ececdffb14631d006359cb0bb3c81d94e84d04caca1aa33f72b0896da45bc15"}
Sep 15 09:20:19.168981 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:19.168947    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"]
Sep 15 09:20:19.172285 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:20:19.172258    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3420b4bd_11d5_4aee_9b2b_a1614cae3865.slice/crio-a249e0a1ebab41420d0144dd4f027af9f4558d200f87545ea30889e5fb1ad503 WatchSource:0}: Error finding container a249e0a1ebab41420d0144dd4f027af9f4558d200f87545ea30889e5fb1ad503: Status 404 returned error can't find the container with id a249e0a1ebab41420d0144dd4f027af9f4558d200f87545ea30889e5fb1ad503
Sep 15 09:20:20.000705 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:20.000668    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828" event={"ID":"3420b4bd-11d5-4aee-9b2b-a1614cae3865","Type":"ContainerStarted","Data":"99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3"}
Sep 15 09:20:20.001175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:20.000737    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828" event={"ID":"3420b4bd-11d5-4aee-9b2b-a1614cae3865","Type":"ContainerStarted","Data":"a249e0a1ebab41420d0144dd4f027af9f4558d200f87545ea30889e5fb1ad503"}
Sep 15 09:20:20.001175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:20.000814    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:20.017570 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:20.017244    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828" podStartSLOduration=2.017225793 podStartE2EDuration="2.017225793s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:20.017012574 +0000 UTC m=+795.780584024" watchObservedRunningTime="2026-09-15 09:20:20.017225793 +0000 UTC m=+795.780797245"
Sep 15 09:20:20.143884 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:20.143836    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"
Sep 15 09:20:20.295428 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:20.295335    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf06add-563e-464d-a826-9f98c56629a1-maas-api-service-ca\") pod \"8cf06add-563e-464d-a826-9f98c56629a1\" (UID: \"8cf06add-563e-464d-a826-9f98c56629a1\") "
Sep 15 09:20:20.295685 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:20.295654    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8cf06add-563e-464d-a826-9f98c56629a1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8cf06add-563e-464d-a826-9f98c56629a1" (UID: "8cf06add-563e-464d-a826-9f98c56629a1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:20:20.396941 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:20.396910    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8cf06add-563e-464d-a826-9f98c56629a1-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:20:21.008116 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:21.008085    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b" event={"ID":"8cf06add-563e-464d-a826-9f98c56629a1","Type":"ContainerDied","Data":"f325a34e8c0c746f5c5f24c6681eed78d4722d56e0af4918551b172e5c8e0ecb"}
Sep 15 09:20:21.008116 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:21.008120    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"
Sep 15 09:20:21.008519 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:21.008139    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f325a34e8c0c746f5c5f24c6681eed78d4722d56e0af4918551b172e5c8e0ecb"
Sep 15 09:20:25.373397 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.373364    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"]
Sep 15 09:20:25.373897 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.373578    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd" podUID="265e3add-f3d9-46d8-8e2c-ab655a17628d" containerName="payload-processing" containerID="cri-o://6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24" gracePeriod=30
Sep 15 09:20:25.542983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.542945    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"]
Sep 15 09:20:25.546690 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.546668    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-ca71c041-4hq8b"]
Sep 15 09:20:25.634006 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.633920    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:20:25.746610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.746579    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m75k7\" (UniqueName: \"kubernetes.io/projected/265e3add-f3d9-46d8-8e2c-ab655a17628d-kube-api-access-m75k7\") pod \"265e3add-f3d9-46d8-8e2c-ab655a17628d\" (UID: \"265e3add-f3d9-46d8-8e2c-ab655a17628d\") "
Sep 15 09:20:25.746794 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.746642    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/265e3add-f3d9-46d8-8e2c-ab655a17628d-plugins-config-volume\") pod \"265e3add-f3d9-46d8-8e2c-ab655a17628d\" (UID: \"265e3add-f3d9-46d8-8e2c-ab655a17628d\") "
Sep 15 09:20:25.747048 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.747023    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/265e3add-f3d9-46d8-8e2c-ab655a17628d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "265e3add-f3d9-46d8-8e2c-ab655a17628d" (UID: "265e3add-f3d9-46d8-8e2c-ab655a17628d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:20:25.749158 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.749137    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/265e3add-f3d9-46d8-8e2c-ab655a17628d-kube-api-access-m75k7" (OuterVolumeSpecName: "kube-api-access-m75k7") pod "265e3add-f3d9-46d8-8e2c-ab655a17628d" (UID: "265e3add-f3d9-46d8-8e2c-ab655a17628d"). InnerVolumeSpecName "kube-api-access-m75k7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:20:25.847429 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.847398    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m75k7\" (UniqueName: \"kubernetes.io/projected/265e3add-f3d9-46d8-8e2c-ab655a17628d-kube-api-access-m75k7\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:20:25.847429 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:25.847424    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/265e3add-f3d9-46d8-8e2c-ab655a17628d-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:20:26.035989 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.035951    2568 generic.go:356] "Generic (PLEG): container finished" podID="265e3add-f3d9-46d8-8e2c-ab655a17628d" containerID="6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24" exitCode=0
Sep 15 09:20:26.036190 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.036017    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"
Sep 15 09:20:26.036190 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.036078    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd" event={"ID":"265e3add-f3d9-46d8-8e2c-ab655a17628d","Type":"ContainerDied","Data":"6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24"}
Sep 15 09:20:26.036190 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.036130    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd" event={"ID":"265e3add-f3d9-46d8-8e2c-ab655a17628d","Type":"ContainerDied","Data":"ff999e14acd28088e57e2096c396caf620e50c9918df657011c2a9cc5114e84d"}
Sep 15 09:20:26.036369 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.036194    2568 scope.go:117] "RemoveContainer" containerID="6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24"
Sep 15 09:20:26.049554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.049527    2568 scope.go:117] "RemoveContainer" containerID="6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24"
Sep 15 09:20:26.049935 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:20:26.049864    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24\": container with ID starting with 6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24 not found: ID does not exist" containerID="6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24"
Sep 15 09:20:26.049935 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.049893    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24"} err="failed to get container status \"6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24\": rpc error: code = NotFound desc = could not find container \"6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24\": container with ID starting with 6fb84768cb8720dd7d46a234e00a1a7d08668439d3cfa6b3d9470404eb4cbc24 not found: ID does not exist"
Sep 15 09:20:26.063805 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.063778    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"]
Sep 15 09:20:26.065571 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.065552    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ca71c041-6f78c5c5c9-b8tfd"]
Sep 15 09:20:26.789782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.789556    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="265e3add-f3d9-46d8-8e2c-ab655a17628d" path="/var/lib/kubelet/pods/265e3add-f3d9-46d8-8e2c-ab655a17628d/volumes"
Sep 15 09:20:26.790304 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:26.790016    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8cf06add-563e-464d-a826-9f98c56629a1" path="/var/lib/kubelet/pods/8cf06add-563e-464d-a826-9f98c56629a1/volumes"
Sep 15 09:20:31.010481 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:31.010438    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:20:32.013632 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.013596    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"]
Sep 15 09:20:32.014020 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.014006    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8cf06add-563e-464d-a826-9f98c56629a1" containerName="revoke-keys"
Sep 15 09:20:32.014075 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.014021    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8cf06add-563e-464d-a826-9f98c56629a1" containerName="revoke-keys"
Sep 15 09:20:32.014075 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.014036    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="265e3add-f3d9-46d8-8e2c-ab655a17628d" containerName="payload-processing"
Sep 15 09:20:32.014075 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.014042    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="265e3add-f3d9-46d8-8e2c-ab655a17628d" containerName="payload-processing"
Sep 15 09:20:32.014165 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.014119    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="265e3add-f3d9-46d8-8e2c-ab655a17628d" containerName="payload-processing"
Sep 15 09:20:32.014165 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.014129    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8cf06add-563e-464d-a826-9f98c56629a1" containerName="revoke-keys"
Sep 15 09:20:32.017159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.017140    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:32.020141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.020119    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-0cec7519\""
Sep 15 09:20:32.020233 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.020122    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-0cec7519-dockercfg-qjs6r\""
Sep 15 09:20:32.031793 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.031772    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"]
Sep 15 09:20:32.043199 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.043161    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"]
Sep 15 09:20:32.046868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.046834    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:32.057918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.057897    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"]
Sep 15 09:20:32.100553 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.100526    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vs4zx\" (UniqueName: \"kubernetes.io/projected/ab1d3eab-a01b-4d88-b162-1e4a93610681-kube-api-access-vs4zx\") pod \"payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv\" (UID: \"ab1d3eab-a01b-4d88-b162-1e4a93610681\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:32.100746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.100645    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1d3eab-a01b-4d88-b162-1e4a93610681-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv\" (UID: \"ab1d3eab-a01b-4d88-b162-1e4a93610681\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:32.201195 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.201156    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vs4zx\" (UniqueName: \"kubernetes.io/projected/ab1d3eab-a01b-4d88-b162-1e4a93610681-kube-api-access-vs4zx\") pod \"payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv\" (UID: \"ab1d3eab-a01b-4d88-b162-1e4a93610681\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:32.201400 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.201210    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adee8f0-27d7-4379-9b66-e53934803a55-plugins-config-volume\") pod \"payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh\" (UID: \"3adee8f0-27d7-4379-9b66-e53934803a55\") " pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:32.201400 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.201242    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1d3eab-a01b-4d88-b162-1e4a93610681-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv\" (UID: \"ab1d3eab-a01b-4d88-b162-1e4a93610681\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:32.201400 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.201258    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wlxs7\" (UniqueName: \"kubernetes.io/projected/3adee8f0-27d7-4379-9b66-e53934803a55-kube-api-access-wlxs7\") pod \"payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh\" (UID: \"3adee8f0-27d7-4379-9b66-e53934803a55\") " pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:32.201955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.201936    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1d3eab-a01b-4d88-b162-1e4a93610681-plugins-config-volume\") pod \"payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv\" (UID: \"ab1d3eab-a01b-4d88-b162-1e4a93610681\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:32.215226 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.215193    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vs4zx\" (UniqueName: \"kubernetes.io/projected/ab1d3eab-a01b-4d88-b162-1e4a93610681-kube-api-access-vs4zx\") pod \"payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv\" (UID: \"ab1d3eab-a01b-4d88-b162-1e4a93610681\") " pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:32.302644 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.302547    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adee8f0-27d7-4379-9b66-e53934803a55-plugins-config-volume\") pod \"payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh\" (UID: \"3adee8f0-27d7-4379-9b66-e53934803a55\") " pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:32.302644 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.302594    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wlxs7\" (UniqueName: \"kubernetes.io/projected/3adee8f0-27d7-4379-9b66-e53934803a55-kube-api-access-wlxs7\") pod \"payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh\" (UID: \"3adee8f0-27d7-4379-9b66-e53934803a55\") " pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:32.303369 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.303345    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adee8f0-27d7-4379-9b66-e53934803a55-plugins-config-volume\") pod \"payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh\" (UID: \"3adee8f0-27d7-4379-9b66-e53934803a55\") " pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:32.311571 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.311541    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wlxs7\" (UniqueName: \"kubernetes.io/projected/3adee8f0-27d7-4379-9b66-e53934803a55-kube-api-access-wlxs7\") pod \"payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh\" (UID: \"3adee8f0-27d7-4379-9b66-e53934803a55\") " pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:32.327238 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.327212    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:32.357500 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.357471    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:32.602686 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.602557    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"]
Sep 15 09:20:32.608404 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:20:32.608365    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1d3eab_a01b_4d88_b162_1e4a93610681.slice/crio-cb586c5aaf6f0e33ed3511f647188d5a9a8a159aacd3d59c023b2de58dbb9b4d WatchSource:0}: Error finding container cb586c5aaf6f0e33ed3511f647188d5a9a8a159aacd3d59c023b2de58dbb9b4d: Status 404 returned error can't find the container with id cb586c5aaf6f0e33ed3511f647188d5a9a8a159aacd3d59c023b2de58dbb9b4d
Sep 15 09:20:32.646154 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:32.646126    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"]
Sep 15 09:20:32.660171 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:20:32.660148    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3adee8f0_27d7_4379_9b66_e53934803a55.slice/crio-e5707b0510915c0b9d5372bc3a2b56f8bb2ea3f8119831a40ad51d7a3580d4b9 WatchSource:0}: Error finding container e5707b0510915c0b9d5372bc3a2b56f8bb2ea3f8119831a40ad51d7a3580d4b9: Status 404 returned error can't find the container with id e5707b0510915c0b9d5372bc3a2b56f8bb2ea3f8119831a40ad51d7a3580d4b9
Sep 15 09:20:33.075185 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:33.075142    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh" event={"ID":"3adee8f0-27d7-4379-9b66-e53934803a55","Type":"ContainerStarted","Data":"5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989"}
Sep 15 09:20:33.075669 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:33.075213    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh" event={"ID":"3adee8f0-27d7-4379-9b66-e53934803a55","Type":"ContainerStarted","Data":"e5707b0510915c0b9d5372bc3a2b56f8bb2ea3f8119831a40ad51d7a3580d4b9"}
Sep 15 09:20:33.075669 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:33.075334    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:33.077476 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:33.077452    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv" event={"ID":"ab1d3eab-a01b-4d88-b162-1e4a93610681","Type":"ContainerStarted","Data":"b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd"}
Sep 15 09:20:33.077640 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:33.077489    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv" event={"ID":"ab1d3eab-a01b-4d88-b162-1e4a93610681","Type":"ContainerStarted","Data":"cb586c5aaf6f0e33ed3511f647188d5a9a8a159aacd3d59c023b2de58dbb9b4d"}
Sep 15 09:20:33.077994 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:33.077962    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:33.095693 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:33.095647    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh" podStartSLOduration=1.095632698 podStartE2EDuration="1.095632698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:33.095427145 +0000 UTC m=+808.858998594" watchObservedRunningTime="2026-09-15 09:20:33.095632698 +0000 UTC m=+808.859204145"
Sep 15 09:20:33.120046 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:33.120002    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv" podStartSLOduration=2.119987089 podStartE2EDuration="2.119987089s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:20:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:20:33.119093434 +0000 UTC m=+808.882664883" watchObservedRunningTime="2026-09-15 09:20:33.119987089 +0000 UTC m=+808.883558537"
Sep 15 09:20:44.085793 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:44.085764    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:20:45.090129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:45.090099    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:20:54.479731 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.479693    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"]
Sep 15 09:20:54.487558 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.487535    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"
Sep 15 09:20:54.488524 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.488499    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"]
Sep 15 09:20:54.490478 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.490460    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:20:54.490643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.490620    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:20:54.605740 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.605698    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6df6cea-3569-4fc3-89ee-c98649111ab0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn\" (UID: \"c6df6cea-3569-4fc3-89ee-c98649111ab0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"
Sep 15 09:20:54.707232 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.707200    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6df6cea-3569-4fc3-89ee-c98649111ab0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn\" (UID: \"c6df6cea-3569-4fc3-89ee-c98649111ab0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"
Sep 15 09:20:54.707894 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.707836    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6df6cea-3569-4fc3-89ee-c98649111ab0-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn\" (UID: \"c6df6cea-3569-4fc3-89ee-c98649111ab0\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"
Sep 15 09:20:54.800574 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:54.800487    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"
Sep 15 09:20:55.076083 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:55.075987    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"]
Sep 15 09:20:55.083133 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:20:55.083105    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc6df6cea_3569_4fc3_89ee_c98649111ab0.slice/crio-fd61434c870250d83567ffaf633dfea8b7c87c1a7ba8b1a26fbe23afb54026a5 WatchSource:0}: Error finding container fd61434c870250d83567ffaf633dfea8b7c87c1a7ba8b1a26fbe23afb54026a5: Status 404 returned error can't find the container with id fd61434c870250d83567ffaf633dfea8b7c87c1a7ba8b1a26fbe23afb54026a5
Sep 15 09:20:55.185094 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:55.185058    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn" event={"ID":"c6df6cea-3569-4fc3-89ee-c98649111ab0","Type":"ContainerStarted","Data":"fd61434c870250d83567ffaf633dfea8b7c87c1a7ba8b1a26fbe23afb54026a5"}
Sep 15 09:20:56.191702 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:56.191666    2568 generic.go:356] "Generic (PLEG): container finished" podID="c6df6cea-3569-4fc3-89ee-c98649111ab0" containerID="d8450b0d0b3f99160d7214562583dbd6167e10aa4fcfef74e80f51a640181cb3" exitCode=0
Sep 15 09:20:56.192130 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:56.191720    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn" event={"ID":"c6df6cea-3569-4fc3-89ee-c98649111ab0","Type":"ContainerDied","Data":"d8450b0d0b3f99160d7214562583dbd6167e10aa4fcfef74e80f51a640181cb3"}
Sep 15 09:20:57.343244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:57.343221    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"
Sep 15 09:20:57.436066 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:57.436035    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6df6cea-3569-4fc3-89ee-c98649111ab0-maas-api-service-ca\") pod \"c6df6cea-3569-4fc3-89ee-c98649111ab0\" (UID: \"c6df6cea-3569-4fc3-89ee-c98649111ab0\") "
Sep 15 09:20:57.436389 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:57.436363    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c6df6cea-3569-4fc3-89ee-c98649111ab0-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "c6df6cea-3569-4fc3-89ee-c98649111ab0" (UID: "c6df6cea-3569-4fc3-89ee-c98649111ab0"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:20:57.536952 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:57.536875    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/c6df6cea-3569-4fc3-89ee-c98649111ab0-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:20:58.206218 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:58.206190    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"
Sep 15 09:20:58.206390 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:58.206188    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn" event={"ID":"c6df6cea-3569-4fc3-89ee-c98649111ab0","Type":"ContainerDied","Data":"fd61434c870250d83567ffaf633dfea8b7c87c1a7ba8b1a26fbe23afb54026a5"}
Sep 15 09:20:58.206390 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:20:58.206315    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fd61434c870250d83567ffaf633dfea8b7c87c1a7ba8b1a26fbe23afb54026a5"
Sep 15 09:21:00.694051 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:00.694017    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"]
Sep 15 09:21:00.694520 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:00.694245    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh" podUID="3adee8f0-27d7-4379-9b66-e53934803a55" containerName="payload-processing" containerID="cri-o://5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989" gracePeriod=30
Sep 15 09:21:00.703572 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:00.703546    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"]
Sep 15 09:21:00.704195 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:00.703823    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv" podUID="ab1d3eab-a01b-4d88-b162-1e4a93610681" containerName="payload-pre-processing" containerID="cri-o://b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd" gracePeriod=30
Sep 15 09:21:00.866523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:00.866487    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"]
Sep 15 09:21:00.868742 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:00.868710    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-0cec7519-khlqn"]
Sep 15 09:21:00.963198 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:00.963173    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:21:00.991090 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:00.990209    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:21:01.071579 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.071549    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vs4zx\" (UniqueName: \"kubernetes.io/projected/ab1d3eab-a01b-4d88-b162-1e4a93610681-kube-api-access-vs4zx\") pod \"ab1d3eab-a01b-4d88-b162-1e4a93610681\" (UID: \"ab1d3eab-a01b-4d88-b162-1e4a93610681\") "
Sep 15 09:21:01.071747 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.071669    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1d3eab-a01b-4d88-b162-1e4a93610681-plugins-config-volume\") pod \"ab1d3eab-a01b-4d88-b162-1e4a93610681\" (UID: \"ab1d3eab-a01b-4d88-b162-1e4a93610681\") "
Sep 15 09:21:01.071747 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.071715    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wlxs7\" (UniqueName: \"kubernetes.io/projected/3adee8f0-27d7-4379-9b66-e53934803a55-kube-api-access-wlxs7\") pod \"3adee8f0-27d7-4379-9b66-e53934803a55\" (UID: \"3adee8f0-27d7-4379-9b66-e53934803a55\") "
Sep 15 09:21:01.071747 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.071744    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adee8f0-27d7-4379-9b66-e53934803a55-plugins-config-volume\") pod \"3adee8f0-27d7-4379-9b66-e53934803a55\" (UID: \"3adee8f0-27d7-4379-9b66-e53934803a55\") "
Sep 15 09:21:01.072140 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.072106    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab1d3eab-a01b-4d88-b162-1e4a93610681-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab1d3eab-a01b-4d88-b162-1e4a93610681" (UID: "ab1d3eab-a01b-4d88-b162-1e4a93610681"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:01.072140 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.072107    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3adee8f0-27d7-4379-9b66-e53934803a55-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3adee8f0-27d7-4379-9b66-e53934803a55" (UID: "3adee8f0-27d7-4379-9b66-e53934803a55"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:01.073777 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.073749    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab1d3eab-a01b-4d88-b162-1e4a93610681-kube-api-access-vs4zx" (OuterVolumeSpecName: "kube-api-access-vs4zx") pod "ab1d3eab-a01b-4d88-b162-1e4a93610681" (UID: "ab1d3eab-a01b-4d88-b162-1e4a93610681"). InnerVolumeSpecName "kube-api-access-vs4zx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:01.073887 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.073823    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3adee8f0-27d7-4379-9b66-e53934803a55-kube-api-access-wlxs7" (OuterVolumeSpecName: "kube-api-access-wlxs7") pod "3adee8f0-27d7-4379-9b66-e53934803a55" (UID: "3adee8f0-27d7-4379-9b66-e53934803a55"). InnerVolumeSpecName "kube-api-access-wlxs7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:01.173293 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.173256    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab1d3eab-a01b-4d88-b162-1e4a93610681-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:01.173293 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.173286    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wlxs7\" (UniqueName: \"kubernetes.io/projected/3adee8f0-27d7-4379-9b66-e53934803a55-kube-api-access-wlxs7\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:01.173293 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.173295    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3adee8f0-27d7-4379-9b66-e53934803a55-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:01.173522 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.173304    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vs4zx\" (UniqueName: \"kubernetes.io/projected/ab1d3eab-a01b-4d88-b162-1e4a93610681-kube-api-access-vs4zx\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:01.223056 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.222975    2568 generic.go:356] "Generic (PLEG): container finished" podID="3adee8f0-27d7-4379-9b66-e53934803a55" containerID="5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989" exitCode=0
Sep 15 09:21:01.223056 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.223033    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"
Sep 15 09:21:01.223056 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.223046    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh" event={"ID":"3adee8f0-27d7-4379-9b66-e53934803a55","Type":"ContainerDied","Data":"5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989"}
Sep 15 09:21:01.223296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.223099    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh" event={"ID":"3adee8f0-27d7-4379-9b66-e53934803a55","Type":"ContainerDied","Data":"e5707b0510915c0b9d5372bc3a2b56f8bb2ea3f8119831a40ad51d7a3580d4b9"}
Sep 15 09:21:01.223296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.223130    2568 scope.go:117] "RemoveContainer" containerID="5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989"
Sep 15 09:21:01.224524 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.224496    2568 generic.go:356] "Generic (PLEG): container finished" podID="ab1d3eab-a01b-4d88-b162-1e4a93610681" containerID="b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd" exitCode=0
Sep 15 09:21:01.224611 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.224550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv" event={"ID":"ab1d3eab-a01b-4d88-b162-1e4a93610681","Type":"ContainerDied","Data":"b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd"}
Sep 15 09:21:01.224611 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.224555    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"
Sep 15 09:21:01.224611 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.224582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv" event={"ID":"ab1d3eab-a01b-4d88-b162-1e4a93610681","Type":"ContainerDied","Data":"cb586c5aaf6f0e33ed3511f647188d5a9a8a159aacd3d59c023b2de58dbb9b4d"}
Sep 15 09:21:01.232461 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.232440    2568 scope.go:117] "RemoveContainer" containerID="5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989"
Sep 15 09:21:01.232796 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:21:01.232767    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989\": container with ID starting with 5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989 not found: ID does not exist" containerID="5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989"
Sep 15 09:21:01.232924 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.232806    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989"} err="failed to get container status \"5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989\": rpc error: code = NotFound desc = could not find container \"5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989\": container with ID starting with 5066a230d9606867b51c639bbca94b2569427c8b62821581648715d59f34d989 not found: ID does not exist"
Sep 15 09:21:01.232924 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.232831    2568 scope.go:117] "RemoveContainer" containerID="b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd"
Sep 15 09:21:01.241537 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.241522    2568 scope.go:117] "RemoveContainer" containerID="b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd"
Sep 15 09:21:01.241801 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:21:01.241780    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd\": container with ID starting with b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd not found: ID does not exist" containerID="b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd"
Sep 15 09:21:01.241879 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.241807    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd"} err="failed to get container status \"b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd\": rpc error: code = NotFound desc = could not find container \"b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd\": container with ID starting with b7ec9ced4a6214593c9e8101e403976b1879b99894004cc4ca2c9c88005110fd not found: ID does not exist"
Sep 15 09:21:01.249424 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.249401    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"]
Sep 15 09:21:01.253610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.253591    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-migrate-0cec7519-79f64cb4c4-5rwnv"]
Sep 15 09:21:01.265904 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.265873    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"]
Sep 15 09:21:01.273627 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.273606    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-0cec7519-65d485fdcd-v84hh"]
Sep 15 09:21:01.767224 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767191    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"]
Sep 15 09:21:01.767661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767601    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3adee8f0-27d7-4379-9b66-e53934803a55" containerName="payload-processing"
Sep 15 09:21:01.767661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767613    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3adee8f0-27d7-4379-9b66-e53934803a55" containerName="payload-processing"
Sep 15 09:21:01.767661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767622    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c6df6cea-3569-4fc3-89ee-c98649111ab0" containerName="revoke-keys"
Sep 15 09:21:01.767661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767627    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c6df6cea-3569-4fc3-89ee-c98649111ab0" containerName="revoke-keys"
Sep 15 09:21:01.767661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767649    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab1d3eab-a01b-4d88-b162-1e4a93610681" containerName="payload-pre-processing"
Sep 15 09:21:01.767661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767655    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab1d3eab-a01b-4d88-b162-1e4a93610681" containerName="payload-pre-processing"
Sep 15 09:21:01.767998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767728    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3adee8f0-27d7-4379-9b66-e53934803a55" containerName="payload-processing"
Sep 15 09:21:01.767998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767739    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c6df6cea-3569-4fc3-89ee-c98649111ab0" containerName="revoke-keys"
Sep 15 09:21:01.767998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.767748    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab1d3eab-a01b-4d88-b162-1e4a93610681" containerName="payload-pre-processing"
Sep 15 09:21:01.772070 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.772052    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.775125 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.775105    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0da90685-openshift-default-dockercfg-x5blf\""
Sep 15 09:21:01.786575 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.785770    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"]
Sep 15 09:21:01.879407 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879362    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-socket\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.879596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879448    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-podinfo\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.879596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879535    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-certs\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.879596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879570    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-envoy\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.879596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879587    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tgbm\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-kube-api-access-6tgbm\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.879801 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879612    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-token\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.879801 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879665    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-credential-socket\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.879801 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879728    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-data\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.879801 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.879742    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istiod-ca-cert\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981121 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-envoy\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981121 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tgbm\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-kube-api-access-6tgbm\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981121 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981098    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-token\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981121 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981120    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-credential-socket\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981476 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981320    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-data\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981476 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981354    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istiod-ca-cert\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981476 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981410    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-socket\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981476 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981459    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-podinfo\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981486    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-credential-socket\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981563    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-certs\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981672    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-data\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981879 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981836    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-socket\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.981946 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.981895    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-certs\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.982122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.982101    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istiod-ca-cert\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.984084 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.984056    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-podinfo\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.984180 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.984091    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-envoy\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.989635 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.989608    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-token\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:01.990263 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:01.990244    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tgbm\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-kube-api-access-6tgbm\") pod \"e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") " pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:02.082871 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:02.082820    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:02.412612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:02.412586    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"]
Sep 15 09:21:02.414564 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:02.414538    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda24b8608_4fe8_4d7d_aac4_f0efbeeaf752.slice/crio-76afc882bcf25b36932bf8af2c5d1d58d4b63c5d105456a3cf4026db24179c8e WatchSource:0}: Error finding container 76afc882bcf25b36932bf8af2c5d1d58d4b63c5d105456a3cf4026db24179c8e: Status 404 returned error can't find the container with id 76afc882bcf25b36932bf8af2c5d1d58d4b63c5d105456a3cf4026db24179c8e
Sep 15 09:21:02.416676 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:02.416642    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:02.416776 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:02.416719    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:02.416776 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:02.416765    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:02.786801 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:02.786729    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3adee8f0-27d7-4379-9b66-e53934803a55" path="/var/lib/kubelet/pods/3adee8f0-27d7-4379-9b66-e53934803a55/volumes"
Sep 15 09:21:02.787167 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:02.787148    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab1d3eab-a01b-4d88-b162-1e4a93610681" path="/var/lib/kubelet/pods/ab1d3eab-a01b-4d88-b162-1e4a93610681/volumes"
Sep 15 09:21:02.787454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:02.787440    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c6df6cea-3569-4fc3-89ee-c98649111ab0" path="/var/lib/kubelet/pods/c6df6cea-3569-4fc3-89ee-c98649111ab0/volumes"
Sep 15 09:21:03.239101 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:03.239066    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" event={"ID":"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752","Type":"ContainerStarted","Data":"0e96bbeda5c74d69012f8d6cbb270341217bdfa8da4158972516ca1b689b654c"}
Sep 15 09:21:03.239276 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:03.239113    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" event={"ID":"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752","Type":"ContainerStarted","Data":"76afc882bcf25b36932bf8af2c5d1d58d4b63c5d105456a3cf4026db24179c8e"}
Sep 15 09:21:03.264689 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:03.264640    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" podStartSLOduration=2.264624663 podStartE2EDuration="2.264624663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:03.262987854 +0000 UTC m=+839.026559302" watchObservedRunningTime="2026-09-15 09:21:03.264624663 +0000 UTC m=+839.028196111"
Sep 15 09:21:04.083657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:04.083619    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:04.089092 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:04.089065    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:04.243557 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:04.243524    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:04.244519 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:04.244496    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:07.374624 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.374589    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"]
Sep 15 09:21:07.379476 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.379458    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:07.382656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.382636    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-0da90685-dockercfg-vljpz\""
Sep 15 09:21:07.382656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.382644    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-0da90685\""
Sep 15 09:21:07.391122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.391098    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"]
Sep 15 09:21:07.406340 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.406310    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"]
Sep 15 09:21:07.414701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.414675    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:07.421513 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.421489    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"]
Sep 15 09:21:07.536102 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.536070    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hdps\" (UniqueName: \"kubernetes.io/projected/72c9c6ae-292d-429b-91ba-922cc1e62efd-kube-api-access-4hdps\") pod \"payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf\" (UID: \"72c9c6ae-292d-429b-91ba-922cc1e62efd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:07.536283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.536132    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmf9f\" (UniqueName: \"kubernetes.io/projected/a8f6e115-4473-4e38-86bb-4279338528c2-kube-api-access-fmf9f\") pod \"payload-processing-e2e-ait-0da90685-df45955bf-qspbk\" (UID: \"a8f6e115-4473-4e38-86bb-4279338528c2\") " pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:07.536283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.536197    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72c9c6ae-292d-429b-91ba-922cc1e62efd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf\" (UID: \"72c9c6ae-292d-429b-91ba-922cc1e62efd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:07.536283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.536262    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f6e115-4473-4e38-86bb-4279338528c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-0da90685-df45955bf-qspbk\" (UID: \"a8f6e115-4473-4e38-86bb-4279338528c2\") " pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:07.637109 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.637024    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f6e115-4473-4e38-86bb-4279338528c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-0da90685-df45955bf-qspbk\" (UID: \"a8f6e115-4473-4e38-86bb-4279338528c2\") " pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:07.637109 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.637089    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hdps\" (UniqueName: \"kubernetes.io/projected/72c9c6ae-292d-429b-91ba-922cc1e62efd-kube-api-access-4hdps\") pod \"payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf\" (UID: \"72c9c6ae-292d-429b-91ba-922cc1e62efd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:07.637295 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.637131    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmf9f\" (UniqueName: \"kubernetes.io/projected/a8f6e115-4473-4e38-86bb-4279338528c2-kube-api-access-fmf9f\") pod \"payload-processing-e2e-ait-0da90685-df45955bf-qspbk\" (UID: \"a8f6e115-4473-4e38-86bb-4279338528c2\") " pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:07.637295 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.637154    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72c9c6ae-292d-429b-91ba-922cc1e62efd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf\" (UID: \"72c9c6ae-292d-429b-91ba-922cc1e62efd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:07.637820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.637801    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72c9c6ae-292d-429b-91ba-922cc1e62efd-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf\" (UID: \"72c9c6ae-292d-429b-91ba-922cc1e62efd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:07.637899 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.637825    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f6e115-4473-4e38-86bb-4279338528c2-plugins-config-volume\") pod \"payload-processing-e2e-ait-0da90685-df45955bf-qspbk\" (UID: \"a8f6e115-4473-4e38-86bb-4279338528c2\") " pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:07.645659 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.645626    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmf9f\" (UniqueName: \"kubernetes.io/projected/a8f6e115-4473-4e38-86bb-4279338528c2-kube-api-access-fmf9f\") pod \"payload-processing-e2e-ait-0da90685-df45955bf-qspbk\" (UID: \"a8f6e115-4473-4e38-86bb-4279338528c2\") " pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:07.645774 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.645703    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hdps\" (UniqueName: \"kubernetes.io/projected/72c9c6ae-292d-429b-91ba-922cc1e62efd-kube-api-access-4hdps\") pod \"payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf\" (UID: \"72c9c6ae-292d-429b-91ba-922cc1e62efd\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:07.690540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.690507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:07.725934 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.725903    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:07.967748 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:07.967725    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"]
Sep 15 09:21:07.970103 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:07.970073    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72c9c6ae_292d_429b_91ba_922cc1e62efd.slice/crio-8bfe9876f7eeccf10718df0d58142c5fc22e2a1ccfc4537d033e74345c1fc1e9 WatchSource:0}: Error finding container 8bfe9876f7eeccf10718df0d58142c5fc22e2a1ccfc4537d033e74345c1fc1e9: Status 404 returned error can't find the container with id 8bfe9876f7eeccf10718df0d58142c5fc22e2a1ccfc4537d033e74345c1fc1e9
Sep 15 09:21:08.016711 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.016686    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"]
Sep 15 09:21:08.019144 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:08.019123    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f6e115_4473_4e38_86bb_4279338528c2.slice/crio-313a1667888be5f964f520e9ef25bd20893fdaa360fd0f25dd8c88b56138dd26 WatchSource:0}: Error finding container 313a1667888be5f964f520e9ef25bd20893fdaa360fd0f25dd8c88b56138dd26: Status 404 returned error can't find the container with id 313a1667888be5f964f520e9ef25bd20893fdaa360fd0f25dd8c88b56138dd26
Sep 15 09:21:08.264774 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.264685    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk" event={"ID":"a8f6e115-4473-4e38-86bb-4279338528c2","Type":"ContainerStarted","Data":"b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3"}
Sep 15 09:21:08.264774 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.264747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk" event={"ID":"a8f6e115-4473-4e38-86bb-4279338528c2","Type":"ContainerStarted","Data":"313a1667888be5f964f520e9ef25bd20893fdaa360fd0f25dd8c88b56138dd26"}
Sep 15 09:21:08.265086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.264777    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:08.266472 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.266449    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf" event={"ID":"72c9c6ae-292d-429b-91ba-922cc1e62efd","Type":"ContainerStarted","Data":"e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201"}
Sep 15 09:21:08.266605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.266486    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf" event={"ID":"72c9c6ae-292d-429b-91ba-922cc1e62efd","Type":"ContainerStarted","Data":"8bfe9876f7eeccf10718df0d58142c5fc22e2a1ccfc4537d033e74345c1fc1e9"}
Sep 15 09:21:08.266605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.266569    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:08.281286 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.281240    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk" podStartSLOduration=1.2812266110000001 podStartE2EDuration="1.281226611s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:08.280043228 +0000 UTC m=+844.043614692" watchObservedRunningTime="2026-09-15 09:21:08.281226611 +0000 UTC m=+844.044798094"
Sep 15 09:21:08.296882 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:08.296820    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf" podStartSLOduration=1.296805588 podStartE2EDuration="1.296805588s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:08.29563317 +0000 UTC m=+844.059204641" watchObservedRunningTime="2026-09-15 09:21:08.296805588 +0000 UTC m=+844.060377035"
Sep 15 09:21:19.272986 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:19.272955    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:19.273462 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:19.273024    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:26.375299 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:26.375265    2568 generic.go:356] "Generic (PLEG): container finished" podID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerID="0e96bbeda5c74d69012f8d6cbb270341217bdfa8da4158972516ca1b689b654c" exitCode=0
Sep 15 09:21:26.375811 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:26.375344    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" event={"ID":"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752","Type":"ContainerDied","Data":"0e96bbeda5c74d69012f8d6cbb270341217bdfa8da4158972516ca1b689b654c"}
Sep 15 09:21:26.375923 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:26.375863    2568 scope.go:117] "RemoveContainer" containerID="0e96bbeda5c74d69012f8d6cbb270341217bdfa8da4158972516ca1b689b654c"
Sep 15 09:21:26.377138 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:26.377105    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:26.377260 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:26.377185    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:26.377260 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:26.377229    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:27.382699 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:27.382663    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" event={"ID":"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752","Type":"ContainerStarted","Data":"90ece763b1517833fcd82042e8efdec263d9aa2b2c20d45c93a0e679d394f314"}
Sep 15 09:21:28.083954 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:28.083915    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:28.084156 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:28.084118    2568 patch_prober.go:28] interesting pod/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 15 09:21:28.084237 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:28.084159    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 15 09:21:29.083597 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:29.083562    2568 patch_prober.go:28] interesting pod/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 15 09:21:29.083986 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:29.083626    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 15 09:21:30.084368 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.084324    2568 patch_prober.go:28] interesting pod/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 15 09:21:30.084829 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.084403    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 15 09:21:30.467759 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.467721    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"]
Sep 15 09:21:30.471792 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.471771    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"
Sep 15 09:21:30.474974 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.474955    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:21:30.475065 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.474955    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:21:30.479578 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.479193    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"]
Sep 15 09:21:30.551726 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.551689    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9516a15c-9465-4227-a61a-48c37b9f47e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0da90685-2qcsw\" (UID: \"9516a15c-9465-4227-a61a-48c37b9f47e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"
Sep 15 09:21:30.652700 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.652661    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9516a15c-9465-4227-a61a-48c37b9f47e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0da90685-2qcsw\" (UID: \"9516a15c-9465-4227-a61a-48c37b9f47e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"
Sep 15 09:21:30.653348 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.653326    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9516a15c-9465-4227-a61a-48c37b9f47e1-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-0da90685-2qcsw\" (UID: \"9516a15c-9465-4227-a61a-48c37b9f47e1\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"
Sep 15 09:21:30.783054 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:30.782964    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"
Sep 15 09:21:31.084119 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:31.084028    2568 patch_prober.go:28] interesting pod/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 15 09:21:31.084293 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:31.084122    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 15 09:21:31.089620 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:31.089554    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"]
Sep 15 09:21:31.103136 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:31.103099    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9516a15c_9465_4227_a61a_48c37b9f47e1.slice/crio-9b1c15f27d2fe008502658becf0c266232bce0c87dc68852112b0b87c657b29f WatchSource:0}: Error finding container 9b1c15f27d2fe008502658becf0c266232bce0c87dc68852112b0b87c657b29f: Status 404 returned error can't find the container with id 9b1c15f27d2fe008502658becf0c266232bce0c87dc68852112b0b87c657b29f
Sep 15 09:21:31.415035 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:31.414835    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw" event={"ID":"9516a15c-9465-4227-a61a-48c37b9f47e1","Type":"ContainerStarted","Data":"9b1c15f27d2fe008502658becf0c266232bce0c87dc68852112b0b87c657b29f"}
Sep 15 09:21:32.084089 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:32.084054    2568 patch_prober.go:28] interesting pod/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Sep 15 09:21:32.084268 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:32.084117    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Sep 15 09:21:32.420312 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:32.420273    2568 generic.go:356] "Generic (PLEG): container finished" podID="9516a15c-9465-4227-a61a-48c37b9f47e1" containerID="f58380827d423b1c668fb705568672dc892c2c538ce4db07960c67683b7a617e" exitCode=0
Sep 15 09:21:32.420714 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:32.420360    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw" event={"ID":"9516a15c-9465-4227-a61a-48c37b9f47e1","Type":"ContainerDied","Data":"f58380827d423b1c668fb705568672dc892c2c538ce4db07960c67683b7a617e"}
Sep 15 09:21:33.088376 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:33.088349    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:33.088681 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:33.088660    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:33.089503 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:33.089480    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:33.566082 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:33.566062    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"
Sep 15 09:21:33.683240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:33.683165    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9516a15c-9465-4227-a61a-48c37b9f47e1-maas-api-service-ca\") pod \"9516a15c-9465-4227-a61a-48c37b9f47e1\" (UID: \"9516a15c-9465-4227-a61a-48c37b9f47e1\") "
Sep 15 09:21:33.683480 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:33.683458    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9516a15c-9465-4227-a61a-48c37b9f47e1-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9516a15c-9465-4227-a61a-48c37b9f47e1" (UID: "9516a15c-9465-4227-a61a-48c37b9f47e1"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:33.784773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:33.784741    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9516a15c-9465-4227-a61a-48c37b9f47e1-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:34.431688 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:34.431642    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"
Sep 15 09:21:34.431688 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:34.431679    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw" event={"ID":"9516a15c-9465-4227-a61a-48c37b9f47e1","Type":"ContainerDied","Data":"9b1c15f27d2fe008502658becf0c266232bce0c87dc68852112b0b87c657b29f"}
Sep 15 09:21:34.431936 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:34.431734    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b1c15f27d2fe008502658becf0c266232bce0c87dc68852112b0b87c657b29f"
Sep 15 09:21:36.761602 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:36.761571    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"]
Sep 15 09:21:36.762000 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:36.761795    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk" podUID="a8f6e115-4473-4e38-86bb-4279338528c2" containerName="payload-processing" containerID="cri-o://b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3" gracePeriod=30
Sep 15 09:21:36.769252 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:36.769226    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"]
Sep 15 09:21:36.769786 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:36.769462    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf" podUID="72c9c6ae-292d-429b-91ba-922cc1e62efd" containerName="payload-pre-processing" containerID="cri-o://e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201" gracePeriod=30
Sep 15 09:21:36.890275 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:21:36.890247    2568 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8f6e115_4473_4e38_86bb_4279338528c2.slice/crio-conmon-b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3.scope\": RecentStats: unable to find data in memory cache]"
Sep 15 09:21:37.041877 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.041831    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"]
Sep 15 09:21:37.044425 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.044387    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-0da90685-2qcsw"]
Sep 15 09:21:37.052395 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.052365    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:37.083709 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.083685    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:37.122311 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.121711    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fmf9f\" (UniqueName: \"kubernetes.io/projected/a8f6e115-4473-4e38-86bb-4279338528c2-kube-api-access-fmf9f\") pod \"a8f6e115-4473-4e38-86bb-4279338528c2\" (UID: \"a8f6e115-4473-4e38-86bb-4279338528c2\") "
Sep 15 09:21:37.122311 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.121896    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f6e115-4473-4e38-86bb-4279338528c2-plugins-config-volume\") pod \"a8f6e115-4473-4e38-86bb-4279338528c2\" (UID: \"a8f6e115-4473-4e38-86bb-4279338528c2\") "
Sep 15 09:21:37.122662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.122631    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8f6e115-4473-4e38-86bb-4279338528c2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a8f6e115-4473-4e38-86bb-4279338528c2" (UID: "a8f6e115-4473-4e38-86bb-4279338528c2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:37.125076 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.125051    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8f6e115-4473-4e38-86bb-4279338528c2-kube-api-access-fmf9f" (OuterVolumeSpecName: "kube-api-access-fmf9f") pod "a8f6e115-4473-4e38-86bb-4279338528c2" (UID: "a8f6e115-4473-4e38-86bb-4279338528c2"). InnerVolumeSpecName "kube-api-access-fmf9f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:37.223413 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.223377    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4hdps\" (UniqueName: \"kubernetes.io/projected/72c9c6ae-292d-429b-91ba-922cc1e62efd-kube-api-access-4hdps\") pod \"72c9c6ae-292d-429b-91ba-922cc1e62efd\" (UID: \"72c9c6ae-292d-429b-91ba-922cc1e62efd\") "
Sep 15 09:21:37.223603 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.223502    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72c9c6ae-292d-429b-91ba-922cc1e62efd-plugins-config-volume\") pod \"72c9c6ae-292d-429b-91ba-922cc1e62efd\" (UID: \"72c9c6ae-292d-429b-91ba-922cc1e62efd\") "
Sep 15 09:21:37.223824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.223766    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fmf9f\" (UniqueName: \"kubernetes.io/projected/a8f6e115-4473-4e38-86bb-4279338528c2-kube-api-access-fmf9f\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:37.223824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.223789    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a8f6e115-4473-4e38-86bb-4279338528c2-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:37.223981 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.223922    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72c9c6ae-292d-429b-91ba-922cc1e62efd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "72c9c6ae-292d-429b-91ba-922cc1e62efd" (UID: "72c9c6ae-292d-429b-91ba-922cc1e62efd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:37.225774 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.225746    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72c9c6ae-292d-429b-91ba-922cc1e62efd-kube-api-access-4hdps" (OuterVolumeSpecName: "kube-api-access-4hdps") pod "72c9c6ae-292d-429b-91ba-922cc1e62efd" (UID: "72c9c6ae-292d-429b-91ba-922cc1e62efd"). InnerVolumeSpecName "kube-api-access-4hdps". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:37.325141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.325054    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4hdps\" (UniqueName: \"kubernetes.io/projected/72c9c6ae-292d-429b-91ba-922cc1e62efd-kube-api-access-4hdps\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:37.325141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.325084    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72c9c6ae-292d-429b-91ba-922cc1e62efd-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:37.448458 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.448418    2568 generic.go:356] "Generic (PLEG): container finished" podID="a8f6e115-4473-4e38-86bb-4279338528c2" containerID="b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3" exitCode=0
Sep 15 09:21:37.448636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.448465    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"
Sep 15 09:21:37.448636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.448503    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk" event={"ID":"a8f6e115-4473-4e38-86bb-4279338528c2","Type":"ContainerDied","Data":"b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3"}
Sep 15 09:21:37.448636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.448558    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk" event={"ID":"a8f6e115-4473-4e38-86bb-4279338528c2","Type":"ContainerDied","Data":"313a1667888be5f964f520e9ef25bd20893fdaa360fd0f25dd8c88b56138dd26"}
Sep 15 09:21:37.448636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.448584    2568 scope.go:117] "RemoveContainer" containerID="b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3"
Sep 15 09:21:37.449908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.449889    2568 generic.go:356] "Generic (PLEG): container finished" podID="72c9c6ae-292d-429b-91ba-922cc1e62efd" containerID="e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201" exitCode=0
Sep 15 09:21:37.450005 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.449930    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf" event={"ID":"72c9c6ae-292d-429b-91ba-922cc1e62efd","Type":"ContainerDied","Data":"e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201"}
Sep 15 09:21:37.450005 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.449963    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf" event={"ID":"72c9c6ae-292d-429b-91ba-922cc1e62efd","Type":"ContainerDied","Data":"8bfe9876f7eeccf10718df0d58142c5fc22e2a1ccfc4537d033e74345c1fc1e9"}
Sep 15 09:21:37.450005 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.449934    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"
Sep 15 09:21:37.458330 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.458315    2568 scope.go:117] "RemoveContainer" containerID="b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3"
Sep 15 09:21:37.458656 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:21:37.458640    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3\": container with ID starting with b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3 not found: ID does not exist" containerID="b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3"
Sep 15 09:21:37.458708 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.458666    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3"} err="failed to get container status \"b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3\": rpc error: code = NotFound desc = could not find container \"b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3\": container with ID starting with b37ba4842952ac7346b7aaadf4d53d2b87a3b6e9b47d0ca0a861405f2b29a0c3 not found: ID does not exist"
Sep 15 09:21:37.458708 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.458688    2568 scope.go:117] "RemoveContainer" containerID="e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201"
Sep 15 09:21:37.467148 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.467129    2568 scope.go:117] "RemoveContainer" containerID="e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201"
Sep 15 09:21:37.467428 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:21:37.467410    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201\": container with ID starting with e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201 not found: ID does not exist" containerID="e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201"
Sep 15 09:21:37.467475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.467434    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201"} err="failed to get container status \"e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201\": rpc error: code = NotFound desc = could not find container \"e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201\": container with ID starting with e0e153d06ccde76bddafa449813b6179e67bf9faef9a6675a5f75aad0a5f3201 not found: ID does not exist"
Sep 15 09:21:37.473713 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.473692    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"]
Sep 15 09:21:37.479483 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.479464    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-0da90685-54dfc94494-gwbxf"]
Sep 15 09:21:37.491221 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.491201    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"]
Sep 15 09:21:37.494854 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:37.494808    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-0da90685-df45955bf-qspbk"]
Sep 15 09:21:38.234094 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:38.228643    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"]
Sep 15 09:21:38.234094 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:38.234054    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy" containerID="cri-o://90ece763b1517833fcd82042e8efdec263d9aa2b2c20d45c93a0e679d394f314" gracePeriod=30
Sep 15 09:21:38.786209 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:38.786181    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72c9c6ae-292d-429b-91ba-922cc1e62efd" path="/var/lib/kubelet/pods/72c9c6ae-292d-429b-91ba-922cc1e62efd/volumes"
Sep 15 09:21:38.786515 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:38.786503    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9516a15c-9465-4227-a61a-48c37b9f47e1" path="/var/lib/kubelet/pods/9516a15c-9465-4227-a61a-48c37b9f47e1/volumes"
Sep 15 09:21:38.786821 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:38.786807    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8f6e115-4473-4e38-86bb-4279338528c2" path="/var/lib/kubelet/pods/a8f6e115-4473-4e38-86bb-4279338528c2/volumes"
Sep 15 09:21:39.020180 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020151    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"]
Sep 15 09:21:39.020613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020590    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72c9c6ae-292d-429b-91ba-922cc1e62efd" containerName="payload-pre-processing"
Sep 15 09:21:39.020613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020614    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="72c9c6ae-292d-429b-91ba-922cc1e62efd" containerName="payload-pre-processing"
Sep 15 09:21:39.020787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020626    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8f6e115-4473-4e38-86bb-4279338528c2" containerName="payload-processing"
Sep 15 09:21:39.020787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020634    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8f6e115-4473-4e38-86bb-4279338528c2" containerName="payload-processing"
Sep 15 09:21:39.020787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020657    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9516a15c-9465-4227-a61a-48c37b9f47e1" containerName="revoke-keys"
Sep 15 09:21:39.020787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020667    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9516a15c-9465-4227-a61a-48c37b9f47e1" containerName="revoke-keys"
Sep 15 09:21:39.020787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020755    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8f6e115-4473-4e38-86bb-4279338528c2" containerName="payload-processing"
Sep 15 09:21:39.020787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020766    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9516a15c-9465-4227-a61a-48c37b9f47e1" containerName="revoke-keys"
Sep 15 09:21:39.020787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.020775    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="72c9c6ae-292d-429b-91ba-922cc1e62efd" containerName="payload-pre-processing"
Sep 15 09:21:39.025298 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.025278    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.032947 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.032925    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a01e15d8-openshift-default-dockercfg-pb7w6\""
Sep 15 09:21:39.041892 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.041801    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"]
Sep 15 09:21:39.144716 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.144680    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-socket\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.144945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.144738    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-data\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.144945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.144786    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59451eee-a8bb-4384-ac8b-9286b5d1e326-istiod-ca-cert\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.144945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.144830    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s6p2f\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-kube-api-access-s6p2f\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.144945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.144885    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-credential-socket\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.144945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.144923    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-token\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.145216 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.144965    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-certs\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.145216 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.144988    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-envoy\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.145216 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.145043    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-podinfo\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.242640 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.242608    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"]
Sep 15 09:21:39.245675 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.245640    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-data\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.245876 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.245707    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59451eee-a8bb-4384-ac8b-9286b5d1e326-istiod-ca-cert\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.245876 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.245762    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s6p2f\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-kube-api-access-s6p2f\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.245876 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.245789    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-credential-socket\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.245876 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.245829    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-token\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246109 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246057    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-certs\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246109 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246087    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-envoy\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246216 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246124    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-data\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246216 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246155    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-podinfo\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246216 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246165    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"
Sep 15 09:21:39.246216 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246196    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-credential-socket\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246236    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-socket\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246461 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246399    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-certs\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246601 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246582    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-socket\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.246890 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.246864    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59451eee-a8bb-4384-ac8b-9286b5d1e326-istiod-ca-cert\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.248661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.248635    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-envoy\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.248889 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.248870    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:21:39.248889 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.248880    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:21:39.249276 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.249255    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-podinfo\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.256447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.256412    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"]
Sep 15 09:21:39.262908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.260048    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s6p2f\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-kube-api-access-s6p2f\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.263745 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.263691    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-token\") pod \"e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") " pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.335549 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.335452    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:39.347150 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.347125    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21077d99-9da8-48ea-8add-eff1e9aecece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-abf07f-f7jzd\" (UID: \"21077d99-9da8-48ea-8add-eff1e9aecece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"
Sep 15 09:21:39.447745 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.447704    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21077d99-9da8-48ea-8add-eff1e9aecece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-abf07f-f7jzd\" (UID: \"21077d99-9da8-48ea-8add-eff1e9aecece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"
Sep 15 09:21:39.448609 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.448586    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21077d99-9da8-48ea-8add-eff1e9aecece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-autores-abf07f-f7jzd\" (UID: \"21077d99-9da8-48ea-8add-eff1e9aecece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"
Sep 15 09:21:39.577798 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.577758    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"
Sep 15 09:21:39.610718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.610685    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"]
Sep 15 09:21:39.612640 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:39.612616    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59451eee_a8bb_4384_ac8b_9286b5d1e326.slice/crio-0930c703c94ef645d725ab0f561ffc64f7f5d9a81083fb59f72935097db88de5 WatchSource:0}: Error finding container 0930c703c94ef645d725ab0f561ffc64f7f5d9a81083fb59f72935097db88de5: Status 404 returned error can't find the container with id 0930c703c94ef645d725ab0f561ffc64f7f5d9a81083fb59f72935097db88de5
Sep 15 09:21:39.615481 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.615445    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:39.615568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.615515    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:39.615568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.615544    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:21:39.869553 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:39.869475    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"]
Sep 15 09:21:39.872926 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:39.872889    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21077d99_9da8_48ea_8add_eff1e9aecece.slice/crio-885d6fd5c21d7cd3c892b43b4e2fa555a1bdc42e3e56f40995b01f1d6aba0892 WatchSource:0}: Error finding container 885d6fd5c21d7cd3c892b43b4e2fa555a1bdc42e3e56f40995b01f1d6aba0892: Status 404 returned error can't find the container with id 885d6fd5c21d7cd3c892b43b4e2fa555a1bdc42e3e56f40995b01f1d6aba0892
Sep 15 09:21:40.468198 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:40.468158    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd" event={"ID":"21077d99-9da8-48ea-8add-eff1e9aecece","Type":"ContainerStarted","Data":"be565ccabd96026e00a926f012833063541d9ecf1fefd2ab8d7fd6b768c57a67"}
Sep 15 09:21:40.468623 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:40.468232    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd" event={"ID":"21077d99-9da8-48ea-8add-eff1e9aecece","Type":"ContainerStarted","Data":"885d6fd5c21d7cd3c892b43b4e2fa555a1bdc42e3e56f40995b01f1d6aba0892"}
Sep 15 09:21:40.469769 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:40.469738    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" event={"ID":"59451eee-a8bb-4384-ac8b-9286b5d1e326","Type":"ContainerStarted","Data":"bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d"}
Sep 15 09:21:40.469887 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:40.469786    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" event={"ID":"59451eee-a8bb-4384-ac8b-9286b5d1e326","Type":"ContainerStarted","Data":"0930c703c94ef645d725ab0f561ffc64f7f5d9a81083fb59f72935097db88de5"}
Sep 15 09:21:40.484022 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:40.483948    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd" podStartSLOduration=1.483934106 podStartE2EDuration="1.483934106s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:40.482177058 +0000 UTC m=+876.245748520" watchObservedRunningTime="2026-09-15 09:21:40.483934106 +0000 UTC m=+876.247505553"
Sep 15 09:21:40.501059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:40.501009    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" podStartSLOduration=1.5009920239999999 podStartE2EDuration="1.500992024s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:40.499449924 +0000 UTC m=+876.263021397" watchObservedRunningTime="2026-09-15 09:21:40.500992024 +0000 UTC m=+876.264563514"
Sep 15 09:21:41.336304 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:41.336271    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:41.341569 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:41.341545    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:41.476175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:41.476136    2568 generic.go:356] "Generic (PLEG): container finished" podID="21077d99-9da8-48ea-8add-eff1e9aecece" containerID="be565ccabd96026e00a926f012833063541d9ecf1fefd2ab8d7fd6b768c57a67" exitCode=0
Sep 15 09:21:41.476565 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:41.476186    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd" event={"ID":"21077d99-9da8-48ea-8add-eff1e9aecece","Type":"ContainerDied","Data":"be565ccabd96026e00a926f012833063541d9ecf1fefd2ab8d7fd6b768c57a67"}
Sep 15 09:21:41.476565 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:41.476532    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:41.477395 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:41.477373    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:21:42.618242 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:42.618215    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"
Sep 15 09:21:42.778174 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:42.778081    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21077d99-9da8-48ea-8add-eff1e9aecece-maas-api-service-ca\") pod \"21077d99-9da8-48ea-8add-eff1e9aecece\" (UID: \"21077d99-9da8-48ea-8add-eff1e9aecece\") "
Sep 15 09:21:42.778469 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:42.778447    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/21077d99-9da8-48ea-8add-eff1e9aecece-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "21077d99-9da8-48ea-8add-eff1e9aecece" (UID: "21077d99-9da8-48ea-8add-eff1e9aecece"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:42.879601 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:42.879566    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/21077d99-9da8-48ea-8add-eff1e9aecece-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.488099 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.488072    2568 generic.go:356] "Generic (PLEG): container finished" podID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerID="90ece763b1517833fcd82042e8efdec263d9aa2b2c20d45c93a0e679d394f314" exitCode=0
Sep 15 09:21:43.488222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.488105    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" event={"ID":"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752","Type":"ContainerDied","Data":"90ece763b1517833fcd82042e8efdec263d9aa2b2c20d45c93a0e679d394f314"}
Sep 15 09:21:43.488222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.488168    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr" event={"ID":"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752","Type":"ContainerDied","Data":"76afc882bcf25b36932bf8af2c5d1d58d4b63c5d105456a3cf4026db24179c8e"}
Sep 15 09:21:43.488222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.488196    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="76afc882bcf25b36932bf8af2c5d1d58d4b63c5d105456a3cf4026db24179c8e"
Sep 15 09:21:43.488222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.488214    2568 scope.go:117] "RemoveContainer" containerID="0e96bbeda5c74d69012f8d6cbb270341217bdfa8da4158972516ca1b689b654c"
Sep 15 09:21:43.489662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.489645    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"
Sep 15 09:21:43.489737 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.489675    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd" event={"ID":"21077d99-9da8-48ea-8add-eff1e9aecece","Type":"ContainerDied","Data":"885d6fd5c21d7cd3c892b43b4e2fa555a1bdc42e3e56f40995b01f1d6aba0892"}
Sep 15 09:21:43.489737 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.489716    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="885d6fd5c21d7cd3c892b43b4e2fa555a1bdc42e3e56f40995b01f1d6aba0892"
Sep 15 09:21:43.499044 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:21:43.499025    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e96bbeda5c74d69012f8d6cbb270341217bdfa8da4158972516ca1b689b654c\": container with ID starting with 0e96bbeda5c74d69012f8d6cbb270341217bdfa8da4158972516ca1b689b654c not found: ID does not exist" containerID="0e96bbeda5c74d69012f8d6cbb270341217bdfa8da4158972516ca1b689b654c"
Sep 15 09:21:43.502613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.502597    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:43.586054 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586024    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tgbm\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-kube-api-access-6tgbm\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586237 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586071    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istiod-ca-cert\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586237 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586097    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-token\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586237 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586132    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-podinfo\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586470 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586234    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-data\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586470 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586282    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-envoy\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586470 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586346    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-credential-socket\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586470 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586420    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-certs\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586470 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586452    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-socket\") pod \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\" (UID: \"a24b8608-4fe8-4d7d-aac4-f0efbeeaf752\") "
Sep 15 09:21:43.586712 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586572    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-data" (OuterVolumeSpecName: "istio-data") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:21:43.586712 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586604    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:43.586712 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586633    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:21:43.587049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586782    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:21:43.587049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586820    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:21:43.587049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586929    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.587049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586947    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.587049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586961    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.587049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586974    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.587049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.586989    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.588579 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.588554    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-kube-api-access-6tgbm" (OuterVolumeSpecName: "kube-api-access-6tgbm") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "kube-api-access-6tgbm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:43.588967 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.588946    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:21:43.589059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.588994    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-token" (OuterVolumeSpecName: "istio-token") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:43.589059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.588996    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" (UID: "a24b8608-4fe8-4d7d-aac4-f0efbeeaf752"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:21:43.687925 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.687887    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.687925 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.687923    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.687925 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.687933    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tgbm\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-kube-api-access-6tgbm\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:43.688351 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:43.687942    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:44.496444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:44.496365    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"
Sep 15 09:21:44.520281 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:44.520253    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"]
Sep 15 09:21:44.523632 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:44.523608    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0da90685-openshift-default-57c945b59d-cqjtr"]
Sep 15 09:21:44.786136 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:44.786062    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" path="/var/lib/kubelet/pods/a24b8608-4fe8-4d7d-aac4-f0efbeeaf752/volumes"
Sep 15 09:21:45.340502 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.340467    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"]
Sep 15 09:21:45.340945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.340925    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy"
Sep 15 09:21:45.340945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.340947    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy"
Sep 15 09:21:45.341050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.340962    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21077d99-9da8-48ea-8add-eff1e9aecece" containerName="revoke-keys"
Sep 15 09:21:45.341050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.340970    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="21077d99-9da8-48ea-8add-eff1e9aecece" containerName="revoke-keys"
Sep 15 09:21:45.341050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.340987    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy"
Sep 15 09:21:45.341050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.340996    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy"
Sep 15 09:21:45.341248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.341112    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="21077d99-9da8-48ea-8add-eff1e9aecece" containerName="revoke-keys"
Sep 15 09:21:45.341248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.341123    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy"
Sep 15 09:21:45.341248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.341130    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a24b8608-4fe8-4d7d-aac4-f0efbeeaf752" containerName="istio-proxy"
Sep 15 09:21:45.345592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.345576    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:45.348361 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.348340    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a01e15d8-dockercfg-r7c9q\""
Sep 15 09:21:45.348467 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.348378    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a01e15d8\""
Sep 15 09:21:45.356307 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.356286    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"]
Sep 15 09:21:45.372428 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.372392    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"]
Sep 15 09:21:45.375752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.375734    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:45.384724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.384704    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"]
Sep 15 09:21:45.505248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.505219    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8\" (UID: \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:45.505433 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.505271    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e9999b-7661-4c2b-a0db-15a01ba6f922-plugins-config-volume\") pod \"payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76\" (UID: \"15e9999b-7661-4c2b-a0db-15a01ba6f922\") " pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:45.505519 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.505428    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmhqd\" (UniqueName: \"kubernetes.io/projected/15e9999b-7661-4c2b-a0db-15a01ba6f922-kube-api-access-wmhqd\") pod \"payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76\" (UID: \"15e9999b-7661-4c2b-a0db-15a01ba6f922\") " pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:45.505519 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.505474    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz8tf\" (UniqueName: \"kubernetes.io/projected/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-kube-api-access-zz8tf\") pod \"payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8\" (UID: \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:45.606729 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.606637    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmhqd\" (UniqueName: \"kubernetes.io/projected/15e9999b-7661-4c2b-a0db-15a01ba6f922-kube-api-access-wmhqd\") pod \"payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76\" (UID: \"15e9999b-7661-4c2b-a0db-15a01ba6f922\") " pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:45.606729 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.606676    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz8tf\" (UniqueName: \"kubernetes.io/projected/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-kube-api-access-zz8tf\") pod \"payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8\" (UID: \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:45.607016 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.606739    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8\" (UID: \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:45.607016 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.606769    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e9999b-7661-4c2b-a0db-15a01ba6f922-plugins-config-volume\") pod \"payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76\" (UID: \"15e9999b-7661-4c2b-a0db-15a01ba6f922\") " pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:45.607700 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.607676    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e9999b-7661-4c2b-a0db-15a01ba6f922-plugins-config-volume\") pod \"payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76\" (UID: \"15e9999b-7661-4c2b-a0db-15a01ba6f922\") " pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:45.607747 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.607676    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8\" (UID: \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:45.620350 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.620328    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmhqd\" (UniqueName: \"kubernetes.io/projected/15e9999b-7661-4c2b-a0db-15a01ba6f922-kube-api-access-wmhqd\") pod \"payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76\" (UID: \"15e9999b-7661-4c2b-a0db-15a01ba6f922\") " pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:45.635390 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.635359    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz8tf\" (UniqueName: \"kubernetes.io/projected/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-kube-api-access-zz8tf\") pod \"payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8\" (UID: \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:45.657236 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.657202    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:45.686136 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.686109    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:45.935157 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.935133    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"]
Sep 15 09:21:45.937200 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:45.937177    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ef9eba_c0d7_493f_92b6_3456b26c8a1e.slice/crio-ed422b55632ed70d1b71f228ca40c88f03be957816a73513cdd0d538b6df4bcd WatchSource:0}: Error finding container ed422b55632ed70d1b71f228ca40c88f03be957816a73513cdd0d538b6df4bcd: Status 404 returned error can't find the container with id ed422b55632ed70d1b71f228ca40c88f03be957816a73513cdd0d538b6df4bcd
Sep 15 09:21:45.973044 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:45.972910    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"]
Sep 15 09:21:45.974893 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:45.974862    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15e9999b_7661_4c2b_a0db_15a01ba6f922.slice/crio-5eafafa43b4196c1b306176466a7dbb4cf3219f67d76bc880b13637f507edc32 WatchSource:0}: Error finding container 5eafafa43b4196c1b306176466a7dbb4cf3219f67d76bc880b13637f507edc32: Status 404 returned error can't find the container with id 5eafafa43b4196c1b306176466a7dbb4cf3219f67d76bc880b13637f507edc32
Sep 15 09:21:46.511179 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:46.511137    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76" event={"ID":"15e9999b-7661-4c2b-a0db-15a01ba6f922","Type":"ContainerStarted","Data":"06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2"}
Sep 15 09:21:46.511380 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:46.511201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76" event={"ID":"15e9999b-7661-4c2b-a0db-15a01ba6f922","Type":"ContainerStarted","Data":"5eafafa43b4196c1b306176466a7dbb4cf3219f67d76bc880b13637f507edc32"}
Sep 15 09:21:46.511380 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:46.511305    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:46.512986 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:46.512948    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8" event={"ID":"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e","Type":"ContainerStarted","Data":"873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457"}
Sep 15 09:21:46.513094 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:46.513007    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8" event={"ID":"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e","Type":"ContainerStarted","Data":"ed422b55632ed70d1b71f228ca40c88f03be957816a73513cdd0d538b6df4bcd"}
Sep 15 09:21:46.513094 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:46.513033    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:46.528489 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:46.528439    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76" podStartSLOduration=1.528421029 podStartE2EDuration="1.528421029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:46.526945247 +0000 UTC m=+882.290516699" watchObservedRunningTime="2026-09-15 09:21:46.528421029 +0000 UTC m=+882.291992484"
Sep 15 09:21:46.543947 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:46.543902    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8" podStartSLOduration=1.543887562 podStartE2EDuration="1.543887562s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:46.542597828 +0000 UTC m=+882.306169278" watchObservedRunningTime="2026-09-15 09:21:46.543887562 +0000 UTC m=+882.307459039"
Sep 15 09:21:50.009354 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.009314    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"]
Sep 15 09:21:50.009892 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.009641    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86" podUID="4de8270a-a8ea-4c3a-a53e-b5351b865f9c" containerName="payload-processing" containerID="cri-o://a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9" gracePeriod=30
Sep 15 09:21:50.017358 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.017332    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"]
Sep 15 09:21:50.017538 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.017519    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl" podUID="e33cf363-90ee-4dba-966b-51ff353fdd48" containerName="payload-pre-processing" containerID="cri-o://9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40" gracePeriod=30
Sep 15 09:21:50.182333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.182301    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"]
Sep 15 09:21:50.184255 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.184218    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-autores-abf07f-f7jzd"]
Sep 15 09:21:50.297339 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.297316    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:21:50.303751 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.303732    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:21:50.453566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.453532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dr9qh\" (UniqueName: \"kubernetes.io/projected/e33cf363-90ee-4dba-966b-51ff353fdd48-kube-api-access-dr9qh\") pod \"e33cf363-90ee-4dba-966b-51ff353fdd48\" (UID: \"e33cf363-90ee-4dba-966b-51ff353fdd48\") "
Sep 15 09:21:50.453566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.453567    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33cf363-90ee-4dba-966b-51ff353fdd48-plugins-config-volume\") pod \"e33cf363-90ee-4dba-966b-51ff353fdd48\" (UID: \"e33cf363-90ee-4dba-966b-51ff353fdd48\") "
Sep 15 09:21:50.453782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.453594    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-plugins-config-volume\") pod \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\" (UID: \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\") "
Sep 15 09:21:50.453782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.453619    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qr9hm\" (UniqueName: \"kubernetes.io/projected/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-kube-api-access-qr9hm\") pod \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\" (UID: \"4de8270a-a8ea-4c3a-a53e-b5351b865f9c\") "
Sep 15 09:21:50.454032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.454003    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4de8270a-a8ea-4c3a-a53e-b5351b865f9c" (UID: "4de8270a-a8ea-4c3a-a53e-b5351b865f9c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:50.454106 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.454003    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e33cf363-90ee-4dba-966b-51ff353fdd48-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e33cf363-90ee-4dba-966b-51ff353fdd48" (UID: "e33cf363-90ee-4dba-966b-51ff353fdd48"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:50.455908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.455883    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e33cf363-90ee-4dba-966b-51ff353fdd48-kube-api-access-dr9qh" (OuterVolumeSpecName: "kube-api-access-dr9qh") pod "e33cf363-90ee-4dba-966b-51ff353fdd48" (UID: "e33cf363-90ee-4dba-966b-51ff353fdd48"). InnerVolumeSpecName "kube-api-access-dr9qh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:50.456003 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.455921    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-kube-api-access-qr9hm" (OuterVolumeSpecName: "kube-api-access-qr9hm") pod "4de8270a-a8ea-4c3a-a53e-b5351b865f9c" (UID: "4de8270a-a8ea-4c3a-a53e-b5351b865f9c"). InnerVolumeSpecName "kube-api-access-qr9hm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:21:50.534479 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.534385    2568 generic.go:356] "Generic (PLEG): container finished" podID="4de8270a-a8ea-4c3a-a53e-b5351b865f9c" containerID="a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9" exitCode=0
Sep 15 09:21:50.534479 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.534433    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"
Sep 15 09:21:50.534674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.534473    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86" event={"ID":"4de8270a-a8ea-4c3a-a53e-b5351b865f9c","Type":"ContainerDied","Data":"a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9"}
Sep 15 09:21:50.534674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.534539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86" event={"ID":"4de8270a-a8ea-4c3a-a53e-b5351b865f9c","Type":"ContainerDied","Data":"e6148dcb2402b94d59d58662d909ae5156712b5fe142da973f7c587cc2ba1b76"}
Sep 15 09:21:50.534674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.534572    2568 scope.go:117] "RemoveContainer" containerID="a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9"
Sep 15 09:21:50.535964 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.535932    2568 generic.go:356] "Generic (PLEG): container finished" podID="e33cf363-90ee-4dba-966b-51ff353fdd48" containerID="9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40" exitCode=0
Sep 15 09:21:50.536072 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.535964    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl" event={"ID":"e33cf363-90ee-4dba-966b-51ff353fdd48","Type":"ContainerDied","Data":"9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40"}
Sep 15 09:21:50.536072 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.536022    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl" event={"ID":"e33cf363-90ee-4dba-966b-51ff353fdd48","Type":"ContainerDied","Data":"21fd40045c05690d9a3169d3b586d502fac09f248e31d60bc4295f01c7ff3578"}
Sep 15 09:21:50.536072 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.535976    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"
Sep 15 09:21:50.546993 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.546969    2568 scope.go:117] "RemoveContainer" containerID="a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9"
Sep 15 09:21:50.547378 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:21:50.547347    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9\": container with ID starting with a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9 not found: ID does not exist" containerID="a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9"
Sep 15 09:21:50.547521 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.547390    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9"} err="failed to get container status \"a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9\": rpc error: code = NotFound desc = could not find container \"a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9\": container with ID starting with a19421238c83e9bcf9fbf0d15a4f9553997680fbfcfffc7332058e75503e47d9 not found: ID does not exist"
Sep 15 09:21:50.547521 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.547414    2568 scope.go:117] "RemoveContainer" containerID="9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40"
Sep 15 09:21:50.554453 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.554429    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dr9qh\" (UniqueName: \"kubernetes.io/projected/e33cf363-90ee-4dba-966b-51ff353fdd48-kube-api-access-dr9qh\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:50.554549 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.554458    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e33cf363-90ee-4dba-966b-51ff353fdd48-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:50.554549 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.554472    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:50.554549 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.554487    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qr9hm\" (UniqueName: \"kubernetes.io/projected/4de8270a-a8ea-4c3a-a53e-b5351b865f9c-kube-api-access-qr9hm\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:21:50.555985 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.555968    2568 scope.go:117] "RemoveContainer" containerID="9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40"
Sep 15 09:21:50.556262 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:21:50.556243    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40\": container with ID starting with 9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40 not found: ID does not exist" containerID="9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40"
Sep 15 09:21:50.556313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.556272    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40"} err="failed to get container status \"9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40\": rpc error: code = NotFound desc = could not find container \"9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40\": container with ID starting with 9952417a7f0f990001a1057a4da875d2395aa1360ba03509c47fea71b0c44a40 not found: ID does not exist"
Sep 15 09:21:50.562013 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.561994    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"]
Sep 15 09:21:50.568703 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.568682    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-autores-abf07f-79d5d794bb-l6jvl"]
Sep 15 09:21:50.582297 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.582272    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"]
Sep 15 09:21:50.584050 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.584032    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-abf07f-5f79db5ff7-5sx86"]
Sep 15 09:21:50.786279 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.786199    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="21077d99-9da8-48ea-8add-eff1e9aecece" path="/var/lib/kubelet/pods/21077d99-9da8-48ea-8add-eff1e9aecece/volumes"
Sep 15 09:21:50.786557 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.786544    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4de8270a-a8ea-4c3a-a53e-b5351b865f9c" path="/var/lib/kubelet/pods/4de8270a-a8ea-4c3a-a53e-b5351b865f9c/volumes"
Sep 15 09:21:50.786889 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:50.786875    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e33cf363-90ee-4dba-966b-51ff353fdd48" path="/var/lib/kubelet/pods/e33cf363-90ee-4dba-966b-51ff353fdd48/volumes"
Sep 15 09:21:56.487677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.487599    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"]
Sep 15 09:21:56.488141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.488027    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4de8270a-a8ea-4c3a-a53e-b5351b865f9c" containerName="payload-processing"
Sep 15 09:21:56.488141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.488039    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4de8270a-a8ea-4c3a-a53e-b5351b865f9c" containerName="payload-processing"
Sep 15 09:21:56.488141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.488053    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e33cf363-90ee-4dba-966b-51ff353fdd48" containerName="payload-pre-processing"
Sep 15 09:21:56.488141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.488059    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e33cf363-90ee-4dba-966b-51ff353fdd48" containerName="payload-pre-processing"
Sep 15 09:21:56.488141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.488131    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4de8270a-a8ea-4c3a-a53e-b5351b865f9c" containerName="payload-processing"
Sep 15 09:21:56.488141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.488139    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e33cf363-90ee-4dba-966b-51ff353fdd48" containerName="payload-pre-processing"
Sep 15 09:21:56.492673 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.492654    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"
Sep 15 09:21:56.496718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.496686    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:21:56.496889 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.496696    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:21:56.498135 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.498108    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"]
Sep 15 09:21:56.501718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.501692    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc9c943-2452-4e1d-a58a-2d87426e068c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc\" (UID: \"ecc9c943-2452-4e1d-a58a-2d87426e068c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"
Sep 15 09:21:56.602981 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.602947    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc9c943-2452-4e1d-a58a-2d87426e068c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc\" (UID: \"ecc9c943-2452-4e1d-a58a-2d87426e068c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"
Sep 15 09:21:56.603570 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.603552    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc9c943-2452-4e1d-a58a-2d87426e068c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc\" (UID: \"ecc9c943-2452-4e1d-a58a-2d87426e068c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"
Sep 15 09:21:56.805136 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:56.805048    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"
Sep 15 09:21:57.088888 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:57.088864    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"]
Sep 15 09:21:57.091395 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:21:57.091367    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecc9c943_2452_4e1d_a58a_2d87426e068c.slice/crio-2bc7851fec5548e757062f266a2672eaf0ba946ffd1045a150000e118392ee00 WatchSource:0}: Error finding container 2bc7851fec5548e757062f266a2672eaf0ba946ffd1045a150000e118392ee00: Status 404 returned error can't find the container with id 2bc7851fec5548e757062f266a2672eaf0ba946ffd1045a150000e118392ee00
Sep 15 09:21:57.520416 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:57.520388    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:21:57.520802 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:57.520497    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:21:57.585894 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:57.585835    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc" event={"ID":"ecc9c943-2452-4e1d-a58a-2d87426e068c","Type":"ContainerStarted","Data":"a2dfb6a8d162f2c99431336c568162b3dd5025ac309830828306996f51ff1345"}
Sep 15 09:21:57.586052 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:57.585942    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc" event={"ID":"ecc9c943-2452-4e1d-a58a-2d87426e068c","Type":"ContainerStarted","Data":"2bc7851fec5548e757062f266a2672eaf0ba946ffd1045a150000e118392ee00"}
Sep 15 09:21:57.608868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:57.606714    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc" podStartSLOduration=1.606690685 podStartE2EDuration="1.606690685s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:21:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:21:57.604887502 +0000 UTC m=+893.368458951" watchObservedRunningTime="2026-09-15 09:21:57.606690685 +0000 UTC m=+893.370262134"
Sep 15 09:21:58.593544 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:58.593502    2568 generic.go:356] "Generic (PLEG): container finished" podID="ecc9c943-2452-4e1d-a58a-2d87426e068c" containerID="a2dfb6a8d162f2c99431336c568162b3dd5025ac309830828306996f51ff1345" exitCode=0
Sep 15 09:21:58.594057 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:58.593610    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc" event={"ID":"ecc9c943-2452-4e1d-a58a-2d87426e068c","Type":"ContainerDied","Data":"a2dfb6a8d162f2c99431336c568162b3dd5025ac309830828306996f51ff1345"}
Sep 15 09:21:59.764364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:59.764341    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"
Sep 15 09:21:59.832353 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:59.832315    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc9c943-2452-4e1d-a58a-2d87426e068c-maas-api-service-ca\") pod \"ecc9c943-2452-4e1d-a58a-2d87426e068c\" (UID: \"ecc9c943-2452-4e1d-a58a-2d87426e068c\") "
Sep 15 09:21:59.832965 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:59.832682    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecc9c943-2452-4e1d-a58a-2d87426e068c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ecc9c943-2452-4e1d-a58a-2d87426e068c" (UID: "ecc9c943-2452-4e1d-a58a-2d87426e068c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:21:59.832965 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:21:59.832809    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ecc9c943-2452-4e1d-a58a-2d87426e068c-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:00.615566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:00.615537    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"
Sep 15 09:22:00.615874 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:00.615566    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc" event={"ID":"ecc9c943-2452-4e1d-a58a-2d87426e068c","Type":"ContainerDied","Data":"2bc7851fec5548e757062f266a2672eaf0ba946ffd1045a150000e118392ee00"}
Sep 15 09:22:00.615981 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:00.615907    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2bc7851fec5548e757062f266a2672eaf0ba946ffd1045a150000e118392ee00"
Sep 15 09:22:05.642110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:05.642077    2568 generic.go:356] "Generic (PLEG): container finished" podID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerID="bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d" exitCode=0
Sep 15 09:22:05.642539 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:05.642146    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" event={"ID":"59451eee-a8bb-4384-ac8b-9286b5d1e326","Type":"ContainerDied","Data":"bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d"}
Sep 15 09:22:05.642539 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:05.642505    2568 scope.go:117] "RemoveContainer" containerID="bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d"
Sep 15 09:22:05.643587 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:05.643557    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:05.643674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:05.643627    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:05.643674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:05.643666    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:06.648592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:06.648558    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" event={"ID":"59451eee-a8bb-4384-ac8b-9286b5d1e326","Type":"ContainerStarted","Data":"a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49"}
Sep 15 09:22:07.315872 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.312602    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"]
Sep 15 09:22:07.315872 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.313289    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76" podUID="15e9999b-7661-4c2b-a0db-15a01ba6f922" containerName="payload-processing" containerID="cri-o://06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2" gracePeriod=30
Sep 15 09:22:07.324548 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.324492    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"]
Sep 15 09:22:07.324762 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.324730    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8" podUID="c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" containerName="payload-pre-processing" containerID="cri-o://873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457" gracePeriod=30
Sep 15 09:22:07.337251 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.335903    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:22:07.337251 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.336997    2568 patch_prober.go:28] interesting pod/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 15 09:22:07.337251 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.337053    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 15 09:22:07.525961 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.516518    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"]
Sep 15 09:22:07.525961 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.520726    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a01e15d8-xcnzc"]
Sep 15 09:22:07.525961 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.525510    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8" podUID="c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.134.0.44:9004: connect: connection refused"
Sep 15 09:22:07.606367 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.606049    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:22:07.641231 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.641147    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"]
Sep 15 09:22:07.644744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.644714    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:22:07.655021 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.654989    2568 generic.go:356] "Generic (PLEG): container finished" podID="15e9999b-7661-4c2b-a0db-15a01ba6f922" containerID="06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2" exitCode=0
Sep 15 09:22:07.655450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.655041    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"
Sep 15 09:22:07.655450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.655075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76" event={"ID":"15e9999b-7661-4c2b-a0db-15a01ba6f922","Type":"ContainerDied","Data":"06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2"}
Sep 15 09:22:07.655450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.655134    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76" event={"ID":"15e9999b-7661-4c2b-a0db-15a01ba6f922","Type":"ContainerDied","Data":"5eafafa43b4196c1b306176466a7dbb4cf3219f67d76bc880b13637f507edc32"}
Sep 15 09:22:07.655450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.655168    2568 scope.go:117] "RemoveContainer" containerID="06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2"
Sep 15 09:22:07.657084 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.657063    2568 generic.go:356] "Generic (PLEG): container finished" podID="c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" containerID="873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457" exitCode=0
Sep 15 09:22:07.657192 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.657153    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"
Sep 15 09:22:07.657192 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.657182    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8" event={"ID":"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e","Type":"ContainerDied","Data":"873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457"}
Sep 15 09:22:07.657287 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.657230    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8" event={"ID":"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e","Type":"ContainerDied","Data":"ed422b55632ed70d1b71f228ca40c88f03be957816a73513cdd0d538b6df4bcd"}
Sep 15 09:22:07.657564 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.657545    2568 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" secret="" err="secret \"e2e-derive-a01e15d8-openshift-default-dockercfg-pb7w6\" not found"
Sep 15 09:22:07.667887 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.667830    2568 scope.go:117] "RemoveContainer" containerID="06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2"
Sep 15 09:22:07.668317 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:22:07.668295    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2\": container with ID starting with 06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2 not found: ID does not exist" containerID="06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2"
Sep 15 09:22:07.668402 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.668339    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2"} err="failed to get container status \"06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2\": rpc error: code = NotFound desc = could not find container \"06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2\": container with ID starting with 06edbfc5c949ea8e600372bbba231aa3740cad81124dff897e41ee07052ab0e2 not found: ID does not exist"
Sep 15 09:22:07.668402 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.668356    2568 scope.go:117] "RemoveContainer" containerID="873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457"
Sep 15 09:22:07.680991 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.680953    2568 scope.go:117] "RemoveContainer" containerID="873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457"
Sep 15 09:22:07.681390 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:22:07.681362    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457\": container with ID starting with 873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457 not found: ID does not exist" containerID="873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457"
Sep 15 09:22:07.681477 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.681404    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457"} err="failed to get container status \"873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457\": rpc error: code = NotFound desc = could not find container \"873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457\": container with ID starting with 873ab15e9566998acae53dd35b5b0a08bbb57eaae659f69043e2a83a7da04457 not found: ID does not exist"
Sep 15 09:22:07.715871 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.714329    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wmhqd\" (UniqueName: \"kubernetes.io/projected/15e9999b-7661-4c2b-a0db-15a01ba6f922-kube-api-access-wmhqd\") pod \"15e9999b-7661-4c2b-a0db-15a01ba6f922\" (UID: \"15e9999b-7661-4c2b-a0db-15a01ba6f922\") "
Sep 15 09:22:07.715871 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.714480    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e9999b-7661-4c2b-a0db-15a01ba6f922-plugins-config-volume\") pod \"15e9999b-7661-4c2b-a0db-15a01ba6f922\" (UID: \"15e9999b-7661-4c2b-a0db-15a01ba6f922\") "
Sep 15 09:22:07.715871 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.714519    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zz8tf\" (UniqueName: \"kubernetes.io/projected/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-kube-api-access-zz8tf\") pod \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\" (UID: \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\") "
Sep 15 09:22:07.715871 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.714561    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-plugins-config-volume\") pod \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\" (UID: \"c4ef9eba-c0d7-493f-92b6-3456b26c8a1e\") "
Sep 15 09:22:07.715871 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.715522    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" (UID: "c4ef9eba-c0d7-493f-92b6-3456b26c8a1e"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:22:07.717234 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.717196    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15e9999b-7661-4c2b-a0db-15a01ba6f922-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "15e9999b-7661-4c2b-a0db-15a01ba6f922" (UID: "15e9999b-7661-4c2b-a0db-15a01ba6f922"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:22:07.719405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.719378    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15e9999b-7661-4c2b-a0db-15a01ba6f922-kube-api-access-wmhqd" (OuterVolumeSpecName: "kube-api-access-wmhqd") pod "15e9999b-7661-4c2b-a0db-15a01ba6f922" (UID: "15e9999b-7661-4c2b-a0db-15a01ba6f922"). InnerVolumeSpecName "kube-api-access-wmhqd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:07.719660 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.719621    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-kube-api-access-zz8tf" (OuterVolumeSpecName: "kube-api-access-zz8tf") pod "c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" (UID: "c4ef9eba-c0d7-493f-92b6-3456b26c8a1e"). InnerVolumeSpecName "kube-api-access-zz8tf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:07.816868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.816381    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:07.816868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.816422    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wmhqd\" (UniqueName: \"kubernetes.io/projected/15e9999b-7661-4c2b-a0db-15a01ba6f922-kube-api-access-wmhqd\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:07.816868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.816439    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/15e9999b-7661-4c2b-a0db-15a01ba6f922-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:07.816868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.816454    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zz8tf\" (UniqueName: \"kubernetes.io/projected/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e-kube-api-access-zz8tf\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:07.976606 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.976578    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"]
Sep 15 09:22:07.980358 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.980336    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76"]
Sep 15 09:22:07.993933 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.993897    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"]
Sep 15 09:22:07.996871 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:07.996831    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a01e15d8-58b6b6b8fd-t77c8"]
Sep 15 09:22:08.336523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:08.336495    2568 patch_prober.go:28] interesting pod/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body=
Sep 15 09:22:08.336648 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:08.336561    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused"
Sep 15 09:22:08.525310 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:08.525271    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-derive-a01e15d8-6757cddb57-dmr76" podUID="15e9999b-7661-4c2b-a0db-15a01ba6f922" containerName="payload-processing" probeResult="failure" output="dial tcp 10.134.0.45:9004: i/o timeout"
Sep 15 09:22:08.664202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:08.664142    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy" containerID="cri-o://a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49" gracePeriod=30
Sep 15 09:22:08.785612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:08.785578    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15e9999b-7661-4c2b-a0db-15a01ba6f922" path="/var/lib/kubelet/pods/15e9999b-7661-4c2b-a0db-15a01ba6f922/volumes"
Sep 15 09:22:08.785968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:08.785955    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" path="/var/lib/kubelet/pods/c4ef9eba-c0d7-493f-92b6-3456b26c8a1e/volumes"
Sep 15 09:22:08.786239 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:08.786227    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecc9c943-2452-4e1d-a58a-2d87426e068c" path="/var/lib/kubelet/pods/ecc9c943-2452-4e1d-a58a-2d87426e068c/volumes"
Sep 15 09:22:11.477255 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:11.477220    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:22:17.617015 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.616991    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709176    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-envoy\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709261    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s6p2f\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-kube-api-access-s6p2f\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709294    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-podinfo\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709324    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-socket\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709359    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-data\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709394    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-credential-socket\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709452    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-token\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709511    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59451eee-a8bb-4384-ac8b-9286b5d1e326-istiod-ca-cert\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.710326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.709561    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-certs\") pod \"59451eee-a8bb-4384-ac8b-9286b5d1e326\" (UID: \"59451eee-a8bb-4384-ac8b-9286b5d1e326\") "
Sep 15 09:22:17.711254 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.710940    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:17.711796 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.711738    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-data" (OuterVolumeSpecName: "istio-data") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:17.713332 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.713284    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:17.713665 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.713622    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/59451eee-a8bb-4384-ac8b-9286b5d1e326-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:22:17.714037 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.713825    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:17.714909 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.714300    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:22:17.715511 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.715454    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-kube-api-access-s6p2f" (OuterVolumeSpecName: "kube-api-access-s6p2f") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "kube-api-access-s6p2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:17.716024 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.715996    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:22:17.716391 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.716372    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-token" (OuterVolumeSpecName: "istio-token") pod "59451eee-a8bb-4384-ac8b-9286b5d1e326" (UID: "59451eee-a8bb-4384-ac8b-9286b5d1e326"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:22:17.716583 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.716561    2568 generic.go:356] "Generic (PLEG): container finished" podID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerID="a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49" exitCode=0
Sep 15 09:22:17.716643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.716615    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"
Sep 15 09:22:17.716688 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.716636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" event={"ID":"59451eee-a8bb-4384-ac8b-9286b5d1e326","Type":"ContainerDied","Data":"a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49"}
Sep 15 09:22:17.716725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.716713    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q" event={"ID":"59451eee-a8bb-4384-ac8b-9286b5d1e326","Type":"ContainerDied","Data":"0930c703c94ef645d725ab0f561ffc64f7f5d9a81083fb59f72935097db88de5"}
Sep 15 09:22:17.716768 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.716737    2568 scope.go:117] "RemoveContainer" containerID="a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49"
Sep 15 09:22:17.732414 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.732397    2568 scope.go:117] "RemoveContainer" containerID="bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d"
Sep 15 09:22:17.740643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.740624    2568 scope.go:117] "RemoveContainer" containerID="a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49"
Sep 15 09:22:17.740955 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:22:17.740936    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49\": container with ID starting with a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49 not found: ID does not exist" containerID="a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49"
Sep 15 09:22:17.741036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.740967    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49"} err="failed to get container status \"a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49\": rpc error: code = NotFound desc = could not find container \"a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49\": container with ID starting with a5958a16ff90c65e0820f1b00cc8007b821def83c5a3ac4a311642e87b963b49 not found: ID does not exist"
Sep 15 09:22:17.741036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.740993    2568 scope.go:117] "RemoveContainer" containerID="bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d"
Sep 15 09:22:17.741261 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:22:17.741244    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d\": container with ID starting with bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d not found: ID does not exist" containerID="bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d"
Sep 15 09:22:17.741301 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.741267    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d"} err="failed to get container status \"bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d\": rpc error: code = NotFound desc = could not find container \"bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d\": container with ID starting with bdfd140b22d427db8ecfa51c05ab933ff4ba1e4ecd264e8487e9cb5c8764df4d not found: ID does not exist"
Sep 15 09:22:17.744618 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.744596    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"]
Sep 15 09:22:17.750617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.750597    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a01e15d8-openshift-default-bf6bb457b-dl27q"]
Sep 15 09:22:17.810803 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810774    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:17.810803 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810799    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s6p2f\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-kube-api-access-s6p2f\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:17.810803 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810809    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:17.811004 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810819    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:17.811004 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810827    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:17.811004 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810836    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:17.811004 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810870    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/59451eee-a8bb-4384-ac8b-9286b5d1e326-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:17.811004 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810885    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/59451eee-a8bb-4384-ac8b-9286b5d1e326-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:17.811004 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:17.810896    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/59451eee-a8bb-4384-ac8b-9286b5d1e326-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:22:18.785662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:18.785629    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" path="/var/lib/kubelet/pods/59451eee-a8bb-4384-ac8b-9286b5d1e326/volumes"
Sep 15 09:22:33.512957 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.512923    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"]
Sep 15 09:22:33.513453 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513439    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy"
Sep 15 09:22:33.513496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513457    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy"
Sep 15 09:22:33.513496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513469    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecc9c943-2452-4e1d-a58a-2d87426e068c" containerName="revoke-keys"
Sep 15 09:22:33.513496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513477    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecc9c943-2452-4e1d-a58a-2d87426e068c" containerName="revoke-keys"
Sep 15 09:22:33.513584 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513516    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" containerName="payload-pre-processing"
Sep 15 09:22:33.513584 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513525    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" containerName="payload-pre-processing"
Sep 15 09:22:33.513584 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513534    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15e9999b-7661-4c2b-a0db-15a01ba6f922" containerName="payload-processing"
Sep 15 09:22:33.513584 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513542    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="15e9999b-7661-4c2b-a0db-15a01ba6f922" containerName="payload-processing"
Sep 15 09:22:33.513701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513614    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy"
Sep 15 09:22:33.513701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513624    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecc9c943-2452-4e1d-a58a-2d87426e068c" containerName="revoke-keys"
Sep 15 09:22:33.513701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513638    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4ef9eba-c0d7-493f-92b6-3456b26c8a1e" containerName="payload-pre-processing"
Sep 15 09:22:33.513701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.513647    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="15e9999b-7661-4c2b-a0db-15a01ba6f922" containerName="payload-processing"
Sep 15 09:22:33.516979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.516957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.519986 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.519963    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-c28cf7-openshift-default-dockercfg-6lzzc\""
Sep 15 09:22:33.527810 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.527787    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"]
Sep 15 09:22:33.657653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.657615    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-data\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.657653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.657658    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncgs2\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-kube-api-access-ncgs2\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.657918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.657755    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-envoy\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.657918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.657793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-credential-socket\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.657918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.657874    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istiod-ca-cert\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.658038 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.657936    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-certs\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.658038 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.657979    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-socket\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.658121 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.658034    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-token\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.658121 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.658068    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-podinfo\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759265 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759222    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-socket\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759265 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759263    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-token\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759518 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759295    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-podinfo\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759518 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759331    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-data\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759518 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759354    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncgs2\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-kube-api-access-ncgs2\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759518 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759491    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-envoy\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759555    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-credential-socket\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istiod-ca-cert\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759646    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-certs\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759666    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-socket\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759953 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759722    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-data\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.759953 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.759944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-credential-socket\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.760072 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.760052    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-certs\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.760335 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.760311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istiod-ca-cert\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.761781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.761758    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-envoy\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.762025 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.761999    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-podinfo\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.767969 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.767915    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-token\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.768054 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.768037    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncgs2\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-kube-api-access-ncgs2\") pod \"e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") " pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:33.828001 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:33.827970    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:34.102551 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:34.102457    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"]
Sep 15 09:22:34.105875 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:22:34.105832    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17ad5784_6bcf_4f36_a9f0_478c8d76741a.slice/crio-4332d9b2656ca57e1632a2a9bd47f5a1253b407821dc9ee375141516f611cf57 WatchSource:0}: Error finding container 4332d9b2656ca57e1632a2a9bd47f5a1253b407821dc9ee375141516f611cf57: Status 404 returned error can't find the container with id 4332d9b2656ca57e1632a2a9bd47f5a1253b407821dc9ee375141516f611cf57
Sep 15 09:22:34.108108 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:34.108074    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:34.108206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:34.108141    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:34.108206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:34.108170    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:34.801129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:34.801094    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" event={"ID":"17ad5784-6bcf-4f36-a9f0-478c8d76741a","Type":"ContainerStarted","Data":"2dd02bf3c0313338722a234c9e8d27f80efbffb82f53590d0a01b680ffa41897"}
Sep 15 09:22:34.801601 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:34.801146    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" event={"ID":"17ad5784-6bcf-4f36-a9f0-478c8d76741a","Type":"ContainerStarted","Data":"4332d9b2656ca57e1632a2a9bd47f5a1253b407821dc9ee375141516f611cf57"}
Sep 15 09:22:34.828752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:34.828727    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:34.844503 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:34.844457    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" podStartSLOduration=1.844441696 podStartE2EDuration="1.844441696s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:22:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:22:34.842124496 +0000 UTC m=+930.605695943" watchObservedRunningTime="2026-09-15 09:22:34.844441696 +0000 UTC m=+930.608013199"
Sep 15 09:22:35.834448 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:35.834415    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:36.812484 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:36.812458    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:36.813424 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:36.813397    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:40.389538 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.389505    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"]
Sep 15 09:22:40.389936 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.389917    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy"
Sep 15 09:22:40.389936 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.389931    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy"
Sep 15 09:22:40.390014 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.390003    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="59451eee-a8bb-4384-ac8b-9286b5d1e326" containerName="istio-proxy"
Sep 15 09:22:40.393078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.393060    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:40.396140 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.396115    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-c28cf7\""
Sep 15 09:22:40.396262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.396144    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-c28cf7-dockercfg-57llg\""
Sep 15 09:22:40.410391 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.410365    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"]
Sep 15 09:22:40.417524 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.417490    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"]
Sep 15 09:22:40.417790 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.417770    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlscx\" (UniqueName: \"kubernetes.io/projected/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-kube-api-access-qlscx\") pod \"payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9\" (UID: \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:40.417880 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.417859    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9\" (UID: \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:40.420789 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.420771    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:40.434677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.434655    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"]
Sep 15 09:22:40.519311 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.519262    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c28cf7-6d66958785-8swln\" (UID: \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\") " pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:40.519484 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.519345    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9\" (UID: \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:40.519562 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.519515    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfhls\" (UniqueName: \"kubernetes.io/projected/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-kube-api-access-lfhls\") pod \"payload-processing-e2e-explicit-c28cf7-6d66958785-8swln\" (UID: \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\") " pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:40.519562 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.519545    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlscx\" (UniqueName: \"kubernetes.io/projected/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-kube-api-access-qlscx\") pod \"payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9\" (UID: \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:40.520780 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.520745    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-plugins-config-volume\") pod \"payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9\" (UID: \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:40.530158 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.530096    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlscx\" (UniqueName: \"kubernetes.io/projected/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-kube-api-access-qlscx\") pod \"payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9\" (UID: \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\") " pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:40.620692 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.620652    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lfhls\" (UniqueName: \"kubernetes.io/projected/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-kube-api-access-lfhls\") pod \"payload-processing-e2e-explicit-c28cf7-6d66958785-8swln\" (UID: \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\") " pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:40.620907 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.620712    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c28cf7-6d66958785-8swln\" (UID: \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\") " pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:40.621457 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.621436    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-plugins-config-volume\") pod \"payload-processing-e2e-explicit-c28cf7-6d66958785-8swln\" (UID: \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\") " pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:40.629222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.629183    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfhls\" (UniqueName: \"kubernetes.io/projected/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-kube-api-access-lfhls\") pod \"payload-processing-e2e-explicit-c28cf7-6d66958785-8swln\" (UID: \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\") " pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:40.708011 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.707979    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:40.730570 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.730548    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:40.982036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:40.982011    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"]
Sep 15 09:22:40.984022 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:22:40.983999    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3f31314_e6e7_426a_9571_ccf6dd91fcf8.slice/crio-eaba53df5993da41f2007833e36612adc3b0547ca3ea7872581210c6b1044e2e WatchSource:0}: Error finding container eaba53df5993da41f2007833e36612adc3b0547ca3ea7872581210c6b1044e2e: Status 404 returned error can't find the container with id eaba53df5993da41f2007833e36612adc3b0547ca3ea7872581210c6b1044e2e
Sep 15 09:22:41.015365 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.015339    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"]
Sep 15 09:22:41.017947 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:22:41.017924    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68dd401d_683b_42a5_bbc8_b12eb37ed3bd.slice/crio-582241e660c5cb90a706c4690acb8ba323d59df50dc97d16ae1849fd63dfa459 WatchSource:0}: Error finding container 582241e660c5cb90a706c4690acb8ba323d59df50dc97d16ae1849fd63dfa459: Status 404 returned error can't find the container with id 582241e660c5cb90a706c4690acb8ba323d59df50dc97d16ae1849fd63dfa459
Sep 15 09:22:41.839971 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.839933    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9" event={"ID":"c3f31314-e6e7-426a-9571-ccf6dd91fcf8","Type":"ContainerStarted","Data":"5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f"}
Sep 15 09:22:41.840596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.839996    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9" event={"ID":"c3f31314-e6e7-426a-9571-ccf6dd91fcf8","Type":"ContainerStarted","Data":"eaba53df5993da41f2007833e36612adc3b0547ca3ea7872581210c6b1044e2e"}
Sep 15 09:22:41.840596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.840042    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:41.841785 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.841759    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln" event={"ID":"68dd401d-683b-42a5-bbc8-b12eb37ed3bd","Type":"ContainerStarted","Data":"6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04"}
Sep 15 09:22:41.841943 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.841800    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln" event={"ID":"68dd401d-683b-42a5-bbc8-b12eb37ed3bd","Type":"ContainerStarted","Data":"582241e660c5cb90a706c4690acb8ba323d59df50dc97d16ae1849fd63dfa459"}
Sep 15 09:22:41.841943 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.841866    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:41.857390 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.857344    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9" podStartSLOduration=1.857331941 podStartE2EDuration="1.857331941s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:22:41.855996832 +0000 UTC m=+937.619568283" watchObservedRunningTime="2026-09-15 09:22:41.857331941 +0000 UTC m=+937.620903388"
Sep 15 09:22:41.874496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:41.874448    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln" podStartSLOduration=1.874431371 podStartE2EDuration="1.874431371s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:22:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:22:41.872617665 +0000 UTC m=+937.636189138" watchObservedRunningTime="2026-09-15 09:22:41.874431371 +0000 UTC m=+937.638002819"
Sep 15 09:22:52.850346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:52.850308    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:22:52.850720 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:52.850395    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:22:57.938795 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:57.938759    2568 generic.go:356] "Generic (PLEG): container finished" podID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerID="2dd02bf3c0313338722a234c9e8d27f80efbffb82f53590d0a01b680ffa41897" exitCode=0
Sep 15 09:22:57.939247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:57.938835    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" event={"ID":"17ad5784-6bcf-4f36-a9f0-478c8d76741a","Type":"ContainerDied","Data":"2dd02bf3c0313338722a234c9e8d27f80efbffb82f53590d0a01b680ffa41897"}
Sep 15 09:22:57.939247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:57.939234    2568 scope.go:117] "RemoveContainer" containerID="2dd02bf3c0313338722a234c9e8d27f80efbffb82f53590d0a01b680ffa41897"
Sep 15 09:22:57.940328 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:57.940296    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:57.940439 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:57.940380    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:57.940439 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:57.940426    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:22:58.945347 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:58.945311    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" event={"ID":"17ad5784-6bcf-4f36-a9f0-478c8d76741a","Type":"ContainerStarted","Data":"f2acc6016effb1f7bc990eb659ec1daacfe05ab253b4de7b6c26b5de4daf129c"}
Sep 15 09:22:59.828975 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:59.828937    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:22:59.829198 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:59.829176    2568 patch_prober.go:28] interesting pod/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 09:22:59.829255 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:22:59.829235    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 09:23:00.829285 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:00.829246    2568 patch_prober.go:28] interesting pod/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 09:23:00.829690 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:00.829301    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 09:23:01.829238 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:01.829203    2568 patch_prober.go:28] interesting pod/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 09:23:01.829491 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:01.829469    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 09:23:02.828369 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:02.828332    2568 patch_prober.go:28] interesting pod/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 09:23:02.828548 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:02.828393    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 09:23:03.828947 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:03.828916    2568 patch_prober.go:28] interesting pod/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body=
Sep 15 09:23:03.829432 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:03.829405    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused"
Sep 15 09:23:04.832730 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:04.832699    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:23:04.833184 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:04.832996    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:23:04.833781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:04.833763    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:23:42.910897 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.910671    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"]
Sep 15 09:23:42.914828 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.914800    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.917739 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.917713    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-7ce8ca0e-openshift-default-dockercfg-fxkzs\""
Sep 15 09:23:42.925011 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.924989    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"]
Sep 15 09:23:42.983725 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.983682    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-socket\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.983949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.983743    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnq8r\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-kube-api-access-tnq8r\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.983949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.983771    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-token\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.983949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.983810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-certs\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.983949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.983906    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-envoy\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.983949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.983944    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-podinfo\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.984201 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.984018    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-credential-socket\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.984201 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.984042    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-data\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:42.984201 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:42.984108    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istiod-ca-cert\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.084545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.084502    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-certs\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.084545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.084551    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-envoy\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.084814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.084692    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-podinfo\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.084814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.084783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-credential-socket\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.084972 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.084813    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-data\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.084972 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.084882    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istiod-ca-cert\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.084972 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.084955    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-socket\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.085150 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.084996    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnq8r\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-kube-api-access-tnq8r\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.085150 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.085025    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-token\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.085150 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.085053    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-certs\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.085489 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.085466    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-socket\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.085583 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.085524    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-credential-socket\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.085682 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.085661    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istiod-ca-cert\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.085774 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.085754    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-data\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.087175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.087158    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-envoy\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.087370 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.087351    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-podinfo\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.093679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.093656    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-token\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.093797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.093730    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnq8r\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-kube-api-access-tnq8r\") pod \"e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") " pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.226059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.225953    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:43.504806 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.504778    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"]
Sep 15 09:23:43.506387 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:23:43.506350    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7a5a784_6055_4f1e_ad5a_11cb6c3376da.slice/crio-6c775e10bfe437f497ee6116c3698229577576c857403572a9f81b9884bb7cda WatchSource:0}: Error finding container 6c775e10bfe437f497ee6116c3698229577576c857403572a9f81b9884bb7cda: Status 404 returned error can't find the container with id 6c775e10bfe437f497ee6116c3698229577576c857403572a9f81b9884bb7cda
Sep 15 09:23:43.508720 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.508682    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:23:43.508790 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.508771    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:23:43.508829 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:43.508816    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:23:44.177125 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:44.177090    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" event={"ID":"c7a5a784-6055-4f1e-ad5a-11cb6c3376da","Type":"ContainerStarted","Data":"4c90053a1abea1b53b63142023a316ed6b8dd94ad95f928b4795919979e93510"}
Sep 15 09:23:44.177517 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:44.177157    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" event={"ID":"c7a5a784-6055-4f1e-ad5a-11cb6c3376da","Type":"ContainerStarted","Data":"6c775e10bfe437f497ee6116c3698229577576c857403572a9f81b9884bb7cda"}
Sep 15 09:23:44.199686 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:44.199633    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podStartSLOduration=2.199616018 podStartE2EDuration="2.199616018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:44.197493744 +0000 UTC m=+999.961065192" watchObservedRunningTime="2026-09-15 09:23:44.199616018 +0000 UTC m=+999.963187466"
Sep 15 09:23:44.226862 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:44.226807    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:44.232252 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:44.232229    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:45.183175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:45.183141    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:45.184002 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:45.183983    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:23:51.604989 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.604954    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"]
Sep 15 09:23:51.608164 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.608149    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:51.610673 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.610640    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7ce8ca0e-dockercfg-fg2j5\""
Sep 15 09:23:51.610790 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.610775    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7ce8ca0e\""
Sep 15 09:23:51.618446 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.618424    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"]
Sep 15 09:23:51.663676 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.663641    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w28l6\" (UniqueName: \"kubernetes.io/projected/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-kube-api-access-w28l6\") pod \"payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp\" (UID: \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\") " pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:51.663822 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.663700    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-plugins-config-volume\") pod \"payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp\" (UID: \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\") " pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:51.764385 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.764343    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w28l6\" (UniqueName: \"kubernetes.io/projected/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-kube-api-access-w28l6\") pod \"payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp\" (UID: \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\") " pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:51.764385 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.764393    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-plugins-config-volume\") pod \"payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp\" (UID: \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\") " pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:51.765067 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.765045    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-plugins-config-volume\") pod \"payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp\" (UID: \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\") " pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:51.774303 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.774278    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w28l6\" (UniqueName: \"kubernetes.io/projected/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-kube-api-access-w28l6\") pod \"payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp\" (UID: \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\") " pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:51.919795 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:51.919767    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:52.195955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:52.195928    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"]
Sep 15 09:23:52.198705 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:23:52.198667    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f349f8e_00e4_4dba_8bb2_3fdcccc48797.slice/crio-7198f56081a754dbb9dc2e92060d5e478011ea9eb2735a247873536a3579c887 WatchSource:0}: Error finding container 7198f56081a754dbb9dc2e92060d5e478011ea9eb2735a247873536a3579c887: Status 404 returned error can't find the container with id 7198f56081a754dbb9dc2e92060d5e478011ea9eb2735a247873536a3579c887
Sep 15 09:23:52.219264 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:52.219231    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp" event={"ID":"7f349f8e-00e4-4dba-8bb2-3fdcccc48797","Type":"ContainerStarted","Data":"7198f56081a754dbb9dc2e92060d5e478011ea9eb2735a247873536a3579c887"}
Sep 15 09:23:53.226383 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:53.226347    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp" event={"ID":"7f349f8e-00e4-4dba-8bb2-3fdcccc48797","Type":"ContainerStarted","Data":"d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac"}
Sep 15 09:23:53.226834 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:53.226432    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:23:53.246183 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:53.246126    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp" podStartSLOduration=2.246110475 podStartE2EDuration="2.246110475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:53.243381098 +0000 UTC m=+1009.006952546" watchObservedRunningTime="2026-09-15 09:23:53.246110475 +0000 UTC m=+1009.009681955"
Sep 15 09:23:55.420383 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.420327    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"]
Sep 15 09:23:55.424717 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.424690    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"
Sep 15 09:23:55.428083 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.428052    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:23:55.428242 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.428058    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:23:55.432677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.432649    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"]
Sep 15 09:23:55.504378 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.504335    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4eb04b9-1f3f-40de-924b-f5aef88a69c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt\" (UID: \"f4eb04b9-1f3f-40de-924b-f5aef88a69c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"
Sep 15 09:23:55.605296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.605261    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4eb04b9-1f3f-40de-924b-f5aef88a69c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt\" (UID: \"f4eb04b9-1f3f-40de-924b-f5aef88a69c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"
Sep 15 09:23:55.605912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.605896    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4eb04b9-1f3f-40de-924b-f5aef88a69c9-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt\" (UID: \"f4eb04b9-1f3f-40de-924b-f5aef88a69c9\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"
Sep 15 09:23:55.738313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:55.738224    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"
Sep 15 09:23:56.008265 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:56.008185    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"]
Sep 15 09:23:56.011462 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:23:56.011436    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4eb04b9_1f3f_40de_924b_f5aef88a69c9.slice/crio-299008a8dd493636697c761b361aaf85643606276383c4eca5125ee6d2824a59 WatchSource:0}: Error finding container 299008a8dd493636697c761b361aaf85643606276383c4eca5125ee6d2824a59: Status 404 returned error can't find the container with id 299008a8dd493636697c761b361aaf85643606276383c4eca5125ee6d2824a59
Sep 15 09:23:56.244072 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:56.244038    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt" event={"ID":"f4eb04b9-1f3f-40de-924b-f5aef88a69c9","Type":"ContainerStarted","Data":"878d15d543ba5695bacd3d2d12f91e6880bf87ca324ad73f0197b0470b8471bb"}
Sep 15 09:23:56.244231 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:56.244119    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt" event={"ID":"f4eb04b9-1f3f-40de-924b-f5aef88a69c9","Type":"ContainerStarted","Data":"299008a8dd493636697c761b361aaf85643606276383c4eca5125ee6d2824a59"}
Sep 15 09:23:56.260028 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:56.259934    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt" podStartSLOduration=1.259913769 podStartE2EDuration="1.259913769s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:23:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:23:56.258598576 +0000 UTC m=+1012.022170025" watchObservedRunningTime="2026-09-15 09:23:56.259913769 +0000 UTC m=+1012.023485219"
Sep 15 09:23:57.251619 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:57.251586    2568 generic.go:356] "Generic (PLEG): container finished" podID="f4eb04b9-1f3f-40de-924b-f5aef88a69c9" containerID="878d15d543ba5695bacd3d2d12f91e6880bf87ca324ad73f0197b0470b8471bb" exitCode=0
Sep 15 09:23:57.252074 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:57.251678    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt" event={"ID":"f4eb04b9-1f3f-40de-924b-f5aef88a69c9","Type":"ContainerDied","Data":"878d15d543ba5695bacd3d2d12f91e6880bf87ca324ad73f0197b0470b8471bb"}
Sep 15 09:23:58.395097 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:58.395048    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"
Sep 15 09:23:58.533433 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:58.533349    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4eb04b9-1f3f-40de-924b-f5aef88a69c9-maas-api-service-ca\") pod \"f4eb04b9-1f3f-40de-924b-f5aef88a69c9\" (UID: \"f4eb04b9-1f3f-40de-924b-f5aef88a69c9\") "
Sep 15 09:23:58.533680 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:58.533656    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4eb04b9-1f3f-40de-924b-f5aef88a69c9-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f4eb04b9-1f3f-40de-924b-f5aef88a69c9" (UID: "f4eb04b9-1f3f-40de-924b-f5aef88a69c9"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:23:58.634478 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:58.634439    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f4eb04b9-1f3f-40de-924b-f5aef88a69c9-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:23:59.263671 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:59.263640    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"
Sep 15 09:23:59.263824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:59.263681    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt" event={"ID":"f4eb04b9-1f3f-40de-924b-f5aef88a69c9","Type":"ContainerDied","Data":"299008a8dd493636697c761b361aaf85643606276383c4eca5125ee6d2824a59"}
Sep 15 09:23:59.263824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:23:59.263728    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="299008a8dd493636697c761b361aaf85643606276383c4eca5125ee6d2824a59"
Sep 15 09:24:04.234182 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:04.234150    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:24:07.235672 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.235633    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"]
Sep 15 09:24:07.236087 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.236032    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln" podUID="68dd401d-683b-42a5-bbc8-b12eb37ed3bd" containerName="payload-processing" containerID="cri-o://6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04" gracePeriod=30
Sep 15 09:24:07.243723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.243371    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"]
Sep 15 09:24:07.243723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.243550    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9" podUID="c3f31314-e6e7-426a-9571-ccf6dd91fcf8" containerName="payload-pre-processing" containerID="cri-o://5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f" gracePeriod=30
Sep 15 09:24:07.478370 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.478334    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"]
Sep 15 09:24:07.489817 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.489681    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-explicit-c28cf7-j4bkt"]
Sep 15 09:24:07.563225 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.563201    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:24:07.600868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.594867    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:24:07.736632 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.736600    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-plugins-config-volume\") pod \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\" (UID: \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\") "
Sep 15 09:24:07.736820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.736662    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlscx\" (UniqueName: \"kubernetes.io/projected/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-kube-api-access-qlscx\") pod \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\" (UID: \"c3f31314-e6e7-426a-9571-ccf6dd91fcf8\") "
Sep 15 09:24:07.736820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.736773    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lfhls\" (UniqueName: \"kubernetes.io/projected/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-kube-api-access-lfhls\") pod \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\" (UID: \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\") "
Sep 15 09:24:07.736820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.736802    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-plugins-config-volume\") pod \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\" (UID: \"68dd401d-683b-42a5-bbc8-b12eb37ed3bd\") "
Sep 15 09:24:07.737246 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.737206    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "68dd401d-683b-42a5-bbc8-b12eb37ed3bd" (UID: "68dd401d-683b-42a5-bbc8-b12eb37ed3bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:24:07.737382 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.737359    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c3f31314-e6e7-426a-9571-ccf6dd91fcf8" (UID: "c3f31314-e6e7-426a-9571-ccf6dd91fcf8"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:24:07.739042 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.739012    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-kube-api-access-lfhls" (OuterVolumeSpecName: "kube-api-access-lfhls") pod "68dd401d-683b-42a5-bbc8-b12eb37ed3bd" (UID: "68dd401d-683b-42a5-bbc8-b12eb37ed3bd"). InnerVolumeSpecName "kube-api-access-lfhls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:07.739368 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.739345    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-kube-api-access-qlscx" (OuterVolumeSpecName: "kube-api-access-qlscx") pod "c3f31314-e6e7-426a-9571-ccf6dd91fcf8" (UID: "c3f31314-e6e7-426a-9571-ccf6dd91fcf8"). InnerVolumeSpecName "kube-api-access-qlscx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:07.838340 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.838253    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:07.838340 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.838281    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:07.838340 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.838291    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlscx\" (UniqueName: \"kubernetes.io/projected/c3f31314-e6e7-426a-9571-ccf6dd91fcf8-kube-api-access-qlscx\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:07.838340 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:07.838299    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lfhls\" (UniqueName: \"kubernetes.io/projected/68dd401d-683b-42a5-bbc8-b12eb37ed3bd-kube-api-access-lfhls\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:08.334213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.334180    2568 generic.go:356] "Generic (PLEG): container finished" podID="c3f31314-e6e7-426a-9571-ccf6dd91fcf8" containerID="5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f" exitCode=0
Sep 15 09:24:08.334657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.334242    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"
Sep 15 09:24:08.334657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.334255    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9" event={"ID":"c3f31314-e6e7-426a-9571-ccf6dd91fcf8","Type":"ContainerDied","Data":"5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f"}
Sep 15 09:24:08.334657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.334313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9" event={"ID":"c3f31314-e6e7-426a-9571-ccf6dd91fcf8","Type":"ContainerDied","Data":"eaba53df5993da41f2007833e36612adc3b0547ca3ea7872581210c6b1044e2e"}
Sep 15 09:24:08.334657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.334340    2568 scope.go:117] "RemoveContainer" containerID="5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f"
Sep 15 09:24:08.335653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.335589    2568 generic.go:356] "Generic (PLEG): container finished" podID="68dd401d-683b-42a5-bbc8-b12eb37ed3bd" containerID="6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04" exitCode=0
Sep 15 09:24:08.335653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.335634    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"
Sep 15 09:24:08.335653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.335639    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln" event={"ID":"68dd401d-683b-42a5-bbc8-b12eb37ed3bd","Type":"ContainerDied","Data":"6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04"}
Sep 15 09:24:08.335782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.335677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln" event={"ID":"68dd401d-683b-42a5-bbc8-b12eb37ed3bd","Type":"ContainerDied","Data":"582241e660c5cb90a706c4690acb8ba323d59df50dc97d16ae1849fd63dfa459"}
Sep 15 09:24:08.343643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.343625    2568 scope.go:117] "RemoveContainer" containerID="5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f"
Sep 15 09:24:08.344033 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:24:08.344008    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f\": container with ID starting with 5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f not found: ID does not exist" containerID="5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f"
Sep 15 09:24:08.344141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.344044    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f"} err="failed to get container status \"5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f\": rpc error: code = NotFound desc = could not find container \"5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f\": container with ID starting with 5825d50a5ace1cfd2a05130099efd907ca93fd0b67b62c6989a7f6c57a2e1a1f not found: ID does not exist"
Sep 15 09:24:08.344141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.344067    2568 scope.go:117] "RemoveContainer" containerID="6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04"
Sep 15 09:24:08.355544 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.355525    2568 scope.go:117] "RemoveContainer" containerID="6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04"
Sep 15 09:24:08.355798 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:24:08.355779    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04\": container with ID starting with 6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04 not found: ID does not exist" containerID="6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04"
Sep 15 09:24:08.355933 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.355802    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04"} err="failed to get container status \"6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04\": rpc error: code = NotFound desc = could not find container \"6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04\": container with ID starting with 6b7e69202c70c94419f40d33a9777011c633af001da8b241551627c16b8c1b04 not found: ID does not exist"
Sep 15 09:24:08.360971 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.360947    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"]
Sep 15 09:24:08.367292 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.367269    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-c28cf7-6d66958785-8swln"]
Sep 15 09:24:08.376617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.376596    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"]
Sep 15 09:24:08.380144 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.380125    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-explicit-c28cf7-96c859fcd-ffdg9"]
Sep 15 09:24:08.786170 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.786129    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68dd401d-683b-42a5-bbc8-b12eb37ed3bd" path="/var/lib/kubelet/pods/68dd401d-683b-42a5-bbc8-b12eb37ed3bd/volumes"
Sep 15 09:24:08.786731 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.786701    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3f31314-e6e7-426a-9571-ccf6dd91fcf8" path="/var/lib/kubelet/pods/c3f31314-e6e7-426a-9571-ccf6dd91fcf8/volumes"
Sep 15 09:24:08.787067 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:08.787052    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4eb04b9-1f3f-40de-924b-f5aef88a69c9" path="/var/lib/kubelet/pods/f4eb04b9-1f3f-40de-924b-f5aef88a69c9/volumes"
Sep 15 09:24:14.142510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.142475    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"]
Sep 15 09:24:14.143156 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.142701    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy" containerID="cri-o://f2acc6016effb1f7bc990eb659ec1daacfe05ab253b4de7b6c26b5de4daf129c" gracePeriod=30
Sep 15 09:24:14.504078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504045    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"]
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504474    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68dd401d-683b-42a5-bbc8-b12eb37ed3bd" containerName="payload-processing"
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504487    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="68dd401d-683b-42a5-bbc8-b12eb37ed3bd" containerName="payload-processing"
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504502    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c3f31314-e6e7-426a-9571-ccf6dd91fcf8" containerName="payload-pre-processing"
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504508    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c3f31314-e6e7-426a-9571-ccf6dd91fcf8" containerName="payload-pre-processing"
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504525    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4eb04b9-1f3f-40de-924b-f5aef88a69c9" containerName="revoke-keys"
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504531    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4eb04b9-1f3f-40de-924b-f5aef88a69c9" containerName="revoke-keys"
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504585    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4eb04b9-1f3f-40de-924b-f5aef88a69c9" containerName="revoke-keys"
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504592    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c3f31314-e6e7-426a-9571-ccf6dd91fcf8" containerName="payload-pre-processing"
Sep 15 09:24:14.506244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.504599    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="68dd401d-683b-42a5-bbc8-b12eb37ed3bd" containerName="payload-processing"
Sep 15 09:24:14.507488 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.507473    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"
Sep 15 09:24:14.509972 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.509948    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:24:14.509972 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.509959    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:24:14.515037 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.514998    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"]
Sep 15 09:24:14.704227 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.704186    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443b7cf8-1468-4d6b-96c2-40435d42e98c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x\" (UID: \"443b7cf8-1468-4d6b-96c2-40435d42e98c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"
Sep 15 09:24:14.805069 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.804965    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443b7cf8-1468-4d6b-96c2-40435d42e98c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x\" (UID: \"443b7cf8-1468-4d6b-96c2-40435d42e98c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"
Sep 15 09:24:14.805597 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.805577    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443b7cf8-1468-4d6b-96c2-40435d42e98c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x\" (UID: \"443b7cf8-1468-4d6b-96c2-40435d42e98c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"
Sep 15 09:24:14.819824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.819796    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"
Sep 15 09:24:14.876565 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.876404    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"]
Sep 15 09:24:14.880897 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.880873    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:14.885534 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.885059    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-981036-openshift-default-dockercfg-6fzg8\""
Sep 15 09:24:14.891745 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:14.891720    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"]
Sep 15 09:24:15.007232 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007144    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-certs\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.007232 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007196    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-credential-socket\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.007540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007265    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpqdh\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-kube-api-access-tpqdh\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.007540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007336    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-envoy\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.007540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007366    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-socket\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.007540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007452    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-podinfo\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.007540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007517    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-data\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.007802 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007594    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-token\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.007802 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.007666    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697a34f4-e9b5-4442-a740-19a6969bdca3-istiod-ca-cert\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.100305 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.100278    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"]
Sep 15 09:24:15.102492 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:24:15.102462    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod443b7cf8_1468_4d6b_96c2_40435d42e98c.slice/crio-52833f88335c43d7c62a55bb2cd65cf24e9bbedb16e61dd6946487fdae4a3f64 WatchSource:0}: Error finding container 52833f88335c43d7c62a55bb2cd65cf24e9bbedb16e61dd6946487fdae4a3f64: Status 404 returned error can't find the container with id 52833f88335c43d7c62a55bb2cd65cf24e9bbedb16e61dd6946487fdae4a3f64
Sep 15 09:24:15.108983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.108834    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpqdh\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-kube-api-access-tpqdh\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.108983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.108914    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-envoy\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.108983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.108946    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-socket\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.109166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.108988    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-podinfo\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.109166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.109043    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-data\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.109166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.109070    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-token\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.109166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.109111    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697a34f4-e9b5-4442-a740-19a6969bdca3-istiod-ca-cert\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.109166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.109158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-certs\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.109660 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.109186    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-credential-socket\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.109935 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.109912    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-credential-socket\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.110092 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.110033    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-socket\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.110257 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.110231    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697a34f4-e9b5-4442-a740-19a6969bdca3-istiod-ca-cert\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.110361 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.110224    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-certs\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.110519 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.110495    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-data\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.112088 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.112061    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-envoy\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.112377 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.112355    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-podinfo\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.117126 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.117106    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpqdh\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-kube-api-access-tpqdh\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.117805 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.117768    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-token\") pod \"e2e-noten-981036-openshift-default-69b54f868b-bpnx6\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") " pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.184638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.184602    2568 patch_prober.go:28] interesting pod/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 15 09:24:15.185007 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.184665    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 15 09:24:15.201683 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.201653    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:15.385607 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.385520    2568 generic.go:356] "Generic (PLEG): container finished" podID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerID="4c90053a1abea1b53b63142023a316ed6b8dd94ad95f928b4795919979e93510" exitCode=0
Sep 15 09:24:15.385768 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.385600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" event={"ID":"c7a5a784-6055-4f1e-ad5a-11cb6c3376da","Type":"ContainerDied","Data":"4c90053a1abea1b53b63142023a316ed6b8dd94ad95f928b4795919979e93510"}
Sep 15 09:24:15.386122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.386103    2568 scope.go:117] "RemoveContainer" containerID="4c90053a1abea1b53b63142023a316ed6b8dd94ad95f928b4795919979e93510"
Sep 15 09:24:15.387076 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.387047    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x" event={"ID":"443b7cf8-1468-4d6b-96c2-40435d42e98c","Type":"ContainerStarted","Data":"52833f88335c43d7c62a55bb2cd65cf24e9bbedb16e61dd6946487fdae4a3f64"}
Sep 15 09:24:15.387314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.387289    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:15.387365 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.387352    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:15.387400 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.387387    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:15.482084 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.482058    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"]
Sep 15 09:24:15.485368 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:24:15.485333    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod697a34f4_e9b5_4442_a740_19a6969bdca3.slice/crio-44fedffb16448040aaae90fda13461de9e6ac3dffad79af5a4c8b6575b8f0c5d WatchSource:0}: Error finding container 44fedffb16448040aaae90fda13461de9e6ac3dffad79af5a4c8b6575b8f0c5d: Status 404 returned error can't find the container with id 44fedffb16448040aaae90fda13461de9e6ac3dffad79af5a4c8b6575b8f0c5d
Sep 15 09:24:15.493903 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.489549    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:15.493903 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.489939    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:15.493903 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:15.490212    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:16.396068 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:16.396023    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6" event={"ID":"697a34f4-e9b5-4442-a740-19a6969bdca3","Type":"ContainerStarted","Data":"7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d"}
Sep 15 09:24:16.396568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:16.396097    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6" event={"ID":"697a34f4-e9b5-4442-a740-19a6969bdca3","Type":"ContainerStarted","Data":"44fedffb16448040aaae90fda13461de9e6ac3dffad79af5a4c8b6575b8f0c5d"}
Sep 15 09:24:16.398940 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:16.398907    2568 generic.go:356] "Generic (PLEG): container finished" podID="443b7cf8-1468-4d6b-96c2-40435d42e98c" containerID="4d8e4089bb7b92535fafbdc5faaf1bf542acaaf65452b7552bef4af73b6efe36" exitCode=0
Sep 15 09:24:16.399097 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:16.399079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x" event={"ID":"443b7cf8-1468-4d6b-96c2-40435d42e98c","Type":"ContainerDied","Data":"4d8e4089bb7b92535fafbdc5faaf1bf542acaaf65452b7552bef4af73b6efe36"}
Sep 15 09:24:16.401975 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:16.401945    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" event={"ID":"c7a5a784-6055-4f1e-ad5a-11cb6c3376da","Type":"ContainerStarted","Data":"ed5733469a14cf47858635c32de820cad42899d389f2f1becccd5d7999ff94bb"}
Sep 15 09:24:16.419752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:16.419678    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6" podStartSLOduration=2.419655688 podStartE2EDuration="2.419655688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:16.417596151 +0000 UTC m=+1032.181167594" watchObservedRunningTime="2026-09-15 09:24:16.419655688 +0000 UTC m=+1032.183227162"
Sep 15 09:24:17.204596 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.204550    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:17.219562 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.219533    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:17.226367 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.226338    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:24:17.226536 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.226514    2568 patch_prober.go:28] interesting pod/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 15 09:24:17.226582 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.226570    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 15 09:24:17.411428 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.411398    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:17.415599 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.415558    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:24:17.604280 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.604001    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"
Sep 15 09:24:17.636453 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.636426    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443b7cf8-1468-4d6b-96c2-40435d42e98c-maas-api-service-ca\") pod \"443b7cf8-1468-4d6b-96c2-40435d42e98c\" (UID: \"443b7cf8-1468-4d6b-96c2-40435d42e98c\") "
Sep 15 09:24:17.636814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.636794    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/443b7cf8-1468-4d6b-96c2-40435d42e98c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "443b7cf8-1468-4d6b-96c2-40435d42e98c" (UID: "443b7cf8-1468-4d6b-96c2-40435d42e98c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:24:17.737450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:17.737363    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/443b7cf8-1468-4d6b-96c2-40435d42e98c-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:18.226568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:18.226528    2568 patch_prober.go:28] interesting pod/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 15 09:24:18.226748 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:18.226580    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 15 09:24:18.419657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:18.419621    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"
Sep 15 09:24:18.420078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:18.419654    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x" event={"ID":"443b7cf8-1468-4d6b-96c2-40435d42e98c","Type":"ContainerDied","Data":"52833f88335c43d7c62a55bb2cd65cf24e9bbedb16e61dd6946487fdae4a3f64"}
Sep 15 09:24:18.420078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:18.419703    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52833f88335c43d7c62a55bb2cd65cf24e9bbedb16e61dd6946487fdae4a3f64"
Sep 15 09:24:19.227241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.227206    2568 patch_prober.go:28] interesting pod/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 15 09:24:19.227418 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.227266    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 15 09:24:19.427325 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.427153    2568 generic.go:356] "Generic (PLEG): container finished" podID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerID="f2acc6016effb1f7bc990eb659ec1daacfe05ab253b4de7b6c26b5de4daf129c" exitCode=0
Sep 15 09:24:19.427325 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.427185    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" event={"ID":"17ad5784-6bcf-4f36-a9f0-478c8d76741a","Type":"ContainerDied","Data":"f2acc6016effb1f7bc990eb659ec1daacfe05ab253b4de7b6c26b5de4daf129c"}
Sep 15 09:24:19.427325 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.427250    2568 scope.go:117] "RemoveContainer" containerID="2dd02bf3c0313338722a234c9e8d27f80efbffb82f53590d0a01b680ffa41897"
Sep 15 09:24:19.444884 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.444865    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:24:19.557722 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.557691    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-podinfo\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.557934 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.557761    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-data\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.557934 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.557790    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istiod-ca-cert\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.557934 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.557825    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-token\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.557934 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.557896    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-certs\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.557934 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.557928    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-socket\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.558198 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.557970    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-envoy\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.558198 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.558006    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ncgs2\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-kube-api-access-ncgs2\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.558198 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.558068    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-credential-socket\") pod \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\" (UID: \"17ad5784-6bcf-4f36-a9f0-478c8d76741a\") "
Sep 15 09:24:19.558306 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.558263    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:24:19.558385 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.558269    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:19.558619 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.558512    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:19.558619 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.558600    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:19.558805 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.558773    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:19.559007 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.558943    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-data" (OuterVolumeSpecName: "istio-data") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:19.560510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.560484    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:24:19.560639 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.560619    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-token" (OuterVolumeSpecName: "istio-token") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:19.561119 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.561098    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:19.561198 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.561134    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-kube-api-access-ncgs2" (OuterVolumeSpecName: "kube-api-access-ncgs2") pod "17ad5784-6bcf-4f36-a9f0-478c8d76741a" (UID: "17ad5784-6bcf-4f36-a9f0-478c8d76741a"). InnerVolumeSpecName "kube-api-access-ncgs2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:19.659950 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.659912    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:19.659950 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.659941    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:19.659950 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.659950    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:19.659950 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.659958    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:19.660257 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.659966    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:19.660257 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.659974    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ncgs2\" (UniqueName: \"kubernetes.io/projected/17ad5784-6bcf-4f36-a9f0-478c8d76741a-kube-api-access-ncgs2\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:19.660257 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.659983    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/17ad5784-6bcf-4f36-a9f0-478c8d76741a-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:19.660257 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:19.659991    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/17ad5784-6bcf-4f36-a9f0-478c8d76741a-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:20.226934 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:20.226898    2568 patch_prober.go:28] interesting pod/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 15 09:24:20.227110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:20.226956    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 15 09:24:20.435351 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:20.435320    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"
Sep 15 09:24:20.435824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:20.435354    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj" event={"ID":"17ad5784-6bcf-4f36-a9f0-478c8d76741a","Type":"ContainerDied","Data":"4332d9b2656ca57e1632a2a9bd47f5a1253b407821dc9ee375141516f611cf57"}
Sep 15 09:24:20.435824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:20.435429    2568 scope.go:117] "RemoveContainer" containerID="f2acc6016effb1f7bc990eb659ec1daacfe05ab253b4de7b6c26b5de4daf129c"
Sep 15 09:24:20.469141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:20.469111    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"]
Sep 15 09:24:20.472475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:20.472449    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-c28cf7-openshift-default-5f67575fd8-rbfwj"]
Sep 15 09:24:20.786330 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:20.786300    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" path="/var/lib/kubelet/pods/17ad5784-6bcf-4f36-a9f0-478c8d76741a/volumes"
Sep 15 09:24:21.227285 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:21.227247    2568 patch_prober.go:28] interesting pod/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body=
Sep 15 09:24:21.227444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:21.227304    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused"
Sep 15 09:24:22.231208 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:22.231180    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:24:22.231673 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:22.231479    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:24:22.232279 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:22.232260    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:24:28.770977 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:28.770945    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"]
Sep 15 09:24:28.771446 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:28.771176    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp" podUID="7f349f8e-00e4-4dba-8bb2-3fdcccc48797" containerName="payload-processing" containerID="cri-o://d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac" gracePeriod=30
Sep 15 09:24:28.953172 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:28.953127    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"]
Sep 15 09:24:28.958309 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:28.958280    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-7ce8ca0e-gpz2x"]
Sep 15 09:24:29.022805 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.022671    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:24:29.158166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.158129    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w28l6\" (UniqueName: \"kubernetes.io/projected/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-kube-api-access-w28l6\") pod \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\" (UID: \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\") "
Sep 15 09:24:29.158166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.158175    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-plugins-config-volume\") pod \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\" (UID: \"7f349f8e-00e4-4dba-8bb2-3fdcccc48797\") "
Sep 15 09:24:29.158606 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.158574    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "7f349f8e-00e4-4dba-8bb2-3fdcccc48797" (UID: "7f349f8e-00e4-4dba-8bb2-3fdcccc48797"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:24:29.160431 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.160407    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-kube-api-access-w28l6" (OuterVolumeSpecName: "kube-api-access-w28l6") pod "7f349f8e-00e4-4dba-8bb2-3fdcccc48797" (UID: "7f349f8e-00e4-4dba-8bb2-3fdcccc48797"). InnerVolumeSpecName "kube-api-access-w28l6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:29.259467 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.259420    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w28l6\" (UniqueName: \"kubernetes.io/projected/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-kube-api-access-w28l6\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:29.259467 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.259457    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/7f349f8e-00e4-4dba-8bb2-3fdcccc48797-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:29.485027 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.484988    2568 generic.go:356] "Generic (PLEG): container finished" podID="7f349f8e-00e4-4dba-8bb2-3fdcccc48797" containerID="d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac" exitCode=0
Sep 15 09:24:29.485212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.485051    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"
Sep 15 09:24:29.485212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.485075    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp" event={"ID":"7f349f8e-00e4-4dba-8bb2-3fdcccc48797","Type":"ContainerDied","Data":"d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac"}
Sep 15 09:24:29.485212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.485160    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp" event={"ID":"7f349f8e-00e4-4dba-8bb2-3fdcccc48797","Type":"ContainerDied","Data":"7198f56081a754dbb9dc2e92060d5e478011ea9eb2735a247873536a3579c887"}
Sep 15 09:24:29.485212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.485183    2568 scope.go:117] "RemoveContainer" containerID="d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac"
Sep 15 09:24:29.494395 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.494378    2568 scope.go:117] "RemoveContainer" containerID="d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac"
Sep 15 09:24:29.494680 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:24:29.494657    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac\": container with ID starting with d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac not found: ID does not exist" containerID="d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac"
Sep 15 09:24:29.494758 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.494692    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac"} err="failed to get container status \"d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac\": rpc error: code = NotFound desc = could not find container \"d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac\": container with ID starting with d95f2effffc779c7d34d94bb4fadb30354bc1e708126fc9f88dace8637dbccac not found: ID does not exist"
Sep 15 09:24:29.506368 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.506345    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"]
Sep 15 09:24:29.510974 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:29.510956    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7ce8ca0e-6cfc88b597-6r8qp"]
Sep 15 09:24:30.786240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:30.786208    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="443b7cf8-1468-4d6b-96c2-40435d42e98c" path="/var/lib/kubelet/pods/443b7cf8-1468-4d6b-96c2-40435d42e98c/volumes"
Sep 15 09:24:30.786612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:30.786551    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7f349f8e-00e4-4dba-8bb2-3fdcccc48797" path="/var/lib/kubelet/pods/7f349f8e-00e4-4dba-8bb2-3fdcccc48797/volumes"
Sep 15 09:24:35.342445 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:35.342402    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"]
Sep 15 09:24:35.342889 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:35.342658    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy" containerID="cri-o://ed5733469a14cf47858635c32de820cad42899d389f2f1becccd5d7999ff94bb" gracePeriod=30
Sep 15 09:24:37.233732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:37.233691    2568 patch_prober.go:28] interesting pod/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:24:37.234154 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:37.233769    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:24:40.546048 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.546011    2568 generic.go:356] "Generic (PLEG): container finished" podID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerID="ed5733469a14cf47858635c32de820cad42899d389f2f1becccd5d7999ff94bb" exitCode=0
Sep 15 09:24:40.546406 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.546082    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" event={"ID":"c7a5a784-6055-4f1e-ad5a-11cb6c3376da","Type":"ContainerDied","Data":"ed5733469a14cf47858635c32de820cad42899d389f2f1becccd5d7999ff94bb"}
Sep 15 09:24:40.546406 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.546143    2568 scope.go:117] "RemoveContainer" containerID="4c90053a1abea1b53b63142023a316ed6b8dd94ad95f928b4795919979e93510"
Sep 15 09:24:40.603465 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.603439    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:24:40.776749 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.776715    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-socket\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.776749 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.776754    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-credential-socket\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.777018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.776796    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-data\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.777018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.776813    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-token\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.777018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.776838    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-certs\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.777018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.776920    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-podinfo\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.777018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.776976    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tnq8r\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-kube-api-access-tnq8r\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.777018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777002    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istiod-ca-cert\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.777326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777034    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-envoy\") pod \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\" (UID: \"c7a5a784-6055-4f1e-ad5a-11cb6c3376da\") "
Sep 15 09:24:40.777326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777046    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-data" (OuterVolumeSpecName: "istio-data") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:40.777326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777053    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:40.777326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777165    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:40.777326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777261    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:40.777536 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777378    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:24:40.777536 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777399    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:40.777536 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777421    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:40.777536 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777436    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:40.777536 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.777449    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:40.779250 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.779219    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-token" (OuterVolumeSpecName: "istio-token") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:40.779385 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.779324    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:24:40.779753 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.779729    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-kube-api-access-tnq8r" (OuterVolumeSpecName: "kube-api-access-tnq8r") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "kube-api-access-tnq8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:24:40.779860 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.779728    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c7a5a784-6055-4f1e-ad5a-11cb6c3376da" (UID: "c7a5a784-6055-4f1e-ad5a-11cb6c3376da"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:24:40.878609 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.878582    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:40.878609 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.878604    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:40.878781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.878616    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tnq8r\" (UniqueName: \"kubernetes.io/projected/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-kube-api-access-tnq8r\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:40.878781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.878632    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:40.878781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:40.878641    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c7a5a784-6055-4f1e-ad5a-11cb6c3376da-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:24:41.558356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:41.558313    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck" event={"ID":"c7a5a784-6055-4f1e-ad5a-11cb6c3376da","Type":"ContainerDied","Data":"6c775e10bfe437f497ee6116c3698229577576c857403572a9f81b9884bb7cda"}
Sep 15 09:24:41.558782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:41.558333    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"
Sep 15 09:24:41.558782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:41.558430    2568 scope.go:117] "RemoveContainer" containerID="ed5733469a14cf47858635c32de820cad42899d389f2f1becccd5d7999ff94bb"
Sep 15 09:24:41.576305 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:41.576280    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"]
Sep 15 09:24:41.579866 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:41.579825    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-7ce8ca0e-openshift-default-7479867c6-l8qck"]
Sep 15 09:24:42.785710 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:42.785675    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" path="/var/lib/kubelet/pods/c7a5a784-6055-4f1e-ad5a-11cb6c3376da/volumes"
Sep 15 09:24:48.936328 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936290    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"]
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936680    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936696    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936708    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7f349f8e-00e4-4dba-8bb2-3fdcccc48797" containerName="payload-processing"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936717    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7f349f8e-00e4-4dba-8bb2-3fdcccc48797" containerName="payload-processing"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936727    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936732    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936738    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936744    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936752    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="443b7cf8-1468-4d6b-96c2-40435d42e98c" containerName="revoke-keys"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936757    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="443b7cf8-1468-4d6b-96c2-40435d42e98c" containerName="revoke-keys"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936777    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936782    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936863    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7f349f8e-00e4-4dba-8bb2-3fdcccc48797" containerName="payload-processing"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936877    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936885    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="443b7cf8-1468-4d6b-96c2-40435d42e98c" containerName="revoke-keys"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936895    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="17ad5784-6bcf-4f36-a9f0-478c8d76741a" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936901    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy"
Sep 15 09:24:48.936918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.936910    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c7a5a784-6055-4f1e-ad5a-11cb6c3376da" containerName="istio-proxy"
Sep 15 09:24:48.941507 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.941485    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.946212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.946194    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w2-577f23-openshift-default-dockercfg-x8cbr\""
Sep 15 09:24:48.952818 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.952777    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"]
Sep 15 09:24:48.955403 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955377    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-socket\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.955524 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955447    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-token\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.955524 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955515    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istiod-ca-cert\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.955642 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955589    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-credential-socket\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.955642 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955622    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-certs\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.955808 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-podinfo\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.955808 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955694    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-data\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.955808 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955726    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mxbn\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-kube-api-access-8mxbn\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:48.955808 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:48.955756    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-envoy\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058006 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.057944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-credential-socket\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058204    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-credential-socket\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058301    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-certs\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058353    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-podinfo\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058462 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058408    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-data\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058462 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058439    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mxbn\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-kube-api-access-8mxbn\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058467    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-envoy\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058514    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-socket\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058550    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-token\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.058727 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.058588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istiod-ca-cert\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.059355 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.059327    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istiod-ca-cert\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.059588 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.059553    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-data\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.059819 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.059793    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-socket\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.060409 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.060389    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-certs\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.063138 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.063087    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-podinfo\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.070966 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.068452    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-envoy\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.070966 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.070753    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-token\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.073730 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.073705    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mxbn\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-kube-api-access-8mxbn\") pod \"e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") " pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.253122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.253024    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:49.527938 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.527915    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"]
Sep 15 09:24:49.530174 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:24:49.530141    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9df51671_7a22_4411_9fdf_7e5d21b33bd9.slice/crio-11a9ce4d4a674dfaf4f9d67967bf689192ef2cd84e8aad41dec8c2e5ff9d56e7 WatchSource:0}: Error finding container 11a9ce4d4a674dfaf4f9d67967bf689192ef2cd84e8aad41dec8c2e5ff9d56e7: Status 404 returned error can't find the container with id 11a9ce4d4a674dfaf4f9d67967bf689192ef2cd84e8aad41dec8c2e5ff9d56e7
Sep 15 09:24:49.532789 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.532757    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:49.532888 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.532822    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:49.532888 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.532870    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:24:49.603606 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:49.603581    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" event={"ID":"9df51671-7a22-4411-9fdf-7e5d21b33bd9","Type":"ContainerStarted","Data":"11a9ce4d4a674dfaf4f9d67967bf689192ef2cd84e8aad41dec8c2e5ff9d56e7"}
Sep 15 09:24:50.609976 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:50.609947    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" event={"ID":"9df51671-7a22-4411-9fdf-7e5d21b33bd9","Type":"ContainerStarted","Data":"e808267aeef9a47aec4e9d8f1770a8a8b3eca3ec832880109303638984598245"}
Sep 15 09:24:50.631503 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:50.631457    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" podStartSLOduration=2.631440038 podStartE2EDuration="2.631440038s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:50.629600142 +0000 UTC m=+1066.393171590" watchObservedRunningTime="2026-09-15 09:24:50.631440038 +0000 UTC m=+1066.395011486"
Sep 15 09:24:51.253955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:51.253920    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:51.258824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:51.258797    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:51.615828 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:51.615738    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:51.616678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:51.616658    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:24:55.096026 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.095987    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"]
Sep 15 09:24:55.100325 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.100291    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.103228 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.103046    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ffb593\"/\"default-dockercfg-bjtj2\""
Sep 15 09:24:55.105514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.104429    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"e2e-models-e2e-worker-w0-ffb593\"/\"distinct-w0-ffb593-kserve-self-signed-certs\""
Sep 15 09:24:55.105514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.104636    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ffb593\"/\"kube-root-ca.crt\""
Sep 15 09:24:55.105514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.104865    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"e2e-models-e2e-worker-w0-ffb593\"/\"openshift-service-ca.crt\""
Sep 15 09:24:55.114792 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.114766    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"]
Sep 15 09:24:55.223109 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.223067    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-dshm\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.223296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.223145    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w72j\" (UniqueName: \"kubernetes.io/projected/75d868d0-37d6-4b52-9c29-59338845c9fb-kube-api-access-4w72j\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.223296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.223170    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-tmp-dir\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.223296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.223209    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d868d0-37d6-4b52-9c29-59338845c9fb-tls-certs\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.223463 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.223298    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-model-cache\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.223463 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.223342    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-home\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.324333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324300    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-dshm\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.324539 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324355    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w72j\" (UniqueName: \"kubernetes.io/projected/75d868d0-37d6-4b52-9c29-59338845c9fb-kube-api-access-4w72j\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.324539 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324380    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-tmp-dir\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.324539 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d868d0-37d6-4b52-9c29-59338845c9fb-tls-certs\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.324539 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324446    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-model-cache\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.324539 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324466    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-home\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.324920 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-model-cache\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.325069 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324925    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-home\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.325069 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.324944    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-tmp-dir\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.326939 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.326912    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-dshm\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.327035 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.327003    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d868d0-37d6-4b52-9c29-59338845c9fb-tls-certs\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.332535 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.332518    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w72j\" (UniqueName: \"kubernetes.io/projected/75d868d0-37d6-4b52-9c29-59338845c9fb-kube-api-access-4w72j\") pod \"distinct-w0-ffb593-kserve-77bc76c6b-x5f22\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") " pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.415754 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.415389    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:24:55.710660 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:55.710541    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"]
Sep 15 09:24:55.713572 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:24:55.713543    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod75d868d0_37d6_4b52_9c29_59338845c9fb.slice/crio-d33b4b8690d055666b5c83fa07cc2d237bff982e153443d26a94f929c8324634 WatchSource:0}: Error finding container d33b4b8690d055666b5c83fa07cc2d237bff982e153443d26a94f929c8324634: Status 404 returned error can't find the container with id d33b4b8690d055666b5c83fa07cc2d237bff982e153443d26a94f929c8324634
Sep 15 09:24:56.483765 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.483725    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"]
Sep 15 09:24:56.487225 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.487209    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:56.490023 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.490002    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-577f23\""
Sep 15 09:24:56.490162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.490060    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-577f23-dockercfg-vvcmz\""
Sep 15 09:24:56.497374 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.497351    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"]
Sep 15 09:24:56.534792 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.534760    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk\" (UID: \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:56.534792 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.534791    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfdz5\" (UniqueName: \"kubernetes.io/projected/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-kube-api-access-jfdz5\") pod \"payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk\" (UID: \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:56.636087 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.636050    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk\" (UID: \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:56.636087 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.636092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfdz5\" (UniqueName: \"kubernetes.io/projected/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-kube-api-access-jfdz5\") pod \"payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk\" (UID: \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:56.636785 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.636765    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk\" (UID: \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:56.644541 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.644515    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfdz5\" (UniqueName: \"kubernetes.io/projected/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-kube-api-access-jfdz5\") pod \"payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk\" (UID: \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:56.646193 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.646165    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22" event={"ID":"75d868d0-37d6-4b52-9c29-59338845c9fb","Type":"ContainerStarted","Data":"78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b"}
Sep 15 09:24:56.646291 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.646211    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22" event={"ID":"75d868d0-37d6-4b52-9c29-59338845c9fb","Type":"ContainerStarted","Data":"d33b4b8690d055666b5c83fa07cc2d237bff982e153443d26a94f929c8324634"}
Sep 15 09:24:56.662884 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.662817    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22" podStartSLOduration=1.6628022900000001 podStartE2EDuration="1.66280229s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:56.661822675 +0000 UTC m=+1072.425394125" watchObservedRunningTime="2026-09-15 09:24:56.66280229 +0000 UTC m=+1072.426373739"
Sep 15 09:24:56.798443 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:56.798361    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:57.070132 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:57.070103    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"]
Sep 15 09:24:57.071817 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:24:57.071774    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b3f8b3_cc2c_404d_b8d1_6056b6294bdd.slice/crio-00333f50f97ff3ec14f870ecef701dca7596d1ab4ee47cd6a5277bb4eba5491e WatchSource:0}: Error finding container 00333f50f97ff3ec14f870ecef701dca7596d1ab4ee47cd6a5277bb4eba5491e: Status 404 returned error can't find the container with id 00333f50f97ff3ec14f870ecef701dca7596d1ab4ee47cd6a5277bb4eba5491e
Sep 15 09:24:57.653644 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:57.653613    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk" event={"ID":"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd","Type":"ContainerStarted","Data":"65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994"}
Sep 15 09:24:57.654063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:57.653672    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk" event={"ID":"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd","Type":"ContainerStarted","Data":"00333f50f97ff3ec14f870ecef701dca7596d1ab4ee47cd6a5277bb4eba5491e"}
Sep 15 09:24:57.654063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:57.653831    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:24:57.672528 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:24:57.672469    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk" podStartSLOduration=1.672443553 podStartE2EDuration="1.672443553s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:24:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:24:57.670168456 +0000 UTC m=+1073.433739915" watchObservedRunningTime="2026-09-15 09:24:57.672443553 +0000 UTC m=+1073.436015016"
Sep 15 09:25:05.415701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:05.415663    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:25:05.416131 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:05.415724    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:25:05.428110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:05.428088    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:25:05.706097 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:05.706016    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:25:08.660624 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:08.660589    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:25:08.980158 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:08.980085    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"]
Sep 15 09:25:08.984898 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:08.984882    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"
Sep 15 09:25:08.987732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:08.987710    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:25:08.987912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:08.987753    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:25:08.991496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:08.991472    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"]
Sep 15 09:25:09.057908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:09.057868    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ecc7de-3345-4f01-b6b3-f5a5161403e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm\" (UID: \"73ecc7de-3345-4f01-b6b3-f5a5161403e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"
Sep 15 09:25:09.159281 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:09.159244    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ecc7de-3345-4f01-b6b3-f5a5161403e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm\" (UID: \"73ecc7de-3345-4f01-b6b3-f5a5161403e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"
Sep 15 09:25:09.159903 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:09.159835    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ecc7de-3345-4f01-b6b3-f5a5161403e8-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm\" (UID: \"73ecc7de-3345-4f01-b6b3-f5a5161403e8\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"
Sep 15 09:25:09.298726 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:09.298639    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"
Sep 15 09:25:09.576486 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:09.576456    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"]
Sep 15 09:25:09.578249 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:25:09.578218    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73ecc7de_3345_4f01_b6b3_f5a5161403e8.slice/crio-e33d8ce02b1977dd04155d62a48a4c9e3d6dd5269223bb37d37a46d9450a764a WatchSource:0}: Error finding container e33d8ce02b1977dd04155d62a48a4c9e3d6dd5269223bb37d37a46d9450a764a: Status 404 returned error can't find the container with id e33d8ce02b1977dd04155d62a48a4c9e3d6dd5269223bb37d37a46d9450a764a
Sep 15 09:25:09.715636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:09.715600    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm" event={"ID":"73ecc7de-3345-4f01-b6b3-f5a5161403e8","Type":"ContainerStarted","Data":"e33d8ce02b1977dd04155d62a48a4c9e3d6dd5269223bb37d37a46d9450a764a"}
Sep 15 09:25:10.723584 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:10.723547    2568 generic.go:356] "Generic (PLEG): container finished" podID="73ecc7de-3345-4f01-b6b3-f5a5161403e8" containerID="6929db07d573728044c63a094033384db515b4ccbd2fa9162d703b4e57564466" exitCode=0
Sep 15 09:25:10.723983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:10.723624    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm" event={"ID":"73ecc7de-3345-4f01-b6b3-f5a5161403e8","Type":"ContainerDied","Data":"6929db07d573728044c63a094033384db515b4ccbd2fa9162d703b4e57564466"}
Sep 15 09:25:11.866333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:11.866309    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"
Sep 15 09:25:11.986229 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:11.986142    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ecc7de-3345-4f01-b6b3-f5a5161403e8-maas-api-service-ca\") pod \"73ecc7de-3345-4f01-b6b3-f5a5161403e8\" (UID: \"73ecc7de-3345-4f01-b6b3-f5a5161403e8\") "
Sep 15 09:25:11.986539 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:11.986517    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/73ecc7de-3345-4f01-b6b3-f5a5161403e8-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "73ecc7de-3345-4f01-b6b3-f5a5161403e8" (UID: "73ecc7de-3345-4f01-b6b3-f5a5161403e8"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:12.086870 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:12.086825    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/73ecc7de-3345-4f01-b6b3-f5a5161403e8-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:12.735590 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:12.735549    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm" event={"ID":"73ecc7de-3345-4f01-b6b3-f5a5161403e8","Type":"ContainerDied","Data":"e33d8ce02b1977dd04155d62a48a4c9e3d6dd5269223bb37d37a46d9450a764a"}
Sep 15 09:25:12.735590 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:12.735574    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"
Sep 15 09:25:12.735826 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:12.735615    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e33d8ce02b1977dd04155d62a48a4c9e3d6dd5269223bb37d37a46d9450a764a"
Sep 15 09:25:20.058049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.058018    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"]
Sep 15 09:25:20.058592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.058217    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs" podUID="4f50f649-b813-475d-91fb-c78f156823ce" containerName="payload-processing" containerID="cri-o://ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee" gracePeriod=30
Sep 15 09:25:20.066027 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.065171    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"]
Sep 15 09:25:20.066027 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.065433    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh" podUID="6f1882c1-8069-4c9d-9832-a9774d5cf886" containerName="payload-pre-processing" containerID="cri-o://92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24" gracePeriod=30
Sep 15 09:25:20.263234 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.263197    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"]
Sep 15 09:25:20.270562 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.270099    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-a23d9f-l56pm"]
Sep 15 09:25:20.454939 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.454913    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:25:20.458124 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.458101    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:25:20.574084 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.573994    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f50f649-b813-475d-91fb-c78f156823ce-plugins-config-volume\") pod \"4f50f649-b813-475d-91fb-c78f156823ce\" (UID: \"4f50f649-b813-475d-91fb-c78f156823ce\") "
Sep 15 09:25:20.574258 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.574107    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5fdj\" (UniqueName: \"kubernetes.io/projected/6f1882c1-8069-4c9d-9832-a9774d5cf886-kube-api-access-c5fdj\") pod \"6f1882c1-8069-4c9d-9832-a9774d5cf886\" (UID: \"6f1882c1-8069-4c9d-9832-a9774d5cf886\") "
Sep 15 09:25:20.574258 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.574124    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f1882c1-8069-4c9d-9832-a9774d5cf886-plugins-config-volume\") pod \"6f1882c1-8069-4c9d-9832-a9774d5cf886\" (UID: \"6f1882c1-8069-4c9d-9832-a9774d5cf886\") "
Sep 15 09:25:20.574258 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.574156    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lwfnp\" (UniqueName: \"kubernetes.io/projected/4f50f649-b813-475d-91fb-c78f156823ce-kube-api-access-lwfnp\") pod \"4f50f649-b813-475d-91fb-c78f156823ce\" (UID: \"4f50f649-b813-475d-91fb-c78f156823ce\") "
Sep 15 09:25:20.574472 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.574351    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f50f649-b813-475d-91fb-c78f156823ce-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4f50f649-b813-475d-91fb-c78f156823ce" (UID: "4f50f649-b813-475d-91fb-c78f156823ce"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:20.574472 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.574461    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6f1882c1-8069-4c9d-9832-a9774d5cf886-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6f1882c1-8069-4c9d-9832-a9774d5cf886" (UID: "6f1882c1-8069-4c9d-9832-a9774d5cf886"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:20.576333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.576311    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f50f649-b813-475d-91fb-c78f156823ce-kube-api-access-lwfnp" (OuterVolumeSpecName: "kube-api-access-lwfnp") pod "4f50f649-b813-475d-91fb-c78f156823ce" (UID: "4f50f649-b813-475d-91fb-c78f156823ce"). InnerVolumeSpecName "kube-api-access-lwfnp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:20.576416 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.576343    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f1882c1-8069-4c9d-9832-a9774d5cf886-kube-api-access-c5fdj" (OuterVolumeSpecName: "kube-api-access-c5fdj") pod "6f1882c1-8069-4c9d-9832-a9774d5cf886" (UID: "6f1882c1-8069-4c9d-9832-a9774d5cf886"). InnerVolumeSpecName "kube-api-access-c5fdj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:20.675912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.675880    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5fdj\" (UniqueName: \"kubernetes.io/projected/6f1882c1-8069-4c9d-9832-a9774d5cf886-kube-api-access-c5fdj\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:20.675912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.675905    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6f1882c1-8069-4c9d-9832-a9774d5cf886-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:20.675912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.675914    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lwfnp\" (UniqueName: \"kubernetes.io/projected/4f50f649-b813-475d-91fb-c78f156823ce-kube-api-access-lwfnp\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:20.675912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.675922    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4f50f649-b813-475d-91fb-c78f156823ce-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:20.780324 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.780286    2568 generic.go:356] "Generic (PLEG): container finished" podID="4f50f649-b813-475d-91fb-c78f156823ce" containerID="ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee" exitCode=0
Sep 15 09:25:20.780504 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.780394    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"
Sep 15 09:25:20.781872 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.781821    2568 generic.go:356] "Generic (PLEG): container finished" podID="6f1882c1-8069-4c9d-9832-a9774d5cf886" containerID="92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24" exitCode=0
Sep 15 09:25:20.781991 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.781900    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"
Sep 15 09:25:20.786263 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.786240    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="73ecc7de-3345-4f01-b6b3-f5a5161403e8" path="/var/lib/kubelet/pods/73ecc7de-3345-4f01-b6b3-f5a5161403e8/volumes"
Sep 15 09:25:20.786672 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.786654    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs" event={"ID":"4f50f649-b813-475d-91fb-c78f156823ce","Type":"ContainerDied","Data":"ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee"}
Sep 15 09:25:20.786732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.786703    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs" event={"ID":"4f50f649-b813-475d-91fb-c78f156823ce","Type":"ContainerDied","Data":"6b85d464aac5a19484bf6683818b0494b811b287e99965471b93333bc65ded8a"}
Sep 15 09:25:20.786776 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.786730    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh" event={"ID":"6f1882c1-8069-4c9d-9832-a9774d5cf886","Type":"ContainerDied","Data":"92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24"}
Sep 15 09:25:20.786776 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.786756    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh" event={"ID":"6f1882c1-8069-4c9d-9832-a9774d5cf886","Type":"ContainerDied","Data":"74eb6244b64acd760388d74d2d6f4c1fd15e2e99ed9ae1503ae40a2de18d9177"}
Sep 15 09:25:20.786862 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.786785    2568 scope.go:117] "RemoveContainer" containerID="ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee"
Sep 15 09:25:20.824217 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.824154    2568 scope.go:117] "RemoveContainer" containerID="ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee"
Sep 15 09:25:20.824924 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:25:20.824884    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee\": container with ID starting with ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee not found: ID does not exist" containerID="ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee"
Sep 15 09:25:20.825037 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.824936    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee"} err="failed to get container status \"ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee\": rpc error: code = NotFound desc = could not find container \"ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee\": container with ID starting with ee8c25360021053f0c3c9510225a2f65862d8b1ad4ca86c7ca41a30e45fcafee not found: ID does not exist"
Sep 15 09:25:20.825037 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.824967    2568 scope.go:117] "RemoveContainer" containerID="92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24"
Sep 15 09:25:20.834339 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.834316    2568 scope.go:117] "RemoveContainer" containerID="92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24"
Sep 15 09:25:20.834610 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:25:20.834591    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24\": container with ID starting with 92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24 not found: ID does not exist" containerID="92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24"
Sep 15 09:25:20.834653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.834619    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24"} err="failed to get container status \"92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24\": rpc error: code = NotFound desc = could not find container \"92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24\": container with ID starting with 92728e33589a4a25185e4f392c5e3daa70574682d45ca02c08fca51fb029ca24 not found: ID does not exist"
Sep 15 09:25:20.840575 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.840555    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"]
Sep 15 09:25:20.847955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.847934    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-a-a23d9f-5fc5545c47-xxrcs"]
Sep 15 09:25:20.862047 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.862020    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"]
Sep 15 09:25:20.866431 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:20.866408    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-a-a23d9f-9555c5d66-8jxmh"]
Sep 15 09:25:22.657078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:22.657041    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 15 09:25:22.657500 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:22.657102    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 15 09:25:22.789794 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:22.788815    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f50f649-b813-475d-91fb-c78f156823ce" path="/var/lib/kubelet/pods/4f50f649-b813-475d-91fb-c78f156823ce/volumes"
Sep 15 09:25:22.789794 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:22.789413    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f1882c1-8069-4c9d-9832-a9774d5cf886" path="/var/lib/kubelet/pods/6f1882c1-8069-4c9d-9832-a9774d5cf886/volumes"
Sep 15 09:25:24.810111 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:24.810079    2568 generic.go:356] "Generic (PLEG): container finished" podID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerID="e808267aeef9a47aec4e9d8f1770a8a8b3eca3ec832880109303638984598245" exitCode=0
Sep 15 09:25:24.810550 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:24.810147    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" event={"ID":"9df51671-7a22-4411-9fdf-7e5d21b33bd9","Type":"ContainerDied","Data":"e808267aeef9a47aec4e9d8f1770a8a8b3eca3ec832880109303638984598245"}
Sep 15 09:25:24.810550 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:24.810518    2568 scope.go:117] "RemoveContainer" containerID="e808267aeef9a47aec4e9d8f1770a8a8b3eca3ec832880109303638984598245"
Sep 15 09:25:24.811611 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:24.811585    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:25:24.811664 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:24.811652    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:25:24.811700 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:24.811688    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:25:25.821372 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.821333    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" event={"ID":"9df51671-7a22-4411-9fdf-7e5d21b33bd9","Type":"ContainerStarted","Data":"0628415b84877b2c8c6d5f3143428e0e5e8fa4ac4a372d95278c5caf5561def2"}
Sep 15 09:25:25.911113 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911070    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"]
Sep 15 09:25:25.911621 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911597    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f50f649-b813-475d-91fb-c78f156823ce" containerName="payload-processing"
Sep 15 09:25:25.911724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911623    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f50f649-b813-475d-91fb-c78f156823ce" containerName="payload-processing"
Sep 15 09:25:25.911724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911637    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="73ecc7de-3345-4f01-b6b3-f5a5161403e8" containerName="revoke-keys"
Sep 15 09:25:25.911724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911646    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="73ecc7de-3345-4f01-b6b3-f5a5161403e8" containerName="revoke-keys"
Sep 15 09:25:25.911724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911666    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f1882c1-8069-4c9d-9832-a9774d5cf886" containerName="payload-pre-processing"
Sep 15 09:25:25.911724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911676    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f1882c1-8069-4c9d-9832-a9774d5cf886" containerName="payload-pre-processing"
Sep 15 09:25:25.912014 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911784    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f50f649-b813-475d-91fb-c78f156823ce" containerName="payload-processing"
Sep 15 09:25:25.912014 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911795    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f1882c1-8069-4c9d-9832-a9774d5cf886" containerName="payload-pre-processing"
Sep 15 09:25:25.912014 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.911806    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="73ecc7de-3345-4f01-b6b3-f5a5161403e8" containerName="revoke-keys"
Sep 15 09:25:25.915692 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.915667    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:25.919120 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.918966    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-f032a1-dockercfg-45r7t\""
Sep 15 09:25:25.919120 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.919100    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-f032a1\""
Sep 15 09:25:25.926794 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.926762    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa705466-771a-4a6b-a5c6-4f87a555f749-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv\" (UID: \"fa705466-771a-4a6b-a5c6-4f87a555f749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:25.926947 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.926855    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjhhl\" (UniqueName: \"kubernetes.io/projected/fa705466-771a-4a6b-a5c6-4f87a555f749-kube-api-access-bjhhl\") pod \"payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv\" (UID: \"fa705466-771a-4a6b-a5c6-4f87a555f749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:25.929506 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.929481    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"]
Sep 15 09:25:25.935042 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.935016    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"]
Sep 15 09:25:25.938606 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.938561    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:25.940610 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:25.940586    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"]
Sep 15 09:25:26.028317 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.028278    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa705466-771a-4a6b-a5c6-4f87a555f749-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv\" (UID: \"fa705466-771a-4a6b-a5c6-4f87a555f749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:26.028527 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.028349    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjhhl\" (UniqueName: \"kubernetes.io/projected/fa705466-771a-4a6b-a5c6-4f87a555f749-kube-api-access-bjhhl\") pod \"payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv\" (UID: \"fa705466-771a-4a6b-a5c6-4f87a555f749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:26.028527 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.028427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpxh8\" (UniqueName: \"kubernetes.io/projected/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-kube-api-access-zpxh8\") pod \"payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb\" (UID: \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:26.028527 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.028513    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb\" (UID: \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:26.029558 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.029496    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa705466-771a-4a6b-a5c6-4f87a555f749-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv\" (UID: \"fa705466-771a-4a6b-a5c6-4f87a555f749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:26.039100 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.039074    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjhhl\" (UniqueName: \"kubernetes.io/projected/fa705466-771a-4a6b-a5c6-4f87a555f749-kube-api-access-bjhhl\") pod \"payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv\" (UID: \"fa705466-771a-4a6b-a5c6-4f87a555f749\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:26.129907 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.129780    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb\" (UID: \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:26.130060 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.129973    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpxh8\" (UniqueName: \"kubernetes.io/projected/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-kube-api-access-zpxh8\") pod \"payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb\" (UID: \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:26.130745 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.130714    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb\" (UID: \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:26.138385 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.138358    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpxh8\" (UniqueName: \"kubernetes.io/projected/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-kube-api-access-zpxh8\") pod \"payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb\" (UID: \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:26.229407 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.229368    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:26.249528 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.249507    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:26.253926 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.253891    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:25:26.254139 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.254115    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 09:25:26.254250 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.254165    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 09:25:26.513869 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.510399    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"]
Sep 15 09:25:26.515413 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:25:26.515369    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa705466_771a_4a6b_a5c6_4f87a555f749.slice/crio-e71d882193c073a64250ebe04d3524f308afca81e61019cfee83574e85cf530d WatchSource:0}: Error finding container e71d882193c073a64250ebe04d3524f308afca81e61019cfee83574e85cf530d: Status 404 returned error can't find the container with id e71d882193c073a64250ebe04d3524f308afca81e61019cfee83574e85cf530d
Sep 15 09:25:26.564485 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.564425    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"]
Sep 15 09:25:26.565725 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:25:26.565699    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4940bed_872b_4d4b_b0a2_044aa5ceba8d.slice/crio-c1053d94ba68c5591e7a4c08e9c656a704239b66a265161e27bb69604cc3230d WatchSource:0}: Error finding container c1053d94ba68c5591e7a4c08e9c656a704239b66a265161e27bb69604cc3230d: Status 404 returned error can't find the container with id c1053d94ba68c5591e7a4c08e9c656a704239b66a265161e27bb69604cc3230d
Sep 15 09:25:26.833097 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.833011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb" event={"ID":"e4940bed-872b-4d4b-b0a2-044aa5ceba8d","Type":"ContainerStarted","Data":"74211d9ba7456eb8cebf9c8b42e16568744bc72be3b88ecdb93ced3855417feb"}
Sep 15 09:25:26.833097 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.833064    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb" event={"ID":"e4940bed-872b-4d4b-b0a2-044aa5ceba8d","Type":"ContainerStarted","Data":"c1053d94ba68c5591e7a4c08e9c656a704239b66a265161e27bb69604cc3230d"}
Sep 15 09:25:26.834099 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.833179    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:26.834886 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.834861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv" event={"ID":"fa705466-771a-4a6b-a5c6-4f87a555f749","Type":"ContainerStarted","Data":"aba58d3f223a3a7c20c44e094362274c2dd44a61688294c34ccbded0ca50053a"}
Sep 15 09:25:26.834956 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.834907    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv" event={"ID":"fa705466-771a-4a6b-a5c6-4f87a555f749","Type":"ContainerStarted","Data":"e71d882193c073a64250ebe04d3524f308afca81e61019cfee83574e85cf530d"}
Sep 15 09:25:26.834956 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.834936    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:26.871419 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.871364    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv" podStartSLOduration=1.871349022 podStartE2EDuration="1.871349022s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:26.870046017 +0000 UTC m=+1102.633617475" watchObservedRunningTime="2026-09-15 09:25:26.871349022 +0000 UTC m=+1102.634920480"
Sep 15 09:25:26.871572 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:26.871483    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb" podStartSLOduration=1.871477198 podStartE2EDuration="1.871477198s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:26.850128122 +0000 UTC m=+1102.613699577" watchObservedRunningTime="2026-09-15 09:25:26.871477198 +0000 UTC m=+1102.635048644"
Sep 15 09:25:27.254275 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.254239    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 09:25:27.254482 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.254301    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 09:25:27.634966 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.634871    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"]
Sep 15 09:25:27.635391 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.635119    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy" containerID="cri-o://1c70cfbd6a905c8bcc5bdabb4785d72215da7a621eb71a57127e610068f6a7a8" gracePeriod=30
Sep 15 09:25:27.982388 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.982346    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"]
Sep 15 09:25:27.985978 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.985957    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"
Sep 15 09:25:27.988647 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.988631    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:25:27.988801 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.988788    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:25:27.994547 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:27.994517    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"]
Sep 15 09:25:28.051942 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:28.051900    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3803f2d-bdeb-413c-8294-6822af0f053c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7\" (UID: \"d3803f2d-bdeb-413c-8294-6822af0f053c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"
Sep 15 09:25:28.153447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:28.153416    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3803f2d-bdeb-413c-8294-6822af0f053c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7\" (UID: \"d3803f2d-bdeb-413c-8294-6822af0f053c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"
Sep 15 09:25:28.154171 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:28.154148    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3803f2d-bdeb-413c-8294-6822af0f053c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7\" (UID: \"d3803f2d-bdeb-413c-8294-6822af0f053c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"
Sep 15 09:25:28.254332 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:28.254243    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 09:25:28.254332 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:28.254302    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 09:25:28.329258 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:28.329222    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"
Sep 15 09:25:28.614638 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:28.602086    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"]
Sep 15 09:25:28.614638 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:25:28.614367    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3803f2d_bdeb_413c_8294_6822af0f053c.slice/crio-ebe35ef8c1f095844facf7e97893816b1f9930b4d70d6229e16fe45bf48ea332 WatchSource:0}: Error finding container ebe35ef8c1f095844facf7e97893816b1f9930b4d70d6229e16fe45bf48ea332: Status 404 returned error can't find the container with id ebe35ef8c1f095844facf7e97893816b1f9930b4d70d6229e16fe45bf48ea332
Sep 15 09:25:28.846765 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:28.846733    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7" event={"ID":"d3803f2d-bdeb-413c-8294-6822af0f053c","Type":"ContainerStarted","Data":"ebe35ef8c1f095844facf7e97893816b1f9930b4d70d6229e16fe45bf48ea332"}
Sep 15 09:25:29.254240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:29.254156    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 09:25:29.254240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:29.254212    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 09:25:29.854412 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:29.854323    2568 generic.go:356] "Generic (PLEG): container finished" podID="d3803f2d-bdeb-413c-8294-6822af0f053c" containerID="6645fb1809d692b60f1e63e8cd16e9edbdc09dda5def78d790c148f60524cb3a" exitCode=0
Sep 15 09:25:29.854573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:29.854409    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7" event={"ID":"d3803f2d-bdeb-413c-8294-6822af0f053c","Type":"ContainerDied","Data":"6645fb1809d692b60f1e63e8cd16e9edbdc09dda5def78d790c148f60524cb3a"}
Sep 15 09:25:30.253836 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:30.253392    2568 patch_prober.go:28] interesting pod/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body=
Sep 15 09:25:30.253836 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:30.253455    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused"
Sep 15 09:25:31.016017 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.015986    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"
Sep 15 09:25:31.086175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.086142    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3803f2d-bdeb-413c-8294-6822af0f053c-maas-api-service-ca\") pod \"d3803f2d-bdeb-413c-8294-6822af0f053c\" (UID: \"d3803f2d-bdeb-413c-8294-6822af0f053c\") "
Sep 15 09:25:31.086497 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.086470    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d3803f2d-bdeb-413c-8294-6822af0f053c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d3803f2d-bdeb-413c-8294-6822af0f053c" (UID: "d3803f2d-bdeb-413c-8294-6822af0f053c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:31.187379 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.187346    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d3803f2d-bdeb-413c-8294-6822af0f053c-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:31.257184 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.257155    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:25:31.257531 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.257510    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:25:31.258256 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.258236    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:25:31.866387 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.866358    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"
Sep 15 09:25:31.866581 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.866393    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7" event={"ID":"d3803f2d-bdeb-413c-8294-6822af0f053c","Type":"ContainerDied","Data":"ebe35ef8c1f095844facf7e97893816b1f9930b4d70d6229e16fe45bf48ea332"}
Sep 15 09:25:31.866581 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:31.866438    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ebe35ef8c1f095844facf7e97893816b1f9930b4d70d6229e16fe45bf48ea332"
Sep 15 09:25:32.875589 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:32.875557    2568 generic.go:356] "Generic (PLEG): container finished" podID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerID="1c70cfbd6a905c8bcc5bdabb4785d72215da7a621eb71a57127e610068f6a7a8" exitCode=0
Sep 15 09:25:32.875962 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:32.875623    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" event={"ID":"813b4a28-d0ea-4b3e-81c4-bd9734658846","Type":"ContainerDied","Data":"1c70cfbd6a905c8bcc5bdabb4785d72215da7a621eb71a57127e610068f6a7a8"}
Sep 15 09:25:32.875962 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:32.875688    2568 scope.go:117] "RemoveContainer" containerID="22707c45bf038f89a7dd0241c85bcef048e5b0d15c7eab5c298cd3a987aa733f"
Sep 15 09:25:32.891114 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:25:32.891088    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22707c45bf038f89a7dd0241c85bcef048e5b0d15c7eab5c298cd3a987aa733f\": container with ID starting with 22707c45bf038f89a7dd0241c85bcef048e5b0d15c7eab5c298cd3a987aa733f not found: ID does not exist" containerID="22707c45bf038f89a7dd0241c85bcef048e5b0d15c7eab5c298cd3a987aa733f"
Sep 15 09:25:32.894514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:32.894494    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:25:33.002622 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002590    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-token\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.002813 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002641    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-credential-socket\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.002813 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002674    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-certs\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.002813 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002694    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hntpt\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-kube-api-access-hntpt\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.002813 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002744    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-podinfo\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.002813 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002777    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-socket\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.002813 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002802    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-data\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.003162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002836    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/813b4a28-d0ea-4b3e-81c4-bd9734658846-istiod-ca-cert\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.003162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.002906    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-envoy\") pod \"813b4a28-d0ea-4b3e-81c4-bd9734658846\" (UID: \"813b4a28-d0ea-4b3e-81c4-bd9734658846\") "
Sep 15 09:25:33.003162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.003010    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:33.003162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.003021    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:33.003162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.003141    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:33.003420 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.003250    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.003420 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.003271    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.003420 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.003288    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.003420 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.003383    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-data" (OuterVolumeSpecName: "istio-data") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:33.003578 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.003427    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/813b4a28-d0ea-4b3e-81c4-bd9734658846-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:33.005208 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.005182    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:25:33.005208 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.005203    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-token" (OuterVolumeSpecName: "istio-token") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:33.005397 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.005247    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:33.005639 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.005621    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-kube-api-access-hntpt" (OuterVolumeSpecName: "kube-api-access-hntpt") pod "813b4a28-d0ea-4b3e-81c4-bd9734658846" (UID: "813b4a28-d0ea-4b3e-81c4-bd9734658846"). InnerVolumeSpecName "kube-api-access-hntpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:33.103986 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.103952    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/813b4a28-d0ea-4b3e-81c4-bd9734658846-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.103986 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.103980    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.103986 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.103989    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.104205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.103997    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hntpt\" (UniqueName: \"kubernetes.io/projected/813b4a28-d0ea-4b3e-81c4-bd9734658846-kube-api-access-hntpt\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.104205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.104007    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.104205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.104015    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/813b4a28-d0ea-4b3e-81c4-bd9734658846-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:33.882185 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.882155    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"
Sep 15 09:25:33.882573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.882164    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h" event={"ID":"813b4a28-d0ea-4b3e-81c4-bd9734658846","Type":"ContainerDied","Data":"ef3fc66027c71d277b152290ee76177744ca8c74b1a55dd574cf3ac215ca0f41"}
Sep 15 09:25:33.882573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.882288    2568 scope.go:117] "RemoveContainer" containerID="1c70cfbd6a905c8bcc5bdabb4785d72215da7a621eb71a57127e610068f6a7a8"
Sep 15 09:25:33.904501 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.904468    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"]
Sep 15 09:25:33.908593 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:33.908572    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-a23d9f-openshift-default-5f48866c7b-qck9h"]
Sep 15 09:25:34.789866 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:34.787600    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" path="/var/lib/kubelet/pods/813b4a28-d0ea-4b3e-81c4-bd9734658846/volumes"
Sep 15 09:25:37.843395 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:37.843363    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:25:37.843734 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:37.843426    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:25:38.587200 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.587163    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"]
Sep 15 09:25:38.587443 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.587414    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828" podUID="3420b4bd-11d5-4aee-9b2b-a1614cae3865" containerName="payload-pre-processing" containerID="cri-o://99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3" gracePeriod=30
Sep 15 09:25:38.744186 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.744157    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"]
Sep 15 09:25:38.748260 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.748234    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-2430e2-vrhq7"]
Sep 15 09:25:38.787533 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.787496    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3803f2d-bdeb-413c-8294-6822af0f053c" path="/var/lib/kubelet/pods/d3803f2d-bdeb-413c-8294-6822af0f053c/volumes"
Sep 15 09:25:38.867708 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.867629    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:25:38.913356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.913271    2568 generic.go:356] "Generic (PLEG): container finished" podID="3420b4bd-11d5-4aee-9b2b-a1614cae3865" containerID="99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3" exitCode=0
Sep 15 09:25:38.913356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.913331    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"
Sep 15 09:25:38.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.913330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828" event={"ID":"3420b4bd-11d5-4aee-9b2b-a1614cae3865","Type":"ContainerDied","Data":"99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3"}
Sep 15 09:25:38.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.913458    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828" event={"ID":"3420b4bd-11d5-4aee-9b2b-a1614cae3865","Type":"ContainerDied","Data":"a249e0a1ebab41420d0144dd4f027af9f4558d200f87545ea30889e5fb1ad503"}
Sep 15 09:25:38.913554 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.913484    2568 scope.go:117] "RemoveContainer" containerID="99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3"
Sep 15 09:25:38.922506 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.922484    2568 scope.go:117] "RemoveContainer" containerID="99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3"
Sep 15 09:25:38.922780 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:25:38.922751    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3\": container with ID starting with 99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3 not found: ID does not exist" containerID="99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3"
Sep 15 09:25:38.922955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.922780    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3"} err="failed to get container status \"99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3\": rpc error: code = NotFound desc = could not find container \"99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3\": container with ID starting with 99c44863cb65d57df540e6192a5073da9b99e6a47acfb61f2b67aec7755b75a3 not found: ID does not exist"
Sep 15 09:25:38.961612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.961583    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jg66t\" (UniqueName: \"kubernetes.io/projected/3420b4bd-11d5-4aee-9b2b-a1614cae3865-kube-api-access-jg66t\") pod \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\" (UID: \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\") "
Sep 15 09:25:38.961772 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.961698    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3420b4bd-11d5-4aee-9b2b-a1614cae3865-plugins-config-volume\") pod \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\" (UID: \"3420b4bd-11d5-4aee-9b2b-a1614cae3865\") "
Sep 15 09:25:38.962070 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.962048    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3420b4bd-11d5-4aee-9b2b-a1614cae3865-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3420b4bd-11d5-4aee-9b2b-a1614cae3865" (UID: "3420b4bd-11d5-4aee-9b2b-a1614cae3865"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:38.963967 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:38.963948    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3420b4bd-11d5-4aee-9b2b-a1614cae3865-kube-api-access-jg66t" (OuterVolumeSpecName: "kube-api-access-jg66t") pod "3420b4bd-11d5-4aee-9b2b-a1614cae3865" (UID: "3420b4bd-11d5-4aee-9b2b-a1614cae3865"). InnerVolumeSpecName "kube-api-access-jg66t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:39.062766 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:39.062727    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3420b4bd-11d5-4aee-9b2b-a1614cae3865-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:39.062766 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:39.062759    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jg66t\" (UniqueName: \"kubernetes.io/projected/3420b4bd-11d5-4aee-9b2b-a1614cae3865-kube-api-access-jg66t\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:39.244455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:39.243439    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"]
Sep 15 09:25:39.251317 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:39.249464    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-2430e2-7bb579c8fd-dr828"]
Sep 15 09:25:40.786913 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:40.786882    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3420b4bd-11d5-4aee-9b2b-a1614cae3865" path="/var/lib/kubelet/pods/3420b4bd-11d5-4aee-9b2b-a1614cae3865/volumes"
Sep 15 09:25:49.951794 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:49.951762    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"]
Sep 15 09:25:49.952274 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:49.951971    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6" podUID="697a34f4-e9b5-4442-a740-19a6969bdca3" containerName="istio-proxy" containerID="cri-o://7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d" gracePeriod=30
Sep 15 09:25:55.198437 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.198413    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:25:55.318025 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.317939    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-credential-socket\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318025 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.317980    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-envoy\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318259 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318040    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-podinfo\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318259 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318087    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-socket\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318259 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318112    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-certs\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318259 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318134    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpqdh\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-kube-api-access-tpqdh\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318259 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318180    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697a34f4-e9b5-4442-a740-19a6969bdca3-istiod-ca-cert\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318259 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318189    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:55.318259 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318227    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-token\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318600 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318272    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-data\") pod \"697a34f4-e9b5-4442-a740-19a6969bdca3\" (UID: \"697a34f4-e9b5-4442-a740-19a6969bdca3\") "
Sep 15 09:25:55.318600 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318431    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:55.318600 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318477    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/697a34f4-e9b5-4442-a740-19a6969bdca3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:25:55.318746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318634    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/697a34f4-e9b5-4442-a740-19a6969bdca3-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.318746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318645    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-data" (OuterVolumeSpecName: "istio-data") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:55.318746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318656    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.318746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318673    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.318746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.318712    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:55.320713 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.320660    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-kube-api-access-tpqdh" (OuterVolumeSpecName: "kube-api-access-tpqdh") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "kube-api-access-tpqdh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:55.320865 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.320734    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:25:55.320930 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.320914    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:25:55.320968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.320920    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-token" (OuterVolumeSpecName: "istio-token") pod "697a34f4-e9b5-4442-a740-19a6969bdca3" (UID: "697a34f4-e9b5-4442-a740-19a6969bdca3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:25:55.419447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.419410    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.419447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.419438    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.419447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.419449    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.419672 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.419460    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/697a34f4-e9b5-4442-a740-19a6969bdca3-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.419672 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.419471    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/697a34f4-e9b5-4442-a740-19a6969bdca3-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:55.419672 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:55.419483    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpqdh\" (UniqueName: \"kubernetes.io/projected/697a34f4-e9b5-4442-a740-19a6969bdca3-kube-api-access-tpqdh\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:25:56.008155 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.008120    2568 generic.go:356] "Generic (PLEG): container finished" podID="697a34f4-e9b5-4442-a740-19a6969bdca3" containerID="7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d" exitCode=0
Sep 15 09:25:56.008313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.008165    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6" event={"ID":"697a34f4-e9b5-4442-a740-19a6969bdca3","Type":"ContainerDied","Data":"7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d"}
Sep 15 09:25:56.008313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.008169    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"
Sep 15 09:25:56.008313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.008209    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6" event={"ID":"697a34f4-e9b5-4442-a740-19a6969bdca3","Type":"ContainerDied","Data":"44fedffb16448040aaae90fda13461de9e6ac3dffad79af5a4c8b6575b8f0c5d"}
Sep 15 09:25:56.008313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.008229    2568 scope.go:117] "RemoveContainer" containerID="7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d"
Sep 15 09:25:56.017904 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.017887    2568 scope.go:117] "RemoveContainer" containerID="7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d"
Sep 15 09:25:56.018148 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:25:56.018129    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d\": container with ID starting with 7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d not found: ID does not exist" containerID="7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d"
Sep 15 09:25:56.018188 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.018157    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d"} err="failed to get container status \"7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d\": rpc error: code = NotFound desc = could not find container \"7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d\": container with ID starting with 7e30b3ce6213d1d309c1c220eac4419813b5ecec37197a445eeb09ea98cec91d not found: ID does not exist"
Sep 15 09:25:56.030283 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.030260    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"]
Sep 15 09:25:56.037373 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.037351    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-981036-openshift-default-69b54f868b-bpnx6"]
Sep 15 09:25:56.786438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:56.786400    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="697a34f4-e9b5-4442-a740-19a6969bdca3" path="/var/lib/kubelet/pods/697a34f4-e9b5-4442-a740-19a6969bdca3/volumes"
Sep 15 09:25:58.306534 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.306493    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"]
Sep 15 09:25:58.307146 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307125    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307151    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307171    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3803f2d-bdeb-413c-8294-6822af0f053c" containerName="revoke-keys"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307178    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3803f2d-bdeb-413c-8294-6822af0f053c" containerName="revoke-keys"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307188    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="697a34f4-e9b5-4442-a740-19a6969bdca3" containerName="istio-proxy"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307196    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="697a34f4-e9b5-4442-a740-19a6969bdca3" containerName="istio-proxy"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307204    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3420b4bd-11d5-4aee-9b2b-a1614cae3865" containerName="payload-pre-processing"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307212    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3420b4bd-11d5-4aee-9b2b-a1614cae3865" containerName="payload-pre-processing"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307237    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy"
Sep 15 09:25:58.307248 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307245    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy"
Sep 15 09:25:58.307674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307343    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3420b4bd-11d5-4aee-9b2b-a1614cae3865" containerName="payload-pre-processing"
Sep 15 09:25:58.307674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307355    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy"
Sep 15 09:25:58.307674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307363    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="813b4a28-d0ea-4b3e-81c4-bd9734658846" containerName="istio-proxy"
Sep 15 09:25:58.307674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307374    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="697a34f4-e9b5-4442-a740-19a6969bdca3" containerName="istio-proxy"
Sep 15 09:25:58.307674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.307384    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3803f2d-bdeb-413c-8294-6822af0f053c" containerName="revoke-keys"
Sep 15 09:25:58.314523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.314502    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.317701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.317654    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-fcb750c6-openshift-default-dockercfg-4zl78\""
Sep 15 09:25:58.320782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.320755    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"]
Sep 15 09:25:58.447756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.447720    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-token\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.447957 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.447775    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-certs\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.447957 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.447810    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-data\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.447957 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.447835    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-envoy\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.447957 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.447887    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-credential-socket\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.447957 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.447941    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15139d99-cb64-43b9-91f8-56a63e1b3a94-istiod-ca-cert\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.448129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.447980    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2sj\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-kube-api-access-fx2sj\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.448129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.448035    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-podinfo\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.448129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.448055    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-socket\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.548798 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.548769    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15139d99-cb64-43b9-91f8-56a63e1b3a94-istiod-ca-cert\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.548968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.548815    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2sj\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-kube-api-access-fx2sj\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.548968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.548864    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-podinfo\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.548968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.548889    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-socket\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.548968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.548916    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-token\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.548968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.548944    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-certs\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.549190 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.548999    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-data\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.549190 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.549056    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-envoy\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.549190 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.549087    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-credential-socket\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.549450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.549408    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-socket\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.549450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.549446    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-credential-socket\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.549666 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.549502    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-data\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.549666 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.549653    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15139d99-cb64-43b9-91f8-56a63e1b3a94-istiod-ca-cert\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.549787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.549678    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-certs\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.552084 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.552054    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-envoy\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.552355 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.552333    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-podinfo\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.556643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.556585    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2sj\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-kube-api-access-fx2sj\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.556911 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.556892    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-token\") pod \"e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") " pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.627944 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.627910    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:58.910707 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.910676    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"]
Sep 15 09:25:58.911948 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:25:58.911923    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15139d99_cb64_43b9_91f8_56a63e1b3a94.slice/crio-7d65537b59620da2f86c5f3ebc9046ed86dd7cdf503ce1ab60bffd932550e944 WatchSource:0}: Error finding container 7d65537b59620da2f86c5f3ebc9046ed86dd7cdf503ce1ab60bffd932550e944: Status 404 returned error can't find the container with id 7d65537b59620da2f86c5f3ebc9046ed86dd7cdf503ce1ab60bffd932550e944
Sep 15 09:25:58.914344 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.914304    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:25:58.914408 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.914392    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:25:58.914452 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:58.914436    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:25:59.027345 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:59.027311    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" event={"ID":"15139d99-cb64-43b9-91f8-56a63e1b3a94","Type":"ContainerStarted","Data":"cd626617bea3b8aa88dd010b0312f8e23387b3f1abafeaf1e72b663c5582a334"}
Sep 15 09:25:59.027513 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:59.027377    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" event={"ID":"15139d99-cb64-43b9-91f8-56a63e1b3a94","Type":"ContainerStarted","Data":"7d65537b59620da2f86c5f3ebc9046ed86dd7cdf503ce1ab60bffd932550e944"}
Sep 15 09:25:59.045730 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:59.045669    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" podStartSLOduration=1.04564856 podStartE2EDuration="1.04564856s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:25:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:25:59.04521309 +0000 UTC m=+1134.808784538" watchObservedRunningTime="2026-09-15 09:25:59.04564856 +0000 UTC m=+1134.809220009"
Sep 15 09:25:59.628093 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:59.628062    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:25:59.633307 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:25:59.633284    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:26:00.033226 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:00.033183    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:26:00.034294 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:00.034271    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:26:05.039693 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.039653    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"]
Sep 15 09:26:05.044820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.044798    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:05.047403 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.047378    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-fcb750c6-dockercfg-qx9fl\""
Sep 15 09:26:05.047533 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.047516    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-fcb750c6\""
Sep 15 09:26:05.051774 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.051753    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"]
Sep 15 09:26:05.209542 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.209500    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/3b8912a7-a3b4-4531-948e-7f8c09e01c37-kube-api-access-s5h96\") pod \"payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp\" (UID: \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:05.209721 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.209673    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b8912a7-a3b4-4531-948e-7f8c09e01c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp\" (UID: \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:05.310401 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.310365    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b8912a7-a3b4-4531-948e-7f8c09e01c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp\" (UID: \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:05.310584 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.310426    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/3b8912a7-a3b4-4531-948e-7f8c09e01c37-kube-api-access-s5h96\") pod \"payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp\" (UID: \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:05.311079 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.311063    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b8912a7-a3b4-4531-948e-7f8c09e01c37-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp\" (UID: \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:05.318591 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.318568    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/3b8912a7-a3b4-4531-948e-7f8c09e01c37-kube-api-access-s5h96\") pod \"payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp\" (UID: \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:05.356437 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.356407    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:05.627204 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:05.627178    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"]
Sep 15 09:26:05.629516 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:26:05.629492    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b8912a7_a3b4_4531_948e_7f8c09e01c37.slice/crio-6bfd1def98dbe6e6325efc9b4e6e8450dda7ffb63f058f497b4aed9c294c6bc8 WatchSource:0}: Error finding container 6bfd1def98dbe6e6325efc9b4e6e8450dda7ffb63f058f497b4aed9c294c6bc8: Status 404 returned error can't find the container with id 6bfd1def98dbe6e6325efc9b4e6e8450dda7ffb63f058f497b4aed9c294c6bc8
Sep 15 09:26:06.069585 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:06.069549    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp" event={"ID":"3b8912a7-a3b4-4531-948e-7f8c09e01c37","Type":"ContainerStarted","Data":"c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887"}
Sep 15 09:26:06.069585 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:06.069612    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:06.070069 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:06.069634    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp" event={"ID":"3b8912a7-a3b4-4531-948e-7f8c09e01c37","Type":"ContainerStarted","Data":"6bfd1def98dbe6e6325efc9b4e6e8450dda7ffb63f058f497b4aed9c294c6bc8"}
Sep 15 09:26:06.085666 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:06.085607    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp" podStartSLOduration=1.085589213 podStartE2EDuration="1.085589213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:26:06.08440494 +0000 UTC m=+1141.847976388" watchObservedRunningTime="2026-09-15 09:26:06.085589213 +0000 UTC m=+1141.849160661"
Sep 15 09:26:17.076026 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:17.075998    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:26:25.172948 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:25.172916    2568 generic.go:356] "Generic (PLEG): container finished" podID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerID="cd626617bea3b8aa88dd010b0312f8e23387b3f1abafeaf1e72b663c5582a334" exitCode=0
Sep 15 09:26:25.173423 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:25.172974    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" event={"ID":"15139d99-cb64-43b9-91f8-56a63e1b3a94","Type":"ContainerDied","Data":"cd626617bea3b8aa88dd010b0312f8e23387b3f1abafeaf1e72b663c5582a334"}
Sep 15 09:26:25.173423 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:25.173353    2568 scope.go:117] "RemoveContainer" containerID="cd626617bea3b8aa88dd010b0312f8e23387b3f1abafeaf1e72b663c5582a334"
Sep 15 09:26:25.174501 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:25.174473    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:26:25.174571 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:25.174540    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:26:25.174609 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:25.174571    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:26:26.179738 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:26.179696    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" event={"ID":"15139d99-cb64-43b9-91f8-56a63e1b3a94","Type":"ContainerStarted","Data":"070aa2ae9314bdc4150934d7b514fbe9ca53ebbb732458977d43c92a9787b134"}
Sep 15 09:26:26.629059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:26.628981    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:26:26.629935 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:26.629907    2568 patch_prober.go:28] interesting pod/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 15 09:26:26.630074 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:26.629967    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 15 09:26:27.629089 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:27.629051    2568 patch_prober.go:28] interesting pod/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 15 09:26:27.629495 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:27.629136    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 15 09:26:28.629296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:28.629260    2568 patch_prober.go:28] interesting pod/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 15 09:26:28.629772 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:28.629345    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 15 09:26:29.628605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:29.628563    2568 patch_prober.go:28] interesting pod/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 15 09:26:29.628784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:29.628633    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 15 09:26:30.033730 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:30.033696    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:26:30.629357 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:30.629076    2568 patch_prober.go:28] interesting pod/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body=
Sep 15 09:26:30.629357 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:30.629155    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused"
Sep 15 09:26:31.261115 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.261082    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"]
Sep 15 09:26:31.264402 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.264379    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:31.267032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.267013    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w3-f79800\""
Sep 15 09:26:31.276200 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.276173    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"]
Sep 15 09:26:31.305574 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.305532    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"]
Sep 15 09:26:31.309936 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.309915    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:31.313275 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.313255    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w3-f79800-dockercfg-7vpqp\""
Sep 15 09:26:31.318720 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.318689    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"]
Sep 15 09:26:31.364740 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.364706    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0902c-0792-4f1c-bffc-521a19ee9bff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz\" (UID: \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:31.364968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.364780    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f95dq\" (UniqueName: \"kubernetes.io/projected/5dd0902c-0792-4f1c-bffc-521a19ee9bff-kube-api-access-f95dq\") pod \"payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz\" (UID: \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:31.465557 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.465507    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0902c-0792-4f1c-bffc-521a19ee9bff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz\" (UID: \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:31.465753 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.465606    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f95dq\" (UniqueName: \"kubernetes.io/projected/5dd0902c-0792-4f1c-bffc-521a19ee9bff-kube-api-access-f95dq\") pod \"payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz\" (UID: \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:31.465753 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.465665    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc859519-88cc-4b00-96ee-dccd69b59f74-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp\" (UID: \"bc859519-88cc-4b00-96ee-dccd69b59f74\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:31.465753 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.465744    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tp8r\" (UniqueName: \"kubernetes.io/projected/bc859519-88cc-4b00-96ee-dccd69b59f74-kube-api-access-6tp8r\") pod \"payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp\" (UID: \"bc859519-88cc-4b00-96ee-dccd69b59f74\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:31.466439 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.466414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0902c-0792-4f1c-bffc-521a19ee9bff-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz\" (UID: \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:31.474813 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.474787    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f95dq\" (UniqueName: \"kubernetes.io/projected/5dd0902c-0792-4f1c-bffc-521a19ee9bff-kube-api-access-f95dq\") pod \"payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz\" (UID: \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:31.567086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.566996    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc859519-88cc-4b00-96ee-dccd69b59f74-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp\" (UID: \"bc859519-88cc-4b00-96ee-dccd69b59f74\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:31.567086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.567068    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tp8r\" (UniqueName: \"kubernetes.io/projected/bc859519-88cc-4b00-96ee-dccd69b59f74-kube-api-access-6tp8r\") pod \"payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp\" (UID: \"bc859519-88cc-4b00-96ee-dccd69b59f74\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:31.567736 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.567706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc859519-88cc-4b00-96ee-dccd69b59f74-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp\" (UID: \"bc859519-88cc-4b00-96ee-dccd69b59f74\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:31.575791 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.575760    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:31.579337 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.579002    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tp8r\" (UniqueName: \"kubernetes.io/projected/bc859519-88cc-4b00-96ee-dccd69b59f74-kube-api-access-6tp8r\") pod \"payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp\" (UID: \"bc859519-88cc-4b00-96ee-dccd69b59f74\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:31.622152 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.622109    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:31.635964 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.635937    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:26:31.639313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.638222    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:26:31.852311 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.852286    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"]
Sep 15 09:26:31.854010 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:26:31.853976    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5dd0902c_0792_4f1c_bffc_521a19ee9bff.slice/crio-136c32158a3f83ea08f91be385b6e0deafcf9e8193aac35521f16385989f3ef6 WatchSource:0}: Error finding container 136c32158a3f83ea08f91be385b6e0deafcf9e8193aac35521f16385989f3ef6: Status 404 returned error can't find the container with id 136c32158a3f83ea08f91be385b6e0deafcf9e8193aac35521f16385989f3ef6
Sep 15 09:26:31.912665 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:31.912639    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"]
Sep 15 09:26:31.914103 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:26:31.914078    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc859519_88cc_4b00_96ee_dccd69b59f74.slice/crio-d8878f3e8f9513113060d834a598e5c4cf9547a4fdcc39b220dc14a8bc224fd7 WatchSource:0}: Error finding container d8878f3e8f9513113060d834a598e5c4cf9547a4fdcc39b220dc14a8bc224fd7: Status 404 returned error can't find the container with id d8878f3e8f9513113060d834a598e5c4cf9547a4fdcc39b220dc14a8bc224fd7
Sep 15 09:26:32.224466 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:32.224204    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp" event={"ID":"bc859519-88cc-4b00-96ee-dccd69b59f74","Type":"ContainerStarted","Data":"c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6"}
Sep 15 09:26:32.224466 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:32.224280    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp" event={"ID":"bc859519-88cc-4b00-96ee-dccd69b59f74","Type":"ContainerStarted","Data":"d8878f3e8f9513113060d834a598e5c4cf9547a4fdcc39b220dc14a8bc224fd7"}
Sep 15 09:26:32.224466 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:32.224328    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:26:32.226305 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:32.226276    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz" event={"ID":"5dd0902c-0792-4f1c-bffc-521a19ee9bff","Type":"ContainerStarted","Data":"ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8"}
Sep 15 09:26:32.226438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:32.226330    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz" event={"ID":"5dd0902c-0792-4f1c-bffc-521a19ee9bff","Type":"ContainerStarted","Data":"136c32158a3f83ea08f91be385b6e0deafcf9e8193aac35521f16385989f3ef6"}
Sep 15 09:26:32.226438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:32.226423    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:32.264105 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:32.264037    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp" podStartSLOduration=1.264022854 podStartE2EDuration="1.264022854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:26:32.242793523 +0000 UTC m=+1168.006364973" watchObservedRunningTime="2026-09-15 09:26:32.264022854 +0000 UTC m=+1168.027594301"
Sep 15 09:26:32.264568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:32.264201    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz" podStartSLOduration=1.264195912 podStartE2EDuration="1.264195912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:26:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:26:32.262019214 +0000 UTC m=+1168.025590660" watchObservedRunningTime="2026-09-15 09:26:32.264195912 +0000 UTC m=+1168.027767406"
Sep 15 09:26:43.234915 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:43.234879    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:26:43.235331 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:26:43.234951    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:27:04.847386 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:04.847347    2568 scope.go:117] "RemoveContainer" containerID="6ececdffb14631d006359cb0bb3c81d94e84d04caca1aa33f72b0896da45bc15"
Sep 15 09:27:04.858151 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:04.858130    2568 scope.go:117] "RemoveContainer" containerID="d8450b0d0b3f99160d7214562583dbd6167e10aa4fcfef74e80f51a640181cb3"
Sep 15 09:27:05.609996 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.609959    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"]
Sep 15 09:27:05.614929 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.614912    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:05.617742 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.617720    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-8dd3bd\""
Sep 15 09:27:05.617886 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.617777    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-8dd3bd-dockercfg-w5vq2\""
Sep 15 09:27:05.622094 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.622064    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"]
Sep 15 09:27:05.650994 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.650961    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"]
Sep 15 09:27:05.654475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.654459    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:05.664253 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.664234    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"]
Sep 15 09:27:05.697579 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.697488    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsv87\" (UniqueName: \"kubernetes.io/projected/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-kube-api-access-lsv87\") pod \"payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z\" (UID: \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:05.697579 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.697554    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z\" (UID: \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:05.799133 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.799099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsv87\" (UniqueName: \"kubernetes.io/projected/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-kube-api-access-lsv87\") pod \"payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z\" (UID: \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:05.799297 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.799144    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z\" (UID: \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:05.799297 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.799273    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j95r5\" (UniqueName: \"kubernetes.io/projected/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-kube-api-access-j95r5\") pod \"payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427\" (UID: \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:05.799438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.799417    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427\" (UID: \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:05.799787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.799771    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z\" (UID: \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:05.807648 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.807627    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsv87\" (UniqueName: \"kubernetes.io/projected/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-kube-api-access-lsv87\") pod \"payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z\" (UID: \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:05.900985 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.900890    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j95r5\" (UniqueName: \"kubernetes.io/projected/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-kube-api-access-j95r5\") pod \"payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427\" (UID: \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:05.901460 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.901020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427\" (UID: \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:05.901800 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.901777    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427\" (UID: \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:05.909525 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.909499    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j95r5\" (UniqueName: \"kubernetes.io/projected/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-kube-api-access-j95r5\") pod \"payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427\" (UID: \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:05.927355 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.927327    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:05.965030 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:05.964999    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:06.202361 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.202336    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"]
Sep 15 09:27:06.203915 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:27:06.203886    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebe5abc0_6951_4c37_af6c_b5f5f88d22d6.slice/crio-5c5022084bd4a174ea1d632166cfda9b9e0c0abaab1262a10f4c7a0f2f1faaed WatchSource:0}: Error finding container 5c5022084bd4a174ea1d632166cfda9b9e0c0abaab1262a10f4c7a0f2f1faaed: Status 404 returned error can't find the container with id 5c5022084bd4a174ea1d632166cfda9b9e0c0abaab1262a10f4c7a0f2f1faaed
Sep 15 09:27:06.252525 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.252484    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"]
Sep 15 09:27:06.254353 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:27:06.254329    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5fd5e3d_033b_41b1_b37a_0ebe3c5064dd.slice/crio-e201d2db1ae4cec1ab8f0e89f492f701c1ee1c7b100c3410f3daa1ddb2cfb8a7 WatchSource:0}: Error finding container e201d2db1ae4cec1ab8f0e89f492f701c1ee1c7b100c3410f3daa1ddb2cfb8a7: Status 404 returned error can't find the container with id e201d2db1ae4cec1ab8f0e89f492f701c1ee1c7b100c3410f3daa1ddb2cfb8a7
Sep 15 09:27:06.419197 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.419157    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427" event={"ID":"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd","Type":"ContainerStarted","Data":"758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45"}
Sep 15 09:27:06.419391 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.419222    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427" event={"ID":"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd","Type":"ContainerStarted","Data":"e201d2db1ae4cec1ab8f0e89f492f701c1ee1c7b100c3410f3daa1ddb2cfb8a7"}
Sep 15 09:27:06.419391 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.419336    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:27:06.421023 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.420996    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z" event={"ID":"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6","Type":"ContainerStarted","Data":"e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184"}
Sep 15 09:27:06.421171 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.421037    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z" event={"ID":"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6","Type":"ContainerStarted","Data":"5c5022084bd4a174ea1d632166cfda9b9e0c0abaab1262a10f4c7a0f2f1faaed"}
Sep 15 09:27:06.421171 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.421131    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:06.437012 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.436961    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427" podStartSLOduration=1.436942059 podStartE2EDuration="1.436942059s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:06.435499428 +0000 UTC m=+1202.199070878" watchObservedRunningTime="2026-09-15 09:27:06.436942059 +0000 UTC m=+1202.200513511"
Sep 15 09:27:06.453136 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:06.453055    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z" podStartSLOduration=1.453040092 podStartE2EDuration="1.453040092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:27:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:27:06.451172762 +0000 UTC m=+1202.214744213" watchObservedRunningTime="2026-09-15 09:27:06.453040092 +0000 UTC m=+1202.216611537"
Sep 15 09:27:17.427999 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:17.427969    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:27:17.428380 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:27:17.428037    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:28:04.880122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:04.880092    2568 scope.go:117] "RemoveContainer" containerID="be565ccabd96026e00a926f012833063541d9ecf1fefd2ab8d7fd6b768c57a67"
Sep 15 09:28:04.888709 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:04.888690    2568 scope.go:117] "RemoveContainer" containerID="f58380827d423b1c668fb705568672dc892c2c538ce4db07960c67683b7a617e"
Sep 15 09:28:04.896540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:04.896524    2568 scope.go:117] "RemoveContainer" containerID="90ece763b1517833fcd82042e8efdec263d9aa2b2c20d45c93a0e679d394f314"
Sep 15 09:28:04.904226 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:04.904208    2568 scope.go:117] "RemoveContainer" containerID="a2dfb6a8d162f2c99431336c568162b3dd5025ac309830828306996f51ff1345"
Sep 15 09:28:23.591471 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.591439    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"]
Sep 15 09:28:23.596624 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.596596    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"
Sep 15 09:28:23.599255 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.599231    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:28:23.599404 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.599390    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:28:23.604318 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.604270    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"]
Sep 15 09:28:23.624853 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.624822    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acd513b-9f8e-49c9-b50a-12a96f9d3af3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b\" (UID: \"7acd513b-9f8e-49c9-b50a-12a96f9d3af3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"
Sep 15 09:28:23.725494 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.725455    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acd513b-9f8e-49c9-b50a-12a96f9d3af3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b\" (UID: \"7acd513b-9f8e-49c9-b50a-12a96f9d3af3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"
Sep 15 09:28:23.726201 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.726174    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acd513b-9f8e-49c9-b50a-12a96f9d3af3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b\" (UID: \"7acd513b-9f8e-49c9-b50a-12a96f9d3af3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"
Sep 15 09:28:23.909500 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:23.909472    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"
Sep 15 09:28:24.182812 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:24.182783    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"]
Sep 15 09:28:24.184468 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:28:24.184428    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7acd513b_9f8e_49c9_b50a_12a96f9d3af3.slice/crio-8468c5b58a2afd09503e0fcfafa1223bc2eeade7896980a6dc952454b6836f2a WatchSource:0}: Error finding container 8468c5b58a2afd09503e0fcfafa1223bc2eeade7896980a6dc952454b6836f2a: Status 404 returned error can't find the container with id 8468c5b58a2afd09503e0fcfafa1223bc2eeade7896980a6dc952454b6836f2a
Sep 15 09:28:24.829913 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:24.829879    2568 generic.go:356] "Generic (PLEG): container finished" podID="7acd513b-9f8e-49c9-b50a-12a96f9d3af3" containerID="d828eba5e5c210c5b5ddb4e9239a61b006c41719a49c0d19389e0535a1cadb82" exitCode=0
Sep 15 09:28:24.830247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:24.829955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b" event={"ID":"7acd513b-9f8e-49c9-b50a-12a96f9d3af3","Type":"ContainerDied","Data":"d828eba5e5c210c5b5ddb4e9239a61b006c41719a49c0d19389e0535a1cadb82"}
Sep 15 09:28:24.830247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:24.830011    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b" event={"ID":"7acd513b-9f8e-49c9-b50a-12a96f9d3af3","Type":"ContainerStarted","Data":"8468c5b58a2afd09503e0fcfafa1223bc2eeade7896980a6dc952454b6836f2a"}
Sep 15 09:28:25.976480 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:25.976457    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"
Sep 15 09:28:26.047697 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:26.047664    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acd513b-9f8e-49c9-b50a-12a96f9d3af3-maas-api-service-ca\") pod \"7acd513b-9f8e-49c9-b50a-12a96f9d3af3\" (UID: \"7acd513b-9f8e-49c9-b50a-12a96f9d3af3\") "
Sep 15 09:28:26.048046 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:26.048025    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7acd513b-9f8e-49c9-b50a-12a96f9d3af3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7acd513b-9f8e-49c9-b50a-12a96f9d3af3" (UID: "7acd513b-9f8e-49c9-b50a-12a96f9d3af3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:28:26.149583 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:26.149496    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7acd513b-9f8e-49c9-b50a-12a96f9d3af3-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:28:26.841193 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:26.841156    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b" event={"ID":"7acd513b-9f8e-49c9-b50a-12a96f9d3af3","Type":"ContainerDied","Data":"8468c5b58a2afd09503e0fcfafa1223bc2eeade7896980a6dc952454b6836f2a"}
Sep 15 09:28:26.841357 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:26.841215    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8468c5b58a2afd09503e0fcfafa1223bc2eeade7896980a6dc952454b6836f2a"
Sep 15 09:28:26.841357 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:26.841213    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"
Sep 15 09:28:39.177811 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.177772    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"]
Sep 15 09:28:39.178465 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.178039    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp" podUID="3b8912a7-a3b4-4531-948e-7f8c09e01c37" containerName="payload-pre-processing" containerID="cri-o://c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887" gracePeriod=30
Sep 15 09:28:39.362357 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.362324    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"]
Sep 15 09:28:39.365960 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.365931    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-fcb750c6-kfv4b"]
Sep 15 09:28:39.448949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.448869    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:28:39.578149 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.578118    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b8912a7-a3b4-4531-948e-7f8c09e01c37-plugins-config-volume\") pod \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\" (UID: \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\") "
Sep 15 09:28:39.578324 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.578170    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/3b8912a7-a3b4-4531-948e-7f8c09e01c37-kube-api-access-s5h96\") pod \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\" (UID: \"3b8912a7-a3b4-4531-948e-7f8c09e01c37\") "
Sep 15 09:28:39.578542 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.578514    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b8912a7-a3b4-4531-948e-7f8c09e01c37-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b8912a7-a3b4-4531-948e-7f8c09e01c37" (UID: "3b8912a7-a3b4-4531-948e-7f8c09e01c37"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:28:39.580394 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.580364    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b8912a7-a3b4-4531-948e-7f8c09e01c37-kube-api-access-s5h96" (OuterVolumeSpecName: "kube-api-access-s5h96") pod "3b8912a7-a3b4-4531-948e-7f8c09e01c37" (UID: "3b8912a7-a3b4-4531-948e-7f8c09e01c37"). InnerVolumeSpecName "kube-api-access-s5h96". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:28:39.679896 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.679832    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b8912a7-a3b4-4531-948e-7f8c09e01c37-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:28:39.679896 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.679888    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s5h96\" (UniqueName: \"kubernetes.io/projected/3b8912a7-a3b4-4531-948e-7f8c09e01c37-kube-api-access-s5h96\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:28:39.910718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.910685    2568 generic.go:356] "Generic (PLEG): container finished" podID="3b8912a7-a3b4-4531-948e-7f8c09e01c37" containerID="c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887" exitCode=0
Sep 15 09:28:39.910914 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.910733    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"
Sep 15 09:28:39.910914 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.910740    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp" event={"ID":"3b8912a7-a3b4-4531-948e-7f8c09e01c37","Type":"ContainerDied","Data":"c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887"}
Sep 15 09:28:39.910914 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.910792    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp" event={"ID":"3b8912a7-a3b4-4531-948e-7f8c09e01c37","Type":"ContainerDied","Data":"6bfd1def98dbe6e6325efc9b4e6e8450dda7ffb63f058f497b4aed9c294c6bc8"}
Sep 15 09:28:39.910914 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.910820    2568 scope.go:117] "RemoveContainer" containerID="c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887"
Sep 15 09:28:39.923996 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.923969    2568 scope.go:117] "RemoveContainer" containerID="c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887"
Sep 15 09:28:39.924474 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:28:39.924444    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887\": container with ID starting with c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887 not found: ID does not exist" containerID="c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887"
Sep 15 09:28:39.924551 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.924488    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887"} err="failed to get container status \"c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887\": rpc error: code = NotFound desc = could not find container \"c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887\": container with ID starting with c042bd65bc080004311572d9bb678a99ee79a6b4377d04bb8c652191f86fc887 not found: ID does not exist"
Sep 15 09:28:39.939363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.939339    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"]
Sep 15 09:28:39.943628 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:39.943607    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-fcb750c6-8ff848f7d-8r6pp"]
Sep 15 09:28:40.785820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:40.785786    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b8912a7-a3b4-4531-948e-7f8c09e01c37" path="/var/lib/kubelet/pods/3b8912a7-a3b4-4531-948e-7f8c09e01c37/volumes"
Sep 15 09:28:40.786221 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:28:40.786148    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7acd513b-9f8e-49c9-b50a-12a96f9d3af3" path="/var/lib/kubelet/pods/7acd513b-9f8e-49c9-b50a-12a96f9d3af3/volumes"
Sep 15 09:30:00.146420 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.146313    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"]
Sep 15 09:30:00.150205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.148206    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7acd513b-9f8e-49c9-b50a-12a96f9d3af3" containerName="revoke-keys"
Sep 15 09:30:00.150205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.148234    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7acd513b-9f8e-49c9-b50a-12a96f9d3af3" containerName="revoke-keys"
Sep 15 09:30:00.150205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.148257    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b8912a7-a3b4-4531-948e-7f8c09e01c37" containerName="payload-pre-processing"
Sep 15 09:30:00.150205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.148266    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b8912a7-a3b4-4531-948e-7f8c09e01c37" containerName="payload-pre-processing"
Sep 15 09:30:00.150205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.148427    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7acd513b-9f8e-49c9-b50a-12a96f9d3af3" containerName="revoke-keys"
Sep 15 09:30:00.150205 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.148447    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b8912a7-a3b4-4531-948e-7f8c09e01c37" containerName="payload-pre-processing"
Sep 15 09:30:00.152546 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.152514    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"]
Sep 15 09:30:00.153036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.153000    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"
Sep 15 09:30:00.157169 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.157146    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:30:00.157341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.157316    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7"]
Sep 15 09:30:00.157755 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.157737    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"
Sep 15 09:30:00.161079 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.161054    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"]
Sep 15 09:30:00.161189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.161153    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7"
Sep 15 09:30:00.162669 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.162545    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"]
Sep 15 09:30:00.165039 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.165015    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7"]
Sep 15 09:30:00.168770 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.168749    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"]
Sep 15 09:30:00.169507 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.169490    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"
Sep 15 09:30:00.172953 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.172700    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"
Sep 15 09:30:00.181214 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.181178    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"]
Sep 15 09:30:00.181357 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.181335    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"
Sep 15 09:30:00.220762 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.220726    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7"
Sep 15 09:30:00.229118 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.229097    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"
Sep 15 09:30:00.457428 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.457400    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"]
Sep 15 09:30:00.459225 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:30:00.459199    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ba4c5c6_7710_4328_a3d2_5270c050788c.slice/crio-e2ce87db1383ff0cfa65a128438fde97ba986376acad2e08a39a6471b5c0a7ac WatchSource:0}: Error finding container e2ce87db1383ff0cfa65a128438fde97ba986376acad2e08a39a6471b5c0a7ac: Status 404 returned error can't find the container with id e2ce87db1383ff0cfa65a128438fde97ba986376acad2e08a39a6471b5c0a7ac
Sep 15 09:30:00.475667 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.475624    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"]
Sep 15 09:30:00.478438 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:30:00.478412    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb433925c_b453_4790_b608_806286917058.slice/crio-da17a8faf0435cb8acaaa907f97f2629e5cb7d8416179e0210f43f8e6d1d7244 WatchSource:0}: Error finding container da17a8faf0435cb8acaaa907f97f2629e5cb7d8416179e0210f43f8e6d1d7244: Status 404 returned error can't find the container with id da17a8faf0435cb8acaaa907f97f2629e5cb7d8416179e0210f43f8e6d1d7244
Sep 15 09:30:00.526222 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.526192    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7"]
Sep 15 09:30:00.527724 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:30:00.527700    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88e2b8af_591a_47ee_8022_a9b876c66ced.slice/crio-cf69f73ff460d7eb9ac0cc1ae0fc54ef73f12ae6017541c7ea44a092050349f5 WatchSource:0}: Error finding container cf69f73ff460d7eb9ac0cc1ae0fc54ef73f12ae6017541c7ea44a092050349f5: Status 404 returned error can't find the container with id cf69f73ff460d7eb9ac0cc1ae0fc54ef73f12ae6017541c7ea44a092050349f5
Sep 15 09:30:00.538142 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:00.538121    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"]
Sep 15 09:30:00.541337 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:30:00.541315    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda00f3325_31b7_48e7_85a3_6c8ddb83f27f.slice/crio-a18e798553dbe3a1e0767ea9059948463f66e278a2fa82e237019a99ad737c3e WatchSource:0}: Error finding container a18e798553dbe3a1e0767ea9059948463f66e278a2fa82e237019a99ad737c3e: Status 404 returned error can't find the container with id a18e798553dbe3a1e0767ea9059948463f66e278a2fa82e237019a99ad737c3e
Sep 15 09:30:01.323770 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.323735    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf" event={"ID":"b433925c-b453-4790-b608-806286917058","Type":"ContainerStarted","Data":"ab55e7ed53c7fb50ac00f4db25910b23826b84558c36b696dabba0f5e54cc3a2"}
Sep 15 09:30:01.324213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.323794    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf" event={"ID":"b433925c-b453-4790-b608-806286917058","Type":"ContainerStarted","Data":"da17a8faf0435cb8acaaa907f97f2629e5cb7d8416179e0210f43f8e6d1d7244"}
Sep 15 09:30:01.325334 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.325302    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7" event={"ID":"88e2b8af-591a-47ee-8022-a9b876c66ced","Type":"ContainerStarted","Data":"a6afd6808a84a79eee5bc80198fa26b3c2e35158c8cd6109b36186fc7fee58c8"}
Sep 15 09:30:01.325475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.325356    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7" event={"ID":"88e2b8af-591a-47ee-8022-a9b876c66ced","Type":"ContainerStarted","Data":"cf69f73ff460d7eb9ac0cc1ae0fc54ef73f12ae6017541c7ea44a092050349f5"}
Sep 15 09:30:01.326821 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.326798    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4" event={"ID":"6ba4c5c6-7710-4328-a3d2-5270c050788c","Type":"ContainerStarted","Data":"5623ac328fe2fe4ab6a8af3fe3ef1e6707c209b550c3cf3ad1cb4d4b1b115f3f"}
Sep 15 09:30:01.326965 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.326861    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4" event={"ID":"6ba4c5c6-7710-4328-a3d2-5270c050788c","Type":"ContainerStarted","Data":"e2ce87db1383ff0cfa65a128438fde97ba986376acad2e08a39a6471b5c0a7ac"}
Sep 15 09:30:01.328362 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.328342    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj" event={"ID":"a00f3325-31b7-48e7-85a3-6c8ddb83f27f","Type":"ContainerStarted","Data":"bc57f76383d17b18aea4b7f476458701fb0e219b6fc5357a7609dea37f05518b"}
Sep 15 09:30:01.328452 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.328374    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj" event={"ID":"a00f3325-31b7-48e7-85a3-6c8ddb83f27f","Type":"ContainerStarted","Data":"a18e798553dbe3a1e0767ea9059948463f66e278a2fa82e237019a99ad737c3e"}
Sep 15 09:30:01.340186 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.340141    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf" podStartSLOduration=1.340127836 podStartE2EDuration="1.340127836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:01.338297372 +0000 UTC m=+1377.101868821" watchObservedRunningTime="2026-09-15 09:30:01.340127836 +0000 UTC m=+1377.103699325"
Sep 15 09:30:01.354737 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.354698    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7" podStartSLOduration=1.354686494 podStartE2EDuration="1.354686494s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:01.352205125 +0000 UTC m=+1377.115776572" watchObservedRunningTime="2026-09-15 09:30:01.354686494 +0000 UTC m=+1377.118257942"
Sep 15 09:30:01.367924 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.367881    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4" podStartSLOduration=1.367867051 podStartE2EDuration="1.367867051s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:01.366082055 +0000 UTC m=+1377.129653502" watchObservedRunningTime="2026-09-15 09:30:01.367867051 +0000 UTC m=+1377.131438496"
Sep 15 09:30:01.380314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:01.380272    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj" podStartSLOduration=1.380257327 podStartE2EDuration="1.380257327s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:01.379141328 +0000 UTC m=+1377.142712800" watchObservedRunningTime="2026-09-15 09:30:01.380257327 +0000 UTC m=+1377.143828775"
Sep 15 09:30:02.230397 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.230365    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"]
Sep 15 09:30:02.230589 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.230567    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy" containerID="cri-o://070aa2ae9314bdc4150934d7b514fbe9ca53ebbb732458977d43c92a9787b134" gracePeriod=30
Sep 15 09:30:02.336764 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.336720    2568 generic.go:356] "Generic (PLEG): container finished" podID="88e2b8af-591a-47ee-8022-a9b876c66ced" containerID="a6afd6808a84a79eee5bc80198fa26b3c2e35158c8cd6109b36186fc7fee58c8" exitCode=0
Sep 15 09:30:02.337262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.336830    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7" event={"ID":"88e2b8af-591a-47ee-8022-a9b876c66ced","Type":"ContainerDied","Data":"a6afd6808a84a79eee5bc80198fa26b3c2e35158c8cd6109b36186fc7fee58c8"}
Sep 15 09:30:02.338892 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.338865    2568 generic.go:356] "Generic (PLEG): container finished" podID="6ba4c5c6-7710-4328-a3d2-5270c050788c" containerID="5623ac328fe2fe4ab6a8af3fe3ef1e6707c209b550c3cf3ad1cb4d4b1b115f3f" exitCode=0
Sep 15 09:30:02.339031 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.339013    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4" event={"ID":"6ba4c5c6-7710-4328-a3d2-5270c050788c","Type":"ContainerDied","Data":"5623ac328fe2fe4ab6a8af3fe3ef1e6707c209b550c3cf3ad1cb4d4b1b115f3f"}
Sep 15 09:30:02.341106 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.341078    2568 generic.go:356] "Generic (PLEG): container finished" podID="a00f3325-31b7-48e7-85a3-6c8ddb83f27f" containerID="bc57f76383d17b18aea4b7f476458701fb0e219b6fc5357a7609dea37f05518b" exitCode=0
Sep 15 09:30:02.341237 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.341219    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj" event={"ID":"a00f3325-31b7-48e7-85a3-6c8ddb83f27f","Type":"ContainerDied","Data":"bc57f76383d17b18aea4b7f476458701fb0e219b6fc5357a7609dea37f05518b"}
Sep 15 09:30:02.343253 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.343227    2568 generic.go:356] "Generic (PLEG): container finished" podID="b433925c-b453-4790-b608-806286917058" containerID="ab55e7ed53c7fb50ac00f4db25910b23826b84558c36b696dabba0f5e54cc3a2" exitCode=0
Sep 15 09:30:02.343364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:02.343270    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf" event={"ID":"b433925c-b453-4790-b608-806286917058","Type":"ContainerDied","Data":"ab55e7ed53c7fb50ac00f4db25910b23826b84558c36b696dabba0f5e54cc3a2"}
Sep 15 09:30:03.502745 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:03.502717    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"
Sep 15 09:30:03.551284 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:03.551261    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7"
Sep 15 09:30:03.593629 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:03.593606    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"
Sep 15 09:30:03.596625 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:03.596601    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"
Sep 15 09:30:04.354946 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.354922    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"
Sep 15 09:30:04.355136 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.354955    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj" event={"ID":"a00f3325-31b7-48e7-85a3-6c8ddb83f27f","Type":"ContainerDied","Data":"a18e798553dbe3a1e0767ea9059948463f66e278a2fa82e237019a99ad737c3e"}
Sep 15 09:30:04.355136 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.354997    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a18e798553dbe3a1e0767ea9059948463f66e278a2fa82e237019a99ad737c3e"
Sep 15 09:30:04.356287 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.356270    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"
Sep 15 09:30:04.356445 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.356294    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf" event={"ID":"b433925c-b453-4790-b608-806286917058","Type":"ContainerDied","Data":"da17a8faf0435cb8acaaa907f97f2629e5cb7d8416179e0210f43f8e6d1d7244"}
Sep 15 09:30:04.356445 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.356336    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="da17a8faf0435cb8acaaa907f97f2629e5cb7d8416179e0210f43f8e6d1d7244"
Sep 15 09:30:04.357748 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.357733    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7"
Sep 15 09:30:04.357880 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.357721    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824410-27vm7" event={"ID":"88e2b8af-591a-47ee-8022-a9b876c66ced","Type":"ContainerDied","Data":"cf69f73ff460d7eb9ac0cc1ae0fc54ef73f12ae6017541c7ea44a092050349f5"}
Sep 15 09:30:04.357959 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.357912    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf69f73ff460d7eb9ac0cc1ae0fc54ef73f12ae6017541c7ea44a092050349f5"
Sep 15 09:30:04.359122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.359095    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4" event={"ID":"6ba4c5c6-7710-4328-a3d2-5270c050788c","Type":"ContainerDied","Data":"e2ce87db1383ff0cfa65a128438fde97ba986376acad2e08a39a6471b5c0a7ac"}
Sep 15 09:30:04.359208 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.359127    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e2ce87db1383ff0cfa65a128438fde97ba986376acad2e08a39a6471b5c0a7ac"
Sep 15 09:30:04.359208 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.359098    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"
Sep 15 09:30:04.948678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:04.948648    2568 scope.go:117] "RemoveContainer" containerID="878d15d543ba5695bacd3d2d12f91e6880bf87ca324ad73f0197b0470b8471bb"
Sep 15 09:30:07.385795 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.385756    2568 generic.go:356] "Generic (PLEG): container finished" podID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerID="070aa2ae9314bdc4150934d7b514fbe9ca53ebbb732458977d43c92a9787b134" exitCode=0
Sep 15 09:30:07.386241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.385824    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" event={"ID":"15139d99-cb64-43b9-91f8-56a63e1b3a94","Type":"ContainerDied","Data":"070aa2ae9314bdc4150934d7b514fbe9ca53ebbb732458977d43c92a9787b134"}
Sep 15 09:30:07.386241 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.385936    2568 scope.go:117] "RemoveContainer" containerID="cd626617bea3b8aa88dd010b0312f8e23387b3f1abafeaf1e72b663c5582a334"
Sep 15 09:30:07.494762 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.494699    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:30:07.616496 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616467    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15139d99-cb64-43b9-91f8-56a63e1b3a94-istiod-ca-cert\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.616661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616509    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-token\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.616661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-socket\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.616661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616572    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-data\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.616836 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616731    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-credential-socket\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.616836 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616767    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-envoy\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.616836 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616786    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-podinfo\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.617036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616885    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx2sj\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-kube-api-access-fx2sj\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.617036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616886    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-data" (OuterVolumeSpecName: "istio-data") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.617036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616940    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-certs\") pod \"15139d99-cb64-43b9-91f8-56a63e1b3a94\" (UID: \"15139d99-cb64-43b9-91f8-56a63e1b3a94\") "
Sep 15 09:30:07.617036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616953    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.617036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.616973    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/15139d99-cb64-43b9-91f8-56a63e1b3a94-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:30:07.617304 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.617062    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.617304 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.617239    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.617412 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.617346    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.617412 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.617366    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/15139d99-cb64-43b9-91f8-56a63e1b3a94-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.617412 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.617380    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.617412 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.617393    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.617412 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.617406    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.619088 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.619064    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:30:07.619204 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.619084    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-kube-api-access-fx2sj" (OuterVolumeSpecName: "kube-api-access-fx2sj") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "kube-api-access-fx2sj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:30:07.619450 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.619428    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:30:07.619519 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.619450    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-token" (OuterVolumeSpecName: "istio-token") pod "15139d99-cb64-43b9-91f8-56a63e1b3a94" (UID: "15139d99-cb64-43b9-91f8-56a63e1b3a94"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:30:07.717876 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.717828    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.717876 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.717868    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.717876 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.717878    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx2sj\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-kube-api-access-fx2sj\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:07.718102 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:07.717887    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/15139d99-cb64-43b9-91f8-56a63e1b3a94-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:30:08.392670 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:08.392637    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"
Sep 15 09:30:08.393093 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:08.392674    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4" event={"ID":"15139d99-cb64-43b9-91f8-56a63e1b3a94","Type":"ContainerDied","Data":"7d65537b59620da2f86c5f3ebc9046ed86dd7cdf503ce1ab60bffd932550e944"}
Sep 15 09:30:08.393093 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:08.392732    2568 scope.go:117] "RemoveContainer" containerID="070aa2ae9314bdc4150934d7b514fbe9ca53ebbb732458977d43c92a9787b134"
Sep 15 09:30:08.414593 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:08.414571    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"]
Sep 15 09:30:08.420783 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:08.420763    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-fcb750c6-openshift-default-747d7bcf88-d9xv4"]
Sep 15 09:30:08.787250 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:08.787218    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" path="/var/lib/kubelet/pods/15139d99-cb64-43b9-91f8-56a63e1b3a94/volumes"
Sep 15 09:30:56.405734 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.405651    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"]
Sep 15 09:30:56.406291 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406272    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy"
Sep 15 09:30:56.406363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406296    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy"
Sep 15 09:30:56.406363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406310    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="88e2b8af-591a-47ee-8022-a9b876c66ced" containerName="cleanup"
Sep 15 09:30:56.406363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406319    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="88e2b8af-591a-47ee-8022-a9b876c66ced" containerName="cleanup"
Sep 15 09:30:56.406363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406341    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ba4c5c6-7710-4328-a3d2-5270c050788c" containerName="cleanup"
Sep 15 09:30:56.406363 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406350    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ba4c5c6-7710-4328-a3d2-5270c050788c" containerName="cleanup"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406366    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406374    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406382    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a00f3325-31b7-48e7-85a3-6c8ddb83f27f" containerName="cleanup"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406388    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a00f3325-31b7-48e7-85a3-6c8ddb83f27f" containerName="cleanup"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406400    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b433925c-b453-4790-b608-806286917058" containerName="cleanup"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406405    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b433925c-b453-4790-b608-806286917058" containerName="cleanup"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406477    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406487    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a00f3325-31b7-48e7-85a3-6c8ddb83f27f" containerName="cleanup"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406497    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="88e2b8af-591a-47ee-8022-a9b876c66ced" containerName="cleanup"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406505    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="15139d99-cb64-43b9-91f8-56a63e1b3a94" containerName="istio-proxy"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406514    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ba4c5c6-7710-4328-a3d2-5270c050788c" containerName="cleanup"
Sep 15 09:30:56.406577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.406520    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b433925c-b453-4790-b608-806286917058" containerName="cleanup"
Sep 15 09:30:56.409789 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.409770    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.412706 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.412683    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-730be9-openshift-default-dockercfg-l2pfx\""
Sep 15 09:30:56.424424 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.424401    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"]
Sep 15 09:30:56.557590 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.557550    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istiod-ca-cert\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.557964 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.557929    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-certs\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.558103 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.557990    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-token\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.558103 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.558054    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-credential-socket\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.558213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.558103    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gkn9\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-kube-api-access-2gkn9\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.558213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.558130    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-socket\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.558213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.558149    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-envoy\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.558340 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.558229    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-data\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.558340 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.558267    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-podinfo\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.659797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.659758    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istiod-ca-cert\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.660125 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.660104    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-certs\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.660274 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.660259    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-token\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.660409 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.660395    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-credential-socket\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.660545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.660530    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gkn9\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-kube-api-access-2gkn9\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.660664 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.660650    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-socket\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.660768 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.660755    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-envoy\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.660917 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.660900    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-data\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.661063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.661048    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-podinfo\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.662192 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.662166    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-socket\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.663810 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.662548    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-data\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.663989 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.663009    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-credential-socket\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.664080 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.663553    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istiod-ca-cert\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.664161 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.663747    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-certs\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.666052 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.666007    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-envoy\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.666426 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.666188    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-podinfo\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.670788 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.670764    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-token\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.670940 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.670914    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gkn9\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-kube-api-access-2gkn9\") pod \"e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") " pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:56.720762 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:56.720727    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:57.000906 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:57.000880    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"]
Sep 15 09:30:57.002624 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:30:57.002599    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63e4f26b_42a0_4d50_adf6_b7196f9ff8d0.slice/crio-591f6d09f05f4ae7f6c26453fa3255dd8c83a5976c7bd6e2376cd5da32dc6c41 WatchSource:0}: Error finding container 591f6d09f05f4ae7f6c26453fa3255dd8c83a5976c7bd6e2376cd5da32dc6c41: Status 404 returned error can't find the container with id 591f6d09f05f4ae7f6c26453fa3255dd8c83a5976c7bd6e2376cd5da32dc6c41
Sep 15 09:30:57.005244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:57.005190    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:30:57.005335 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:57.005293    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:30:57.005372 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:57.005335    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:30:57.660976 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:57.660936    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" event={"ID":"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0","Type":"ContainerStarted","Data":"3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2"}
Sep 15 09:30:57.661385 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:57.660991    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" event={"ID":"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0","Type":"ContainerStarted","Data":"591f6d09f05f4ae7f6c26453fa3255dd8c83a5976c7bd6e2376cd5da32dc6c41"}
Sep 15 09:30:57.683575 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:57.683530    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podStartSLOduration=1.6835138939999998 podStartE2EDuration="1.683513894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:30:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:30:57.682310673 +0000 UTC m=+1433.445882121" watchObservedRunningTime="2026-09-15 09:30:57.683513894 +0000 UTC m=+1433.447085342"
Sep 15 09:30:57.721018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:57.720990    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:58.727046 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:58.727020    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:59.673885 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:59.673837    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:30:59.674712 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:30:59.674696    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:31:04.878395 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.878357    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"]
Sep 15 09:31:04.881778 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.881761    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:04.884433 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.884408    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-730be9-dockercfg-pbmws\""
Sep 15 09:31:04.884657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.884631    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-730be9\""
Sep 15 09:31:04.892550 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.892529    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"]
Sep 15 09:31:04.900679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.900656    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"]
Sep 15 09:31:04.904040 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.904025    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:04.915517 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.915496    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"]
Sep 15 09:31:04.947116 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.947083    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tv8wv\" (UniqueName: \"kubernetes.io/projected/1e325950-4be5-4ca8-9b7c-365804945f9d-kube-api-access-tv8wv\") pod \"payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv\" (UID: \"1e325950-4be5-4ca8-9b7c-365804945f9d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:04.947296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.947280    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e325950-4be5-4ca8-9b7c-365804945f9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv\" (UID: \"1e325950-4be5-4ca8-9b7c-365804945f9d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:04.968011 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:04.967985    2568 scope.go:117] "RemoveContainer" containerID="4d8e4089bb7b92535fafbdc5faaf1bf542acaaf65452b7552bef4af73b6efe36"
Sep 15 09:31:05.048260 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.048228    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tv8wv\" (UniqueName: \"kubernetes.io/projected/1e325950-4be5-4ca8-9b7c-365804945f9d-kube-api-access-tv8wv\") pod \"payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv\" (UID: \"1e325950-4be5-4ca8-9b7c-365804945f9d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:05.048444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.048284    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f595acd9-184b-443a-8c78-78dfc41b06d2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-730be9-778974d799-cxwd6\" (UID: \"f595acd9-184b-443a-8c78-78dfc41b06d2\") " pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:05.048444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.048311    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e325950-4be5-4ca8-9b7c-365804945f9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv\" (UID: \"1e325950-4be5-4ca8-9b7c-365804945f9d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:05.048540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.048467    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6zsv\" (UniqueName: \"kubernetes.io/projected/f595acd9-184b-443a-8c78-78dfc41b06d2-kube-api-access-q6zsv\") pod \"payload-processing-e2e-api-a-730be9-778974d799-cxwd6\" (UID: \"f595acd9-184b-443a-8c78-78dfc41b06d2\") " pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:05.049061 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.049044    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e325950-4be5-4ca8-9b7c-365804945f9d-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv\" (UID: \"1e325950-4be5-4ca8-9b7c-365804945f9d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:05.057182 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.057163    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tv8wv\" (UniqueName: \"kubernetes.io/projected/1e325950-4be5-4ca8-9b7c-365804945f9d-kube-api-access-tv8wv\") pod \"payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv\" (UID: \"1e325950-4be5-4ca8-9b7c-365804945f9d\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:05.149510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.149424    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f595acd9-184b-443a-8c78-78dfc41b06d2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-730be9-778974d799-cxwd6\" (UID: \"f595acd9-184b-443a-8c78-78dfc41b06d2\") " pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:05.149510 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.149481    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6zsv\" (UniqueName: \"kubernetes.io/projected/f595acd9-184b-443a-8c78-78dfc41b06d2-kube-api-access-q6zsv\") pod \"payload-processing-e2e-api-a-730be9-778974d799-cxwd6\" (UID: \"f595acd9-184b-443a-8c78-78dfc41b06d2\") " pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:05.150126 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.150105    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f595acd9-184b-443a-8c78-78dfc41b06d2-plugins-config-volume\") pod \"payload-processing-e2e-api-a-730be9-778974d799-cxwd6\" (UID: \"f595acd9-184b-443a-8c78-78dfc41b06d2\") " pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:05.158398 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.158375    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6zsv\" (UniqueName: \"kubernetes.io/projected/f595acd9-184b-443a-8c78-78dfc41b06d2-kube-api-access-q6zsv\") pod \"payload-processing-e2e-api-a-730be9-778974d799-cxwd6\" (UID: \"f595acd9-184b-443a-8c78-78dfc41b06d2\") " pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:05.192881 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.192853    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:05.216312 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.216280    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:05.466269 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.466244    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"]
Sep 15 09:31:05.468348 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:31:05.468324    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e325950_4be5_4ca8_9b7c_365804945f9d.slice/crio-c1c3c1ef3e8f4089872647d94f85e493f4cd69833f7ae25be96fe26b8ad97dde WatchSource:0}: Error finding container c1c3c1ef3e8f4089872647d94f85e493f4cd69833f7ae25be96fe26b8ad97dde: Status 404 returned error can't find the container with id c1c3c1ef3e8f4089872647d94f85e493f4cd69833f7ae25be96fe26b8ad97dde
Sep 15 09:31:05.498629 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.498605    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"]
Sep 15 09:31:05.504035 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:31:05.504004    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf595acd9_184b_443a_8c78_78dfc41b06d2.slice/crio-3f7fef851c2f1650a5084fcbc2dd61b1b8a072caa039d96ac542eabdb70f0b49 WatchSource:0}: Error finding container 3f7fef851c2f1650a5084fcbc2dd61b1b8a072caa039d96ac542eabdb70f0b49: Status 404 returned error can't find the container with id 3f7fef851c2f1650a5084fcbc2dd61b1b8a072caa039d96ac542eabdb70f0b49
Sep 15 09:31:05.707065 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.707029    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv" event={"ID":"1e325950-4be5-4ca8-9b7c-365804945f9d","Type":"ContainerStarted","Data":"cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11"}
Sep 15 09:31:05.707266 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.707096    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv" event={"ID":"1e325950-4be5-4ca8-9b7c-365804945f9d","Type":"ContainerStarted","Data":"c1c3c1ef3e8f4089872647d94f85e493f4cd69833f7ae25be96fe26b8ad97dde"}
Sep 15 09:31:05.707266 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.707229    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:05.709037 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.709012    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6" event={"ID":"f595acd9-184b-443a-8c78-78dfc41b06d2","Type":"ContainerStarted","Data":"e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92"}
Sep 15 09:31:05.709157 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.709049    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6" event={"ID":"f595acd9-184b-443a-8c78-78dfc41b06d2","Type":"ContainerStarted","Data":"3f7fef851c2f1650a5084fcbc2dd61b1b8a072caa039d96ac542eabdb70f0b49"}
Sep 15 09:31:05.709157 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.709101    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:05.725079 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.724989    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv" podStartSLOduration=1.724974918 podStartE2EDuration="1.724974918s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:05.72250763 +0000 UTC m=+1441.486079092" watchObservedRunningTime="2026-09-15 09:31:05.724974918 +0000 UTC m=+1441.488546365"
Sep 15 09:31:05.740576 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:05.740533    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6" podStartSLOduration=1.740520929 podStartE2EDuration="1.740520929s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:05.73839153 +0000 UTC m=+1441.501963010" watchObservedRunningTime="2026-09-15 09:31:05.740520929 +0000 UTC m=+1441.504092377"
Sep 15 09:31:16.717036 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:16.717003    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:31:16.717540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:16.717113    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:31:30.430816 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:30.429728    2568 patch_prober.go:28] interesting pod/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": read tcp 10.134.0.2:42376->10.134.0.73:15021: read: connection reset by peer" start-of-body=
Sep 15 09:31:30.430816 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:30.429831    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": read tcp 10.134.0.2:42376->10.134.0.73:15021: read: connection reset by peer"
Sep 15 09:31:30.859752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:30.859667    2568 generic.go:356] "Generic (PLEG): container finished" podID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerID="3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2" exitCode=0
Sep 15 09:31:30.859928 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:30.859747    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" event={"ID":"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0","Type":"ContainerDied","Data":"3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2"}
Sep 15 09:31:30.860199 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:30.860186    2568 scope.go:117] "RemoveContainer" containerID="3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2"
Sep 15 09:31:30.861461 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:30.861434    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:31:30.861522 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:30.861509    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:31:30.861559 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:30.861550    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:31:31.867472 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:31.867438    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" event={"ID":"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0","Type":"ContainerStarted","Data":"3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855"}
Sep 15 09:31:32.721743 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:32.721704    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:31:32.721960 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:32.721880    2568 patch_prober.go:28] interesting pod/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 15 09:31:32.721960 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:32.721927    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 15 09:31:33.721712 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:33.721673    2568 patch_prober.go:28] interesting pod/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 15 09:31:33.722236 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:33.721776    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 15 09:31:34.722037 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:34.722000    2568 patch_prober.go:28] interesting pod/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 15 09:31:34.722411 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:34.722052    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 15 09:31:35.721362 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:35.721321    2568 patch_prober.go:28] interesting pod/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 15 09:31:35.721572 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:35.721384    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 15 09:31:36.721477 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:36.721440    2568 patch_prober.go:28] interesting pod/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 15 09:31:36.722082 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:36.722051    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 15 09:31:37.722067 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:37.722033    2568 patch_prober.go:28] interesting pod/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused" start-of-body=
Sep 15 09:31:37.722485 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:37.722091    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.73:15021/healthz/ready\": dial tcp 10.134.0.73:15021: connect: connection refused"
Sep 15 09:31:38.726016 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:38.725985    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:31:38.726398 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:38.726345    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:31:38.727063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:38.727044    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:31:40.206682 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.206654    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"]
Sep 15 09:31:40.210572 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.210554    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.213346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.213324    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-ff390e\""
Sep 15 09:31:40.213346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.213336    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-ff390e-dockercfg-wmtf8\""
Sep 15 09:31:40.221158 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.221137    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"]
Sep 15 09:31:40.306357 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.306316    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-72l2k\" (UniqueName: \"kubernetes.io/projected/70bd5a3e-c524-40de-979a-773e0987f1f0-kube-api-access-72l2k\") pod \"payload-processing-e2e-api-b-ff390e-58c965479-4kdff\" (UID: \"70bd5a3e-c524-40de-979a-773e0987f1f0\") " pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.306545 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.306459    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70bd5a3e-c524-40de-979a-773e0987f1f0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ff390e-58c965479-4kdff\" (UID: \"70bd5a3e-c524-40de-979a-773e0987f1f0\") " pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.407201 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.407160    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70bd5a3e-c524-40de-979a-773e0987f1f0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ff390e-58c965479-4kdff\" (UID: \"70bd5a3e-c524-40de-979a-773e0987f1f0\") " pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.408319 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.408290    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70bd5a3e-c524-40de-979a-773e0987f1f0-plugins-config-volume\") pod \"payload-processing-e2e-api-b-ff390e-58c965479-4kdff\" (UID: \"70bd5a3e-c524-40de-979a-773e0987f1f0\") " pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.408485 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.408296    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-72l2k\" (UniqueName: \"kubernetes.io/projected/70bd5a3e-c524-40de-979a-773e0987f1f0-kube-api-access-72l2k\") pod \"payload-processing-e2e-api-b-ff390e-58c965479-4kdff\" (UID: \"70bd5a3e-c524-40de-979a-773e0987f1f0\") " pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.418031 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.417929    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-72l2k\" (UniqueName: \"kubernetes.io/projected/70bd5a3e-c524-40de-979a-773e0987f1f0-kube-api-access-72l2k\") pod \"payload-processing-e2e-api-b-ff390e-58c965479-4kdff\" (UID: \"70bd5a3e-c524-40de-979a-773e0987f1f0\") " pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.521261 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.521169    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.797044 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.797015    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"]
Sep 15 09:31:40.799234 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:31:40.799211    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bd5a3e_c524_40de_979a_773e0987f1f0.slice/crio-3a7eed334e6dccef8fc601dc048b5dfa851ebd748a453916cb02b5a12106cdb8 WatchSource:0}: Error finding container 3a7eed334e6dccef8fc601dc048b5dfa851ebd748a453916cb02b5a12106cdb8: Status 404 returned error can't find the container with id 3a7eed334e6dccef8fc601dc048b5dfa851ebd748a453916cb02b5a12106cdb8
Sep 15 09:31:40.919612 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.919583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff" event={"ID":"70bd5a3e-c524-40de-979a-773e0987f1f0","Type":"ContainerStarted","Data":"e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13"}
Sep 15 09:31:40.919787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.919636    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff" event={"ID":"70bd5a3e-c524-40de-979a-773e0987f1f0","Type":"ContainerStarted","Data":"3a7eed334e6dccef8fc601dc048b5dfa851ebd748a453916cb02b5a12106cdb8"}
Sep 15 09:31:40.919787 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.919666    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:40.938577 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:40.938528    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff" podStartSLOduration=0.938506245 podStartE2EDuration="938.506245ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:31:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:31:40.935488625 +0000 UTC m=+1476.699060074" watchObservedRunningTime="2026-09-15 09:31:40.938506245 +0000 UTC m=+1476.702077695"
Sep 15 09:31:43.248460 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.248424    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"]
Sep 15 09:31:43.252084 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.252069    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"
Sep 15 09:31:43.254952 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.254917    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:31:43.255078 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.254917    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:31:43.259965 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.259697    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"]
Sep 15 09:31:43.438464 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.438427    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1cee8d-0e72-405f-9fb8-f92e19138764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn\" (UID: \"7d1cee8d-0e72-405f-9fb8-f92e19138764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"
Sep 15 09:31:43.539370 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.539280    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1cee8d-0e72-405f-9fb8-f92e19138764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn\" (UID: \"7d1cee8d-0e72-405f-9fb8-f92e19138764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"
Sep 15 09:31:43.539955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.539932    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1cee8d-0e72-405f-9fb8-f92e19138764-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn\" (UID: \"7d1cee8d-0e72-405f-9fb8-f92e19138764\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"
Sep 15 09:31:43.564422 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.564391    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"
Sep 15 09:31:43.842254 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.842177    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"]
Sep 15 09:31:43.842458 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:31:43.842432    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d1cee8d_0e72_405f_9fb8_f92e19138764.slice/crio-484a98b58094b6cac76fb1a7bd670ba817491473ef030558c81bb07ed3183a43 WatchSource:0}: Error finding container 484a98b58094b6cac76fb1a7bd670ba817491473ef030558c81bb07ed3183a43: Status 404 returned error can't find the container with id 484a98b58094b6cac76fb1a7bd670ba817491473ef030558c81bb07ed3183a43
Sep 15 09:31:43.937770 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:43.937737    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn" event={"ID":"7d1cee8d-0e72-405f-9fb8-f92e19138764","Type":"ContainerStarted","Data":"484a98b58094b6cac76fb1a7bd670ba817491473ef030558c81bb07ed3183a43"}
Sep 15 09:31:44.945114 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:44.945078    2568 generic.go:356] "Generic (PLEG): container finished" podID="7d1cee8d-0e72-405f-9fb8-f92e19138764" containerID="d1d75cb2ef72780b0e70fb6028bbae5e14462375d079e6dae10a271b7445fca4" exitCode=0
Sep 15 09:31:44.945513 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:44.945171    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn" event={"ID":"7d1cee8d-0e72-405f-9fb8-f92e19138764","Type":"ContainerDied","Data":"d1d75cb2ef72780b0e70fb6028bbae5e14462375d079e6dae10a271b7445fca4"}
Sep 15 09:31:46.089030 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:46.089005    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"
Sep 15 09:31:46.164709 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:46.164665    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1cee8d-0e72-405f-9fb8-f92e19138764-maas-api-service-ca\") pod \"7d1cee8d-0e72-405f-9fb8-f92e19138764\" (UID: \"7d1cee8d-0e72-405f-9fb8-f92e19138764\") "
Sep 15 09:31:46.165073 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:46.165051    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7d1cee8d-0e72-405f-9fb8-f92e19138764-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7d1cee8d-0e72-405f-9fb8-f92e19138764" (UID: "7d1cee8d-0e72-405f-9fb8-f92e19138764"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:31:46.266225 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:46.266143    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7d1cee8d-0e72-405f-9fb8-f92e19138764-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:31:46.959721 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:46.959694    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"
Sep 15 09:31:46.959903 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:46.959731    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn" event={"ID":"7d1cee8d-0e72-405f-9fb8-f92e19138764","Type":"ContainerDied","Data":"484a98b58094b6cac76fb1a7bd670ba817491473ef030558c81bb07ed3183a43"}
Sep 15 09:31:46.959903 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:46.959773    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="484a98b58094b6cac76fb1a7bd670ba817491473ef030558c81bb07ed3183a43"
Sep 15 09:31:48.127997 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:48.127963    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"]
Sep 15 09:31:51.927915 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:51.927882    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:31:56.234018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.233981    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"]
Sep 15 09:31:56.234613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.234593    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7d1cee8d-0e72-405f-9fb8-f92e19138764" containerName="revoke-keys"
Sep 15 09:31:56.234702 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.234617    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="7d1cee8d-0e72-405f-9fb8-f92e19138764" containerName="revoke-keys"
Sep 15 09:31:56.234757 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.234708    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="7d1cee8d-0e72-405f-9fb8-f92e19138764" containerName="revoke-keys"
Sep 15 09:31:56.237951 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.237931    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"
Sep 15 09:31:56.240548 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.240529    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:31:56.240643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.240573    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:31:56.245462 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.245440    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"]
Sep 15 09:31:56.264998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.264965    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633237b8-fce2-4ab3-93f2-d2a9ea1de447-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-730be9-gmzj9\" (UID: \"633237b8-fce2-4ab3-93f2-d2a9ea1de447\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"
Sep 15 09:31:56.365636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.365599    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633237b8-fce2-4ab3-93f2-d2a9ea1de447-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-730be9-gmzj9\" (UID: \"633237b8-fce2-4ab3-93f2-d2a9ea1de447\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"
Sep 15 09:31:56.366247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.366230    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633237b8-fce2-4ab3-93f2-d2a9ea1de447-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-730be9-gmzj9\" (UID: \"633237b8-fce2-4ab3-93f2-d2a9ea1de447\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"
Sep 15 09:31:56.550376 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.550289    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"
Sep 15 09:31:56.830469 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:56.830442    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"]
Sep 15 09:31:56.832353 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:31:56.832328    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod633237b8_fce2_4ab3_93f2_d2a9ea1de447.slice/crio-cbdfd34ac83cb77f41d1a923f763e4824ec9dd78c2ee3f8ade3f0e30aebe0856 WatchSource:0}: Error finding container cbdfd34ac83cb77f41d1a923f763e4824ec9dd78c2ee3f8ade3f0e30aebe0856: Status 404 returned error can't find the container with id cbdfd34ac83cb77f41d1a923f763e4824ec9dd78c2ee3f8ade3f0e30aebe0856
Sep 15 09:31:57.018654 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:57.018619    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9" event={"ID":"633237b8-fce2-4ab3-93f2-d2a9ea1de447","Type":"ContainerStarted","Data":"cbdfd34ac83cb77f41d1a923f763e4824ec9dd78c2ee3f8ade3f0e30aebe0856"}
Sep 15 09:31:58.026523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:58.026488    2568 generic.go:356] "Generic (PLEG): container finished" podID="633237b8-fce2-4ab3-93f2-d2a9ea1de447" containerID="ae73918939bf4afae1148ac27379d3f76ac977c7d023129a8f3af6fdb44c5b6e" exitCode=0
Sep 15 09:31:58.026937 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:58.026573    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9" event={"ID":"633237b8-fce2-4ab3-93f2-d2a9ea1de447","Type":"ContainerDied","Data":"ae73918939bf4afae1148ac27379d3f76ac977c7d023129a8f3af6fdb44c5b6e"}
Sep 15 09:31:59.179569 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:59.179542    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"
Sep 15 09:31:59.294811 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:59.294717    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633237b8-fce2-4ab3-93f2-d2a9ea1de447-maas-api-service-ca\") pod \"633237b8-fce2-4ab3-93f2-d2a9ea1de447\" (UID: \"633237b8-fce2-4ab3-93f2-d2a9ea1de447\") "
Sep 15 09:31:59.295122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:59.295101    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/633237b8-fce2-4ab3-93f2-d2a9ea1de447-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "633237b8-fce2-4ab3-93f2-d2a9ea1de447" (UID: "633237b8-fce2-4ab3-93f2-d2a9ea1de447"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:31:59.395740 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:31:59.395695    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/633237b8-fce2-4ab3-93f2-d2a9ea1de447-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:00.040423 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:00.040377    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9" event={"ID":"633237b8-fce2-4ab3-93f2-d2a9ea1de447","Type":"ContainerDied","Data":"cbdfd34ac83cb77f41d1a923f763e4824ec9dd78c2ee3f8ade3f0e30aebe0856"}
Sep 15 09:32:00.040640 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:00.040456    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cbdfd34ac83cb77f41d1a923f763e4824ec9dd78c2ee3f8ade3f0e30aebe0856"
Sep 15 09:32:00.040640 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:00.040389    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"
Sep 15 09:32:03.150588 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.150542    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22" podUID="75d868d0-37d6-4b52-9c29-59338845c9fb" containerName="main" containerID="cri-o://78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b" gracePeriod=45
Sep 15 09:32:03.417024 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.416997    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:32:03.536297 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536259    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d868d0-37d6-4b52-9c29-59338845c9fb-tls-certs\") pod \"75d868d0-37d6-4b52-9c29-59338845c9fb\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") "
Sep 15 09:32:03.536482 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536313    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w72j\" (UniqueName: \"kubernetes.io/projected/75d868d0-37d6-4b52-9c29-59338845c9fb-kube-api-access-4w72j\") pod \"75d868d0-37d6-4b52-9c29-59338845c9fb\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") "
Sep 15 09:32:03.536482 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536388    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-model-cache\") pod \"75d868d0-37d6-4b52-9c29-59338845c9fb\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") "
Sep 15 09:32:03.536599 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536488    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-dshm\") pod \"75d868d0-37d6-4b52-9c29-59338845c9fb\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") "
Sep 15 09:32:03.536599 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536510    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-home\") pod \"75d868d0-37d6-4b52-9c29-59338845c9fb\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") "
Sep 15 09:32:03.536599 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536536    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-tmp-dir\") pod \"75d868d0-37d6-4b52-9c29-59338845c9fb\" (UID: \"75d868d0-37d6-4b52-9c29-59338845c9fb\") "
Sep 15 09:32:03.536599 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536573    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-model-cache" (OuterVolumeSpecName: "model-cache") pod "75d868d0-37d6-4b52-9c29-59338845c9fb" (UID: "75d868d0-37d6-4b52-9c29-59338845c9fb"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:03.536798 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536776    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "75d868d0-37d6-4b52-9c29-59338845c9fb" (UID: "75d868d0-37d6-4b52-9c29-59338845c9fb"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:03.536798 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536786    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-home" (OuterVolumeSpecName: "home") pod "75d868d0-37d6-4b52-9c29-59338845c9fb" (UID: "75d868d0-37d6-4b52-9c29-59338845c9fb"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:03.537010 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.536993    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-model-cache\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.537059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.537017    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-home\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.537059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.537030    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-tmp-dir\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.538957 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.538932    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/75d868d0-37d6-4b52-9c29-59338845c9fb-kube-api-access-4w72j" (OuterVolumeSpecName: "kube-api-access-4w72j") pod "75d868d0-37d6-4b52-9c29-59338845c9fb" (UID: "75d868d0-37d6-4b52-9c29-59338845c9fb"). InnerVolumeSpecName "kube-api-access-4w72j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:03.539132 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.539109    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-dshm" (OuterVolumeSpecName: "dshm") pod "75d868d0-37d6-4b52-9c29-59338845c9fb" (UID: "75d868d0-37d6-4b52-9c29-59338845c9fb"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:03.539206 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.539155    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/75d868d0-37d6-4b52-9c29-59338845c9fb-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "75d868d0-37d6-4b52-9c29-59338845c9fb" (UID: "75d868d0-37d6-4b52-9c29-59338845c9fb"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:32:03.637516 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.637486    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/75d868d0-37d6-4b52-9c29-59338845c9fb-tls-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.637516 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.637513    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w72j\" (UniqueName: \"kubernetes.io/projected/75d868d0-37d6-4b52-9c29-59338845c9fb-kube-api-access-4w72j\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:03.637516 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:03.637523    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/75d868d0-37d6-4b52-9c29-59338845c9fb-dshm\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.064592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.064555    2568 generic.go:356] "Generic (PLEG): container finished" podID="75d868d0-37d6-4b52-9c29-59338845c9fb" containerID="78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b" exitCode=0
Sep 15 09:32:04.064772 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.064599    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"
Sep 15 09:32:04.064772 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.064603    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22" event={"ID":"75d868d0-37d6-4b52-9c29-59338845c9fb","Type":"ContainerDied","Data":"78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b"}
Sep 15 09:32:04.064772 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.064726    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22" event={"ID":"75d868d0-37d6-4b52-9c29-59338845c9fb","Type":"ContainerDied","Data":"d33b4b8690d055666b5c83fa07cc2d237bff982e153443d26a94f929c8324634"}
Sep 15 09:32:04.064772 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.064749    2568 scope.go:117] "RemoveContainer" containerID="78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b"
Sep 15 09:32:04.080898 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.080876    2568 scope.go:117] "RemoveContainer" containerID="78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b"
Sep 15 09:32:04.081229 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:04.081209    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b\": container with ID starting with 78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b not found: ID does not exist" containerID="78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b"
Sep 15 09:32:04.081298 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.081242    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b"} err="failed to get container status \"78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b\": rpc error: code = NotFound desc = could not find container \"78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b\": container with ID starting with 78078da60fd75a5761654cdee354c0499effcef02a5a8e9fd6510e9c38731a3b not found: ID does not exist"
Sep 15 09:32:04.090763 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.090735    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"]
Sep 15 09:32:04.094367 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.094339    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["e2e-models-e2e-worker-w0-ffb593/distinct-w0-ffb593-kserve-77bc76c6b-x5f22"]
Sep 15 09:32:04.449898 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.449833    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"]
Sep 15 09:32:04.450362 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.450140    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll" podUID="08ad40ba-7a64-4d54-b89a-9b527847a240" containerName="payload-processing" containerID="cri-o://2c042846ba2a11a43e5caef3ad2d2661b8f53df4b56a48b83651adbf11f02dac" gracePeriod=30
Sep 15 09:32:04.459032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.459004    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"]
Sep 15 09:32:04.459257 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.459232    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd" podUID="9c958b7d-6826-4a5f-b3f7-3e6871faedbe" containerName="payload-pre-processing" containerID="cri-o://a1a1245d19af1a7f55c51c9b50f53fbd400368f974b9b21af8e76c5b4f613b5e" gracePeriod=30
Sep 15 09:32:04.621909 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.621855    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"]
Sep 15 09:32:04.626754 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.626733    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w0-ffb593-lhmjn"]
Sep 15 09:32:04.736135 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.736099    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:32:04.772711 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.772683    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:32:04.788613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.788579    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="75d868d0-37d6-4b52-9c29-59338845c9fb" path="/var/lib/kubelet/pods/75d868d0-37d6-4b52-9c29-59338845c9fb/volumes"
Sep 15 09:32:04.789593 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.789440    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7d1cee8d-0e72-405f-9fb8-f92e19138764" path="/var/lib/kubelet/pods/7d1cee8d-0e72-405f-9fb8-f92e19138764/volumes"
Sep 15 09:32:04.850192 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.850162    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08ad40ba-7a64-4d54-b89a-9b527847a240-plugins-config-volume\") pod \"08ad40ba-7a64-4d54-b89a-9b527847a240\" (UID: \"08ad40ba-7a64-4d54-b89a-9b527847a240\") "
Sep 15 09:32:04.850358 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.850209    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-plugins-config-volume\") pod \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\" (UID: \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\") "
Sep 15 09:32:04.850358 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.850272    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w9gwl\" (UniqueName: \"kubernetes.io/projected/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-kube-api-access-w9gwl\") pod \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\" (UID: \"9c958b7d-6826-4a5f-b3f7-3e6871faedbe\") "
Sep 15 09:32:04.850358 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.850353    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k5mxj\" (UniqueName: \"kubernetes.io/projected/08ad40ba-7a64-4d54-b89a-9b527847a240-kube-api-access-k5mxj\") pod \"08ad40ba-7a64-4d54-b89a-9b527847a240\" (UID: \"08ad40ba-7a64-4d54-b89a-9b527847a240\") "
Sep 15 09:32:04.850623 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.850596    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08ad40ba-7a64-4d54-b89a-9b527847a240-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "08ad40ba-7a64-4d54-b89a-9b527847a240" (UID: "08ad40ba-7a64-4d54-b89a-9b527847a240"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:04.850696 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.850666    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c958b7d-6826-4a5f-b3f7-3e6871faedbe" (UID: "9c958b7d-6826-4a5f-b3f7-3e6871faedbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:04.852586 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.852558    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-kube-api-access-w9gwl" (OuterVolumeSpecName: "kube-api-access-w9gwl") pod "9c958b7d-6826-4a5f-b3f7-3e6871faedbe" (UID: "9c958b7d-6826-4a5f-b3f7-3e6871faedbe"). InnerVolumeSpecName "kube-api-access-w9gwl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:04.852707 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.852684    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08ad40ba-7a64-4d54-b89a-9b527847a240-kube-api-access-k5mxj" (OuterVolumeSpecName: "kube-api-access-k5mxj") pod "08ad40ba-7a64-4d54-b89a-9b527847a240" (UID: "08ad40ba-7a64-4d54-b89a-9b527847a240"). InnerVolumeSpecName "kube-api-access-k5mxj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:04.951919 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.951881    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k5mxj\" (UniqueName: \"kubernetes.io/projected/08ad40ba-7a64-4d54-b89a-9b527847a240-kube-api-access-k5mxj\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.951919 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.951912    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08ad40ba-7a64-4d54-b89a-9b527847a240-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.951919 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.951924    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:04.952156 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:04.951936    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w9gwl\" (UniqueName: \"kubernetes.io/projected/9c958b7d-6826-4a5f-b3f7-3e6871faedbe-kube-api-access-w9gwl\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:05.004957 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.004869    2568 scope.go:117] "RemoveContainer" containerID="6645fb1809d692b60f1e63e8cd16e9edbdc09dda5def78d790c148f60524cb3a"
Sep 15 09:32:05.014424 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.014403    2568 scope.go:117] "RemoveContainer" containerID="6929db07d573728044c63a094033384db515b4ccbd2fa9162d703b4e57564466"
Sep 15 09:32:05.023546 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.023519    2568 scope.go:117] "RemoveContainer" containerID="2c042846ba2a11a43e5caef3ad2d2661b8f53df4b56a48b83651adbf11f02dac"
Sep 15 09:32:05.031912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.031888    2568 scope.go:117] "RemoveContainer" containerID="a1a1245d19af1a7f55c51c9b50f53fbd400368f974b9b21af8e76c5b4f613b5e"
Sep 15 09:32:05.069083 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.069052    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd" event={"ID":"9c958b7d-6826-4a5f-b3f7-3e6871faedbe","Type":"ContainerDied","Data":"a1a1245d19af1a7f55c51c9b50f53fbd400368f974b9b21af8e76c5b4f613b5e"}
Sep 15 09:32:05.069202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.069102    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"
Sep 15 09:32:05.069202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.069112    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"
Sep 15 09:32:05.069202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.069114    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd" event={"ID":"9c958b7d-6826-4a5f-b3f7-3e6871faedbe","Type":"ContainerDied","Data":"955ce58dfef978e1899ef8b3d121fefa3a92e5091a85a9aede56c90bbe05f5ec"}
Sep 15 09:32:05.069202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.069174    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll" event={"ID":"08ad40ba-7a64-4d54-b89a-9b527847a240","Type":"ContainerDied","Data":"2c042846ba2a11a43e5caef3ad2d2661b8f53df4b56a48b83651adbf11f02dac"}
Sep 15 09:32:05.069442 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.069217    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll" event={"ID":"08ad40ba-7a64-4d54-b89a-9b527847a240","Type":"ContainerDied","Data":"d4363f16bef63de083a2ab29160d4519dc76c672c7f8c9f0b5695df779028c04"}
Sep 15 09:32:05.098011 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.097976    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"]
Sep 15 09:32:05.101506 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.101475    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w0-ffb593-84c69bdf54-9nbfd"]
Sep 15 09:32:05.126053 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.126025    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"]
Sep 15 09:32:05.131945 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:05.131921    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-worker-w0-ffb593-79cfbcc885-6v9ll"]
Sep 15 09:32:06.786731 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:06.786701    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08ad40ba-7a64-4d54-b89a-9b527847a240" path="/var/lib/kubelet/pods/08ad40ba-7a64-4d54-b89a-9b527847a240/volumes"
Sep 15 09:32:06.787128 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:06.787113    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c958b7d-6826-4a5f-b3f7-3e6871faedbe" path="/var/lib/kubelet/pods/9c958b7d-6826-4a5f-b3f7-3e6871faedbe/volumes"
Sep 15 09:32:10.799085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:10.799040    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"]
Sep 15 09:32:10.799625 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:10.799295    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy" containerID="cri-o://23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc" gracePeriod=30
Sep 15 09:32:11.945367 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:11.945332    2568 patch_prober.go:28] interesting pod/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:32:11.945714 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:11.945394    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:32:15.149240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.149186    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"]
Sep 15 09:32:15.149722 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.149459    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6" podUID="f595acd9-184b-443a-8c78-78dfc41b06d2" containerName="payload-processing" containerID="cri-o://e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92" gracePeriod=30
Sep 15 09:32:15.159372 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.159349    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"]
Sep 15 09:32:15.159581 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.159560    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv" podUID="1e325950-4be5-4ca8-9b7c-365804945f9d" containerName="payload-pre-processing" containerID="cri-o://cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11" gracePeriod=30
Sep 15 09:32:15.325157 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.323465    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"]
Sep 15 09:32:15.329581 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.329361    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-730be9-gmzj9"]
Sep 15 09:32:15.429900 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.429876    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:32:15.454560 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.454536    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:32:15.561835 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.561793    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e325950-4be5-4ca8-9b7c-365804945f9d-plugins-config-volume\") pod \"1e325950-4be5-4ca8-9b7c-365804945f9d\" (UID: \"1e325950-4be5-4ca8-9b7c-365804945f9d\") "
Sep 15 09:32:15.562018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.561923    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tv8wv\" (UniqueName: \"kubernetes.io/projected/1e325950-4be5-4ca8-9b7c-365804945f9d-kube-api-access-tv8wv\") pod \"1e325950-4be5-4ca8-9b7c-365804945f9d\" (UID: \"1e325950-4be5-4ca8-9b7c-365804945f9d\") "
Sep 15 09:32:15.562065 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.562029    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f595acd9-184b-443a-8c78-78dfc41b06d2-plugins-config-volume\") pod \"f595acd9-184b-443a-8c78-78dfc41b06d2\" (UID: \"f595acd9-184b-443a-8c78-78dfc41b06d2\") "
Sep 15 09:32:15.562065 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.562059    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q6zsv\" (UniqueName: \"kubernetes.io/projected/f595acd9-184b-443a-8c78-78dfc41b06d2-kube-api-access-q6zsv\") pod \"f595acd9-184b-443a-8c78-78dfc41b06d2\" (UID: \"f595acd9-184b-443a-8c78-78dfc41b06d2\") "
Sep 15 09:32:15.562264 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.562233    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1e325950-4be5-4ca8-9b7c-365804945f9d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1e325950-4be5-4ca8-9b7c-365804945f9d" (UID: "1e325950-4be5-4ca8-9b7c-365804945f9d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:15.562388 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.562364    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f595acd9-184b-443a-8c78-78dfc41b06d2-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f595acd9-184b-443a-8c78-78dfc41b06d2" (UID: "f595acd9-184b-443a-8c78-78dfc41b06d2"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:15.562468 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.562448    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1e325950-4be5-4ca8-9b7c-365804945f9d-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:15.564356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.564334    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f595acd9-184b-443a-8c78-78dfc41b06d2-kube-api-access-q6zsv" (OuterVolumeSpecName: "kube-api-access-q6zsv") pod "f595acd9-184b-443a-8c78-78dfc41b06d2" (UID: "f595acd9-184b-443a-8c78-78dfc41b06d2"). InnerVolumeSpecName "kube-api-access-q6zsv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:15.564664 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.564633    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e325950-4be5-4ca8-9b7c-365804945f9d-kube-api-access-tv8wv" (OuterVolumeSpecName: "kube-api-access-tv8wv") pod "1e325950-4be5-4ca8-9b7c-365804945f9d" (UID: "1e325950-4be5-4ca8-9b7c-365804945f9d"). InnerVolumeSpecName "kube-api-access-tv8wv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:15.663797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.663766    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f595acd9-184b-443a-8c78-78dfc41b06d2-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:15.663797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.663798    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q6zsv\" (UniqueName: \"kubernetes.io/projected/f595acd9-184b-443a-8c78-78dfc41b06d2-kube-api-access-q6zsv\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:15.664018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:15.663807    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tv8wv\" (UniqueName: \"kubernetes.io/projected/1e325950-4be5-4ca8-9b7c-365804945f9d-kube-api-access-tv8wv\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.042063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.042038    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:32:16.129789 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.129750    2568 generic.go:356] "Generic (PLEG): container finished" podID="1e325950-4be5-4ca8-9b7c-365804945f9d" containerID="cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11" exitCode=0
Sep 15 09:32:16.130020 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.129797    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"
Sep 15 09:32:16.130020 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.129832    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv" event={"ID":"1e325950-4be5-4ca8-9b7c-365804945f9d","Type":"ContainerDied","Data":"cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11"}
Sep 15 09:32:16.130020 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.129917    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv" event={"ID":"1e325950-4be5-4ca8-9b7c-365804945f9d","Type":"ContainerDied","Data":"c1c3c1ef3e8f4089872647d94f85e493f4cd69833f7ae25be96fe26b8ad97dde"}
Sep 15 09:32:16.130020 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.129952    2568 scope.go:117] "RemoveContainer" containerID="cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11"
Sep 15 09:32:16.131317 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.131293    2568 generic.go:356] "Generic (PLEG): container finished" podID="f595acd9-184b-443a-8c78-78dfc41b06d2" containerID="e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92" exitCode=0
Sep 15 09:32:16.131465 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.131333    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"
Sep 15 09:32:16.131465 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.131383    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6" event={"ID":"f595acd9-184b-443a-8c78-78dfc41b06d2","Type":"ContainerDied","Data":"e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92"}
Sep 15 09:32:16.131465 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.131456    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6" event={"ID":"f595acd9-184b-443a-8c78-78dfc41b06d2","Type":"ContainerDied","Data":"3f7fef851c2f1650a5084fcbc2dd61b1b8a072caa039d96ac542eabdb70f0b49"}
Sep 15 09:32:16.133568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.133541    2568 generic.go:356] "Generic (PLEG): container finished" podID="2c557059-43be-45ae-afc3-09489b3d264a" containerID="23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc" exitCode=0
Sep 15 09:32:16.133661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.133582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" event={"ID":"2c557059-43be-45ae-afc3-09489b3d264a","Type":"ContainerDied","Data":"23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc"}
Sep 15 09:32:16.133661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.133600    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"
Sep 15 09:32:16.133661 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.133625    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc" event={"ID":"2c557059-43be-45ae-afc3-09489b3d264a","Type":"ContainerDied","Data":"46df280587b2edcf21f4675e92ec16be9fca8bed5e2512bca3c04203f159a8d9"}
Sep 15 09:32:16.140620 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.140601    2568 scope.go:117] "RemoveContainer" containerID="cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11"
Sep 15 09:32:16.141057 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:16.141033    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11\": container with ID starting with cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11 not found: ID does not exist" containerID="cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11"
Sep 15 09:32:16.141161 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.141066    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11"} err="failed to get container status \"cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11\": rpc error: code = NotFound desc = could not find container \"cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11\": container with ID starting with cbdf592c92964168786da1428a2382b4ac4e44df60a2c299397ca804a26c2f11 not found: ID does not exist"
Sep 15 09:32:16.141161 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.141084    2568 scope.go:117] "RemoveContainer" containerID="e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92"
Sep 15 09:32:16.149962 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.149944    2568 scope.go:117] "RemoveContainer" containerID="e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92"
Sep 15 09:32:16.150252 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:16.150223    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92\": container with ID starting with e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92 not found: ID does not exist" containerID="e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92"
Sep 15 09:32:16.150296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.150249    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92"} err="failed to get container status \"e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92\": rpc error: code = NotFound desc = could not find container \"e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92\": container with ID starting with e1fce3fb07dee62903e29573b48f30366423ffd610a148a8f2fb74ddd60c9e92 not found: ID does not exist"
Sep 15 09:32:16.150296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.150265    2568 scope.go:117] "RemoveContainer" containerID="23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc"
Sep 15 09:32:16.158706 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.158687    2568 scope.go:117] "RemoveContainer" containerID="21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c"
Sep 15 09:32:16.161984 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.161961    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"]
Sep 15 09:32:16.166221 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.166199    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-730be9-fbf95b67d-sttgv"]
Sep 15 09:32:16.169371 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169348    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-data\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.169493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169437    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-envoy\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.169569 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169479    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c557059-43be-45ae-afc3-09489b3d264a-istiod-ca-cert\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.169569 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169534    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-socket\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.169677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169615    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nntv6\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-kube-api-access-nntv6\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.169677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169660    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c557059-43be-45ae-afc3-09489b3d264a-istio-podinfo\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.169781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169686    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-istio-token\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.169781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169695    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-data" (OuterVolumeSpecName: "istio-data") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:16.169781 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169724    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-credential-socket\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.169956 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169816    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-certs\") pod \"2c557059-43be-45ae-afc3-09489b3d264a\" (UID: \"2c557059-43be-45ae-afc3-09489b3d264a\") "
Sep 15 09:32:16.170022 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.169972    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:16.170151 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.170085    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2c557059-43be-45ae-afc3-09489b3d264a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:16.170527 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.170497    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:16.170648 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.170597    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.170648 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.170619    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.170648 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.170631    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2c557059-43be-45ae-afc3-09489b3d264a-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.170648 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.170645    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.171168 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.170719    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:16.172438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.172411    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:16.172613 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.172594    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-kube-api-access-nntv6" (OuterVolumeSpecName: "kube-api-access-nntv6") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "kube-api-access-nntv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:16.172745 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.172729    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2c557059-43be-45ae-afc3-09489b3d264a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:32:16.172800 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.172774    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-istio-token" (OuterVolumeSpecName: "istio-token") pod "2c557059-43be-45ae-afc3-09489b3d264a" (UID: "2c557059-43be-45ae-afc3-09489b3d264a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:16.181464 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.181443    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"]
Sep 15 09:32:16.188013 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.187991    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-730be9-778974d799-cxwd6"]
Sep 15 09:32:16.188674 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.188655    2568 scope.go:117] "RemoveContainer" containerID="23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc"
Sep 15 09:32:16.189049 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:16.189028    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc\": container with ID starting with 23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc not found: ID does not exist" containerID="23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc"
Sep 15 09:32:16.189148 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.189057    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc"} err="failed to get container status \"23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc\": rpc error: code = NotFound desc = could not find container \"23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc\": container with ID starting with 23d1dd03507124852c94fa71033fb98103407de05411a9de803de00b0b3482bc not found: ID does not exist"
Sep 15 09:32:16.189148 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.189074    2568 scope.go:117] "RemoveContainer" containerID="21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c"
Sep 15 09:32:16.189392 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:16.189375    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c\": container with ID starting with 21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c not found: ID does not exist" containerID="21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c"
Sep 15 09:32:16.189429 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.189400    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c"} err="failed to get container status \"21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c\": rpc error: code = NotFound desc = could not find container \"21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c\": container with ID starting with 21874efdeb717bf856e2487fd2c07ad587f1c728227f592b08eff69091fd8f5c not found: ID does not exist"
Sep 15 09:32:16.271481 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.271447    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nntv6\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-kube-api-access-nntv6\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.271481 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.271475    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2c557059-43be-45ae-afc3-09489b3d264a-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.271481 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.271484    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2c557059-43be-45ae-afc3-09489b3d264a-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.271699 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.271497    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.271699 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.271510    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2c557059-43be-45ae-afc3-09489b3d264a-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:16.460419 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.460390    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"]
Sep 15 09:32:16.465251 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.465227    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-worker-w0-ffb593-openshift-default-7b46bf998b-8jgqc"]
Sep 15 09:32:16.792784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.792701    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e325950-4be5-4ca8-9b7c-365804945f9d" path="/var/lib/kubelet/pods/1e325950-4be5-4ca8-9b7c-365804945f9d/volumes"
Sep 15 09:32:16.793255 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.793239    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2c557059-43be-45ae-afc3-09489b3d264a" path="/var/lib/kubelet/pods/2c557059-43be-45ae-afc3-09489b3d264a/volumes"
Sep 15 09:32:16.793643 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.793618    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="633237b8-fce2-4ab3-93f2-d2a9ea1de447" path="/var/lib/kubelet/pods/633237b8-fce2-4ab3-93f2-d2a9ea1de447/volumes"
Sep 15 09:32:16.793963 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:16.793951    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f595acd9-184b-443a-8c78-78dfc41b06d2" path="/var/lib/kubelet/pods/f595acd9-184b-443a-8c78-78dfc41b06d2/volumes"
Sep 15 09:32:21.539111 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.539076    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"]
Sep 15 09:32:21.539672 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.539324    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" containerID="cri-o://3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855" gracePeriod=30
Sep 15 09:32:21.887703 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.887618    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"]
Sep 15 09:32:21.888027 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888014    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="633237b8-fce2-4ab3-93f2-d2a9ea1de447" containerName="revoke-keys"
Sep 15 09:32:21.888027 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888028    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="633237b8-fce2-4ab3-93f2-d2a9ea1de447" containerName="revoke-keys"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888040    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c958b7d-6826-4a5f-b3f7-3e6871faedbe" containerName="payload-pre-processing"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888045    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c958b7d-6826-4a5f-b3f7-3e6871faedbe" containerName="payload-pre-processing"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888054    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e325950-4be5-4ca8-9b7c-365804945f9d" containerName="payload-pre-processing"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888061    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e325950-4be5-4ca8-9b7c-365804945f9d" containerName="payload-pre-processing"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888066    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888071    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888082    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f595acd9-184b-443a-8c78-78dfc41b06d2" containerName="payload-processing"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888087    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f595acd9-184b-443a-8c78-78dfc41b06d2" containerName="payload-processing"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888097    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="75d868d0-37d6-4b52-9c29-59338845c9fb" containerName="main"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888102    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="75d868d0-37d6-4b52-9c29-59338845c9fb" containerName="main"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888110    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08ad40ba-7a64-4d54-b89a-9b527847a240" containerName="payload-processing"
Sep 15 09:32:21.888129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888115    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="08ad40ba-7a64-4d54-b89a-9b527847a240" containerName="payload-processing"
Sep 15 09:32:21.888493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888173    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e325950-4be5-4ca8-9b7c-365804945f9d" containerName="payload-pre-processing"
Sep 15 09:32:21.888493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888180    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="08ad40ba-7a64-4d54-b89a-9b527847a240" containerName="payload-processing"
Sep 15 09:32:21.888493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888186    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f595acd9-184b-443a-8c78-78dfc41b06d2" containerName="payload-processing"
Sep 15 09:32:21.888493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888192    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="75d868d0-37d6-4b52-9c29-59338845c9fb" containerName="main"
Sep 15 09:32:21.888493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888197    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy"
Sep 15 09:32:21.888493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888202    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c958b7d-6826-4a5f-b3f7-3e6871faedbe" containerName="payload-pre-processing"
Sep 15 09:32:21.888493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888208    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy"
Sep 15 09:32:21.888493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.888213    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="633237b8-fce2-4ab3-93f2-d2a9ea1de447" containerName="revoke-keys"
Sep 15 09:32:21.893003 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.892984    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"
Sep 15 09:32:21.895878 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.895833    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:32:21.896279 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.896259    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:32:21.899211 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:21.899180    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"]
Sep 15 09:32:22.024147 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:22.024107    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f14c1236-d52b-4250-aa9f-39314b3deada-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ff390e-4592g\" (UID: \"f14c1236-d52b-4250-aa9f-39314b3deada\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"
Sep 15 09:32:22.125352 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:22.125266    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f14c1236-d52b-4250-aa9f-39314b3deada-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ff390e-4592g\" (UID: \"f14c1236-d52b-4250-aa9f-39314b3deada\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"
Sep 15 09:32:22.126013 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:22.125992    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f14c1236-d52b-4250-aa9f-39314b3deada-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-ff390e-4592g\" (UID: \"f14c1236-d52b-4250-aa9f-39314b3deada\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"
Sep 15 09:32:22.206595 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:22.206562    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"
Sep 15 09:32:22.476221 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:22.476194    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"]
Sep 15 09:32:22.478101 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:32:22.478075    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf14c1236_d52b_4250_aa9f_39314b3deada.slice/crio-52826fe876b9e402cc522f1f7f91c6d85dd91e6f72d94d5c8a613ecbdec5811a WatchSource:0}: Error finding container 52826fe876b9e402cc522f1f7f91c6d85dd91e6f72d94d5c8a613ecbdec5811a: Status 404 returned error can't find the container with id 52826fe876b9e402cc522f1f7f91c6d85dd91e6f72d94d5c8a613ecbdec5811a
Sep 15 09:32:23.172536 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:23.172502    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g" event={"ID":"f14c1236-d52b-4250-aa9f-39314b3deada","Type":"ContainerStarted","Data":"da5b7b57b84ccf08ab61df782ce4923c40c7df1bf7455290d4934a70c82aab2a"}
Sep 15 09:32:23.172928 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:23.172580    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g" event={"ID":"f14c1236-d52b-4250-aa9f-39314b3deada","Type":"ContainerStarted","Data":"52826fe876b9e402cc522f1f7f91c6d85dd91e6f72d94d5c8a613ecbdec5811a"}
Sep 15 09:32:23.186519 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:23.186468    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g" podStartSLOduration=2.186453978 podStartE2EDuration="2.186453978s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:32:23.185982286 +0000 UTC m=+1518.949553736" watchObservedRunningTime="2026-09-15 09:32:23.186453978 +0000 UTC m=+1518.950025426"
Sep 15 09:32:23.728983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:23.728942    2568 patch_prober.go:28] interesting pod/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:32:23.729154 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:23.729013    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:32:24.178918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:24.178878    2568 generic.go:356] "Generic (PLEG): container finished" podID="f14c1236-d52b-4250-aa9f-39314b3deada" containerID="da5b7b57b84ccf08ab61df782ce4923c40c7df1bf7455290d4934a70c82aab2a" exitCode=0
Sep 15 09:32:24.179294 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:24.179013    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g" event={"ID":"f14c1236-d52b-4250-aa9f-39314b3deada","Type":"ContainerDied","Data":"da5b7b57b84ccf08ab61df782ce4923c40c7df1bf7455290d4934a70c82aab2a"}
Sep 15 09:32:25.318998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:25.318977    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"
Sep 15 09:32:25.348293 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:25.348268    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f14c1236-d52b-4250-aa9f-39314b3deada-maas-api-service-ca\") pod \"f14c1236-d52b-4250-aa9f-39314b3deada\" (UID: \"f14c1236-d52b-4250-aa9f-39314b3deada\") "
Sep 15 09:32:25.348621 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:25.348598    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f14c1236-d52b-4250-aa9f-39314b3deada-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f14c1236-d52b-4250-aa9f-39314b3deada" (UID: "f14c1236-d52b-4250-aa9f-39314b3deada"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:25.449560 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:25.449461    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f14c1236-d52b-4250-aa9f-39314b3deada-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.191397 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.191372    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"
Sep 15 09:32:26.191579 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.191410    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g" event={"ID":"f14c1236-d52b-4250-aa9f-39314b3deada","Type":"ContainerDied","Data":"52826fe876b9e402cc522f1f7f91c6d85dd91e6f72d94d5c8a613ecbdec5811a"}
Sep 15 09:32:26.191579 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.191454    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52826fe876b9e402cc522f1f7f91c6d85dd91e6f72d94d5c8a613ecbdec5811a"
Sep 15 09:32:26.801604 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.801583    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:32:26.859812 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.859736    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-data\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.859812 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.859769    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-podinfo\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.859812 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.859790    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-envoy\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.860085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.859831    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-socket\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.860085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.859875    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gkn9\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-kube-api-access-2gkn9\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.860085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.859937    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istiod-ca-cert\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.860085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.859974    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-certs\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.860085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860017    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-credential-socket\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.860085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860049    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-token\") pod \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\" (UID: \"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0\") "
Sep 15 09:32:26.860403 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860090    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-data" (OuterVolumeSpecName: "istio-data") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:26.860403 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860209    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:26.860403 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860278    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:26.860403 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860298    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:26.860617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860447    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.860617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860490    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.860617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860504    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.860617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860512    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.860824 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.860615    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:26.862391 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.862358    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-token" (OuterVolumeSpecName: "istio-token") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:26.862647 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.862626    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:32:26.862647 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.862639    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:32:26.862775 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.862735    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-kube-api-access-2gkn9" (OuterVolumeSpecName: "kube-api-access-2gkn9") pod "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" (UID: "63e4f26b-42a0-4d50-adf6-b7196f9ff8d0"). InnerVolumeSpecName "kube-api-access-2gkn9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:26.961024 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.960986    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.961024 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.961017    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.961024 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.961030    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gkn9\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-kube-api-access-2gkn9\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.961277 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.961045    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:26.961277 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:26.961057    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:27.198263 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.198232    2568 generic.go:356] "Generic (PLEG): container finished" podID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerID="3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855" exitCode=0
Sep 15 09:32:27.198426 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.198285    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"
Sep 15 09:32:27.198426 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.198326    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" event={"ID":"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0","Type":"ContainerDied","Data":"3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855"}
Sep 15 09:32:27.198426 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.198381    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt" event={"ID":"63e4f26b-42a0-4d50-adf6-b7196f9ff8d0","Type":"ContainerDied","Data":"591f6d09f05f4ae7f6c26453fa3255dd8c83a5976c7bd6e2376cd5da32dc6c41"}
Sep 15 09:32:27.198426 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.198405    2568 scope.go:117] "RemoveContainer" containerID="3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855"
Sep 15 09:32:27.210732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.210706    2568 scope.go:117] "RemoveContainer" containerID="3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2"
Sep 15 09:32:27.220369 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.220350    2568 scope.go:117] "RemoveContainer" containerID="3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855"
Sep 15 09:32:27.220638 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:27.220620    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855\": container with ID starting with 3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855 not found: ID does not exist" containerID="3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855"
Sep 15 09:32:27.220685 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.220646    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855"} err="failed to get container status \"3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855\": rpc error: code = NotFound desc = could not find container \"3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855\": container with ID starting with 3553137f057c861fd91d74fba63a41818505c84009f580bc48e199d921df9855 not found: ID does not exist"
Sep 15 09:32:27.220685 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.220662    2568 scope.go:117] "RemoveContainer" containerID="3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2"
Sep 15 09:32:27.220939 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:27.220921    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2\": container with ID starting with 3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2 not found: ID does not exist" containerID="3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2"
Sep 15 09:32:27.220988 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.220945    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2"} err="failed to get container status \"3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2\": rpc error: code = NotFound desc = could not find container \"3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2\": container with ID starting with 3e69af7596d3dbde44c37eb9300bd8ec734c330cbb5b2473fd4c21a48d50e3a2 not found: ID does not exist"
Sep 15 09:32:27.227925 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.227901    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"]
Sep 15 09:32:27.231627 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:27.231604    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-730be9-openshift-default-5ccb6f57f6-9pbnt"]
Sep 15 09:32:28.786525 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:28.786494    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" path="/var/lib/kubelet/pods/63e4f26b-42a0-4d50-adf6-b7196f9ff8d0/volumes"
Sep 15 09:32:37.927743 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:37.927711    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"]
Sep 15 09:32:37.928185 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:37.927936    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff" podUID="70bd5a3e-c524-40de-979a-773e0987f1f0" containerName="payload-processing" containerID="cri-o://e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13" gracePeriod=30
Sep 15 09:32:38.103345 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.103315    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"]
Sep 15 09:32:38.105316 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.105291    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-ff390e-4592g"]
Sep 15 09:32:38.186018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.185951    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:32:38.262857 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.262812    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70bd5a3e-c524-40de-979a-773e0987f1f0-plugins-config-volume\") pod \"70bd5a3e-c524-40de-979a-773e0987f1f0\" (UID: \"70bd5a3e-c524-40de-979a-773e0987f1f0\") "
Sep 15 09:32:38.263018 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.262925    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-72l2k\" (UniqueName: \"kubernetes.io/projected/70bd5a3e-c524-40de-979a-773e0987f1f0-kube-api-access-72l2k\") pod \"70bd5a3e-c524-40de-979a-773e0987f1f0\" (UID: \"70bd5a3e-c524-40de-979a-773e0987f1f0\") "
Sep 15 09:32:38.263297 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.263263    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/70bd5a3e-c524-40de-979a-773e0987f1f0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "70bd5a3e-c524-40de-979a-773e0987f1f0" (UID: "70bd5a3e-c524-40de-979a-773e0987f1f0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:38.265255 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.265227    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70bd5a3e-c524-40de-979a-773e0987f1f0-kube-api-access-72l2k" (OuterVolumeSpecName: "kube-api-access-72l2k") pod "70bd5a3e-c524-40de-979a-773e0987f1f0" (UID: "70bd5a3e-c524-40de-979a-773e0987f1f0"). InnerVolumeSpecName "kube-api-access-72l2k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:38.266601 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.266577    2568 generic.go:356] "Generic (PLEG): container finished" podID="70bd5a3e-c524-40de-979a-773e0987f1f0" containerID="e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13" exitCode=0
Sep 15 09:32:38.266677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.266616    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff" event={"ID":"70bd5a3e-c524-40de-979a-773e0987f1f0","Type":"ContainerDied","Data":"e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13"}
Sep 15 09:32:38.266677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.266625    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"
Sep 15 09:32:38.266677 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.266663    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff" event={"ID":"70bd5a3e-c524-40de-979a-773e0987f1f0","Type":"ContainerDied","Data":"3a7eed334e6dccef8fc601dc048b5dfa851ebd748a453916cb02b5a12106cdb8"}
Sep 15 09:32:38.266801 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.266690    2568 scope.go:117] "RemoveContainer" containerID="e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13"
Sep 15 09:32:38.277107 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.277092    2568 scope.go:117] "RemoveContainer" containerID="e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13"
Sep 15 09:32:38.277364 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:38.277347    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13\": container with ID starting with e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13 not found: ID does not exist" containerID="e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13"
Sep 15 09:32:38.277415 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.277373    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13"} err="failed to get container status \"e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13\": rpc error: code = NotFound desc = could not find container \"e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13\": container with ID starting with e6b0cd9a25c35bf556392b7715bb1679133e8e72768fef58e157389873264d13 not found: ID does not exist"
Sep 15 09:32:38.287736 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.287713    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"]
Sep 15 09:32:38.291699 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.291668    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-ff390e-58c965479-4kdff"]
Sep 15 09:32:38.364453 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.364425    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-72l2k\" (UniqueName: \"kubernetes.io/projected/70bd5a3e-c524-40de-979a-773e0987f1f0-kube-api-access-72l2k\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:38.364453 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.364449    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/70bd5a3e-c524-40de-979a-773e0987f1f0-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:38.786249 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.786217    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70bd5a3e-c524-40de-979a-773e0987f1f0" path="/var/lib/kubelet/pods/70bd5a3e-c524-40de-979a-773e0987f1f0/volumes"
Sep 15 09:32:38.786547 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:38.786535    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14c1236-d52b-4250-aa9f-39314b3deada" path="/var/lib/kubelet/pods/f14c1236-d52b-4250-aa9f-39314b3deada/volumes"
Sep 15 09:32:44.869758 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.869717    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"]
Sep 15 09:32:44.870175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870138    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy"
Sep 15 09:32:44.870175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870152    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2c557059-43be-45ae-afc3-09489b3d264a" containerName="istio-proxy"
Sep 15 09:32:44.870175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870165    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy"
Sep 15 09:32:44.870175 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870171    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870179    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870184    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870193    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70bd5a3e-c524-40de-979a-773e0987f1f0" containerName="payload-processing"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870202    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="70bd5a3e-c524-40de-979a-773e0987f1f0" containerName="payload-processing"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870218    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f14c1236-d52b-4250-aa9f-39314b3deada" containerName="revoke-keys"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870223    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f14c1236-d52b-4250-aa9f-39314b3deada" containerName="revoke-keys"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870278    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870292    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f14c1236-d52b-4250-aa9f-39314b3deada" containerName="revoke-keys"
Sep 15 09:32:44.870314 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.870300    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="70bd5a3e-c524-40de-979a-773e0987f1f0" containerName="payload-processing"
Sep 15 09:32:44.874595 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.874577    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"
Sep 15 09:32:44.877155 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.877134    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:32:44.877294 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.877161    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:32:44.881743 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.881714    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"]
Sep 15 09:32:44.925760 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:44.925729    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d440c4e6-d299-4473-bea6-f98a9bbf46a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp\" (UID: \"d440c4e6-d299-4473-bea6-f98a9bbf46a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"
Sep 15 09:32:45.026896 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:45.026857    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d440c4e6-d299-4473-bea6-f98a9bbf46a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp\" (UID: \"d440c4e6-d299-4473-bea6-f98a9bbf46a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"
Sep 15 09:32:45.027407 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:45.027388    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d440c4e6-d299-4473-bea6-f98a9bbf46a5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp\" (UID: \"d440c4e6-d299-4473-bea6-f98a9bbf46a5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"
Sep 15 09:32:45.187454 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:45.187418    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"
Sep 15 09:32:45.461546 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:45.461519    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"]
Sep 15 09:32:45.464342 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:32:45.464297    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd440c4e6_d299_4473_bea6_f98a9bbf46a5.slice/crio-f52fb73a9192c591a39be21f169f2110e0bc797b1ca3028872f052796a6d96cb WatchSource:0}: Error finding container f52fb73a9192c591a39be21f169f2110e0bc797b1ca3028872f052796a6d96cb: Status 404 returned error can't find the container with id f52fb73a9192c591a39be21f169f2110e0bc797b1ca3028872f052796a6d96cb
Sep 15 09:32:46.309586 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:46.309547    2568 generic.go:356] "Generic (PLEG): container finished" podID="d440c4e6-d299-4473-bea6-f98a9bbf46a5" containerID="edc730430bb16e4519b55e15e9d2669671692492a2f553cc918617a14c8aa5dc" exitCode=0
Sep 15 09:32:46.310098 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:46.309601    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp" event={"ID":"d440c4e6-d299-4473-bea6-f98a9bbf46a5","Type":"ContainerDied","Data":"edc730430bb16e4519b55e15e9d2669671692492a2f553cc918617a14c8aa5dc"}
Sep 15 09:32:46.310098 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:46.309638    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp" event={"ID":"d440c4e6-d299-4473-bea6-f98a9bbf46a5","Type":"ContainerStarted","Data":"f52fb73a9192c591a39be21f169f2110e0bc797b1ca3028872f052796a6d96cb"}
Sep 15 09:32:47.452631 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:47.452605    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"
Sep 15 09:32:47.548307 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:47.548278    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d440c4e6-d299-4473-bea6-f98a9bbf46a5-maas-api-service-ca\") pod \"d440c4e6-d299-4473-bea6-f98a9bbf46a5\" (UID: \"d440c4e6-d299-4473-bea6-f98a9bbf46a5\") "
Sep 15 09:32:47.548657 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:47.548629    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d440c4e6-d299-4473-bea6-f98a9bbf46a5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d440c4e6-d299-4473-bea6-f98a9bbf46a5" (UID: "d440c4e6-d299-4473-bea6-f98a9bbf46a5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:47.649385 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:47.649301    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d440c4e6-d299-4473-bea6-f98a9bbf46a5-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:48.321463 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:48.321431    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"
Sep 15 09:32:48.321650 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:48.321438    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp" event={"ID":"d440c4e6-d299-4473-bea6-f98a9bbf46a5","Type":"ContainerDied","Data":"f52fb73a9192c591a39be21f169f2110e0bc797b1ca3028872f052796a6d96cb"}
Sep 15 09:32:48.321650 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:48.321551    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f52fb73a9192c591a39be21f169f2110e0bc797b1ca3028872f052796a6d96cb"
Sep 15 09:32:55.531189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.530745    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"]
Sep 15 09:32:55.532887 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.532806    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w2-577f23-29824410-9kwfj"]
Sep 15 09:32:55.559066 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.559035    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"]
Sep 15 09:32:55.559282 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.559240    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk" podUID="11b3f8b3-cc2c-404d-b8d1-6056b6294bdd" containerName="payload-processing" containerID="cri-o://65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994" gracePeriod=30
Sep 15 09:32:55.740939 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.740777    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"]
Sep 15 09:32:55.743582 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.743503    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w2-577f23-fgnvp"]
Sep 15 09:32:55.822213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.822187    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:32:55.918581 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.918543    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfdz5\" (UniqueName: \"kubernetes.io/projected/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-kube-api-access-jfdz5\") pod \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\" (UID: \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\") "
Sep 15 09:32:55.918808 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.918666    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-plugins-config-volume\") pod \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\" (UID: \"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd\") "
Sep 15 09:32:55.919129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.919094    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "11b3f8b3-cc2c-404d-b8d1-6056b6294bdd" (UID: "11b3f8b3-cc2c-404d-b8d1-6056b6294bdd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:32:55.920902 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:55.920882    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-kube-api-access-jfdz5" (OuterVolumeSpecName: "kube-api-access-jfdz5") pod "11b3f8b3-cc2c-404d-b8d1-6056b6294bdd" (UID: "11b3f8b3-cc2c-404d-b8d1-6056b6294bdd"). InnerVolumeSpecName "kube-api-access-jfdz5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:32:56.019653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.019614    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfdz5\" (UniqueName: \"kubernetes.io/projected/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-kube-api-access-jfdz5\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:56.019653 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.019646    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:32:56.361304 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.361273    2568 generic.go:356] "Generic (PLEG): container finished" podID="11b3f8b3-cc2c-404d-b8d1-6056b6294bdd" containerID="65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994" exitCode=0
Sep 15 09:32:56.361500 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.361317    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"
Sep 15 09:32:56.361500 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.361368    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk" event={"ID":"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd","Type":"ContainerDied","Data":"65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994"}
Sep 15 09:32:56.361500 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.361421    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk" event={"ID":"11b3f8b3-cc2c-404d-b8d1-6056b6294bdd","Type":"ContainerDied","Data":"00333f50f97ff3ec14f870ecef701dca7596d1ab4ee47cd6a5277bb4eba5491e"}
Sep 15 09:32:56.361500 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.361447    2568 scope.go:117] "RemoveContainer" containerID="65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994"
Sep 15 09:32:56.370444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.370426    2568 scope.go:117] "RemoveContainer" containerID="65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994"
Sep 15 09:32:56.370738 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:32:56.370714    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994\": container with ID starting with 65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994 not found: ID does not exist" containerID="65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994"
Sep 15 09:32:56.370814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.370747    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994"} err="failed to get container status \"65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994\": rpc error: code = NotFound desc = could not find container \"65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994\": container with ID starting with 65a8a80bfd35f39b1169bb8cb40b990b827c9d9190714047c2f31227c4ae1994 not found: ID does not exist"
Sep 15 09:32:56.381807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.381779    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"]
Sep 15 09:32:56.386082 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.386059    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-577f23-7df4bd789c-b7hfk"]
Sep 15 09:32:56.788820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.788781    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b3f8b3-cc2c-404d-b8d1-6056b6294bdd" path="/var/lib/kubelet/pods/11b3f8b3-cc2c-404d-b8d1-6056b6294bdd/volumes"
Sep 15 09:32:56.789341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.789128    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a00f3325-31b7-48e7-85a3-6c8ddb83f27f" path="/var/lib/kubelet/pods/a00f3325-31b7-48e7-85a3-6c8ddb83f27f/volumes"
Sep 15 09:32:56.789404 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:32:56.789373    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d440c4e6-d299-4473-bea6-f98a9bbf46a5" path="/var/lib/kubelet/pods/d440c4e6-d299-4473-bea6-f98a9bbf46a5/volumes"
Sep 15 09:33:02.234485 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.234449    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"]
Sep 15 09:33:02.234999 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.234723    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy" containerID="cri-o://0628415b84877b2c8c6d5f3143428e0e5e8fa4ac4a372d95278c5caf5561def2" gracePeriod=30
Sep 15 09:33:02.547147 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.547049    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"]
Sep 15 09:33:02.547537 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.547517    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d440c4e6-d299-4473-bea6-f98a9bbf46a5" containerName="revoke-keys"
Sep 15 09:33:02.547626 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.547540    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d440c4e6-d299-4473-bea6-f98a9bbf46a5" containerName="revoke-keys"
Sep 15 09:33:02.547626 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.547586    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b3f8b3-cc2c-404d-b8d1-6056b6294bdd" containerName="payload-processing"
Sep 15 09:33:02.547626 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.547596    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b3f8b3-cc2c-404d-b8d1-6056b6294bdd" containerName="payload-processing"
Sep 15 09:33:02.547780 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.547685    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d440c4e6-d299-4473-bea6-f98a9bbf46a5" containerName="revoke-keys"
Sep 15 09:33:02.547780 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.547700    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="63e4f26b-42a0-4d50-adf6-b7196f9ff8d0" containerName="istio-proxy"
Sep 15 09:33:02.547780 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.547711    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b3f8b3-cc2c-404d-b8d1-6056b6294bdd" containerName="payload-processing"
Sep 15 09:33:02.551574 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.551553    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"
Sep 15 09:33:02.554705 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.554686    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:33:02.554705 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.554694    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:33:02.559645 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.559624    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"]
Sep 15 09:33:02.680713 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.680682    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5376d240-f349-4539-a7bb-c3c7c5851dff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t\" (UID: \"5376d240-f349-4539-a7bb-c3c7c5851dff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"
Sep 15 09:33:02.781211 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.781166    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5376d240-f349-4539-a7bb-c3c7c5851dff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t\" (UID: \"5376d240-f349-4539-a7bb-c3c7c5851dff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"
Sep 15 09:33:02.781968 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.781943    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5376d240-f349-4539-a7bb-c3c7c5851dff-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t\" (UID: \"5376d240-f349-4539-a7bb-c3c7c5851dff\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"
Sep 15 09:33:02.863256 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:02.863182    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"
Sep 15 09:33:03.135067 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:03.135039    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"]
Sep 15 09:33:03.136591 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:33:03.136555    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5376d240_f349_4539_a7bb_c3c7c5851dff.slice/crio-0f6b00ad244102ea1f5f09880b489ce43e4c347a58275a3e4f0c8d0fa72d062b WatchSource:0}: Error finding container 0f6b00ad244102ea1f5f09880b489ce43e4c347a58275a3e4f0c8d0fa72d062b: Status 404 returned error can't find the container with id 0f6b00ad244102ea1f5f09880b489ce43e4c347a58275a3e4f0c8d0fa72d062b
Sep 15 09:33:03.401486 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:03.401448    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t" event={"ID":"5376d240-f349-4539-a7bb-c3c7c5851dff","Type":"ContainerStarted","Data":"0f6b00ad244102ea1f5f09880b489ce43e4c347a58275a3e4f0c8d0fa72d062b"}
Sep 15 09:33:04.407931 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:04.407896    2568 generic.go:356] "Generic (PLEG): container finished" podID="5376d240-f349-4539-a7bb-c3c7c5851dff" containerID="1ee5f4c99904a8f9030dd2759cc4991a9b31a0f13ab26baa899ce2a4fbb8e6b4" exitCode=0
Sep 15 09:33:04.408311 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:04.407975    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t" event={"ID":"5376d240-f349-4539-a7bb-c3c7c5851dff","Type":"ContainerDied","Data":"1ee5f4c99904a8f9030dd2759cc4991a9b31a0f13ab26baa899ce2a4fbb8e6b4"}
Sep 15 09:33:05.551017 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.550988    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"
Sep 15 09:33:05.631635 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.631596    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"]
Sep 15 09:33:05.632061 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.632043    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5376d240-f349-4539-a7bb-c3c7c5851dff" containerName="revoke-keys"
Sep 15 09:33:05.632147 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.632062    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5376d240-f349-4539-a7bb-c3c7c5851dff" containerName="revoke-keys"
Sep 15 09:33:05.632220 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.632147    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5376d240-f349-4539-a7bb-c3c7c5851dff" containerName="revoke-keys"
Sep 15 09:33:05.635110 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.635089    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"
Sep 15 09:33:05.643803 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.643779    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"]
Sep 15 09:33:05.709495 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.709419    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5376d240-f349-4539-a7bb-c3c7c5851dff-maas-api-service-ca\") pod \"5376d240-f349-4539-a7bb-c3c7c5851dff\" (UID: \"5376d240-f349-4539-a7bb-c3c7c5851dff\") "
Sep 15 09:33:05.709932 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.709903    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5376d240-f349-4539-a7bb-c3c7c5851dff-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "5376d240-f349-4539-a7bb-c3c7c5851dff" (UID: "5376d240-f349-4539-a7bb-c3c7c5851dff"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:05.811115 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.811077    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2377f024-ae32-4aa4-8871-a675e2375825-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n\" (UID: \"2377f024-ae32-4aa4-8871-a675e2375825\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"
Sep 15 09:33:05.811284 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.811131    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/5376d240-f349-4539-a7bb-c3c7c5851dff-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:05.911890 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.911817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2377f024-ae32-4aa4-8871-a675e2375825-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n\" (UID: \"2377f024-ae32-4aa4-8871-a675e2375825\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"
Sep 15 09:33:05.912434 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.912413    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2377f024-ae32-4aa4-8871-a675e2375825-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n\" (UID: \"2377f024-ae32-4aa4-8871-a675e2375825\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"
Sep 15 09:33:05.947207 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:05.947168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"
Sep 15 09:33:06.220144 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:06.220114    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"]
Sep 15 09:33:06.222892 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:33:06.222862    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2377f024_ae32_4aa4_8871_a675e2375825.slice/crio-8b67ce7e17dd7fcd9e543d8b902c1a34c54d9d7959142faba5fdd0ecab53b41a WatchSource:0}: Error finding container 8b67ce7e17dd7fcd9e543d8b902c1a34c54d9d7959142faba5fdd0ecab53b41a: Status 404 returned error can't find the container with id 8b67ce7e17dd7fcd9e543d8b902c1a34c54d9d7959142faba5fdd0ecab53b41a
Sep 15 09:33:06.419923 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:06.419881    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t" event={"ID":"5376d240-f349-4539-a7bb-c3c7c5851dff","Type":"ContainerDied","Data":"0f6b00ad244102ea1f5f09880b489ce43e4c347a58275a3e4f0c8d0fa72d062b"}
Sep 15 09:33:06.420077 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:06.419898    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"
Sep 15 09:33:06.420077 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:06.419936    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f6b00ad244102ea1f5f09880b489ce43e4c347a58275a3e4f0c8d0fa72d062b"
Sep 15 09:33:06.421226 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:06.421201    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n" event={"ID":"2377f024-ae32-4aa4-8871-a675e2375825","Type":"ContainerStarted","Data":"8b67ce7e17dd7fcd9e543d8b902c1a34c54d9d7959142faba5fdd0ecab53b41a"}
Sep 15 09:33:07.429399 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.429368    2568 generic.go:356] "Generic (PLEG): container finished" podID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerID="0628415b84877b2c8c6d5f3143428e0e5e8fa4ac4a372d95278c5caf5561def2" exitCode=0
Sep 15 09:33:07.429882 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.429442    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" event={"ID":"9df51671-7a22-4411-9fdf-7e5d21b33bd9","Type":"ContainerDied","Data":"0628415b84877b2c8c6d5f3143428e0e5e8fa4ac4a372d95278c5caf5561def2"}
Sep 15 09:33:07.429882 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.429505    2568 scope.go:117] "RemoveContainer" containerID="e808267aeef9a47aec4e9d8f1770a8a8b3eca3ec832880109303638984598245"
Sep 15 09:33:07.431686 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.431663    2568 generic.go:356] "Generic (PLEG): container finished" podID="2377f024-ae32-4aa4-8871-a675e2375825" containerID="b6dd0127dc504156fe0e9cd10a59550282d06b14f43f0b61054e52a46cb155a9" exitCode=0
Sep 15 09:33:07.431795 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.431716    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n" event={"ID":"2377f024-ae32-4aa4-8871-a675e2375825","Type":"ContainerDied","Data":"b6dd0127dc504156fe0e9cd10a59550282d06b14f43f0b61054e52a46cb155a9"}
Sep 15 09:33:07.490514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.490491    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:33:07.626477 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626394    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mxbn\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-kube-api-access-8mxbn\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626477 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626455    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-podinfo\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626509    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-data\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626542    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-socket\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626564    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istiod-ca-cert\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626599    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-credential-socket\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626625    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-certs\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626951 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626679    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-token\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626951 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626719    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-envoy\") pod \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\" (UID: \"9df51671-7a22-4411-9fdf-7e5d21b33bd9\") "
Sep 15 09:33:07.626951 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626822    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-data" (OuterVolumeSpecName: "istio-data") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:07.626951 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626881    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:07.627173 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.626996    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:07.627173 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.627027    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:07.627173 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.627108    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:07.627173 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.627122    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:07.627173 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.627131    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:07.627173 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.627149    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:07.627418 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.627246    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:07.628919 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.628885    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-kube-api-access-8mxbn" (OuterVolumeSpecName: "kube-api-access-8mxbn") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "kube-api-access-8mxbn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:07.628919 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.628909    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:33:07.629069 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.628948    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:33:07.629145 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.629131    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-token" (OuterVolumeSpecName: "istio-token") pod "9df51671-7a22-4411-9fdf-7e5d21b33bd9" (UID: "9df51671-7a22-4411-9fdf-7e5d21b33bd9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:07.727938 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.727902    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:07.727938 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.727931    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:07.727938 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.727940    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:07.727938 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.727948    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9df51671-7a22-4411-9fdf-7e5d21b33bd9-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:07.728196 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:07.727956    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mxbn\" (UniqueName: \"kubernetes.io/projected/9df51671-7a22-4411-9fdf-7e5d21b33bd9-kube-api-access-8mxbn\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:08.438020 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.437993    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"
Sep 15 09:33:08.438452 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.438030    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw" event={"ID":"9df51671-7a22-4411-9fdf-7e5d21b33bd9","Type":"ContainerDied","Data":"11a9ce4d4a674dfaf4f9d67967bf689192ef2cd84e8aad41dec8c2e5ff9d56e7"}
Sep 15 09:33:08.438452 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.438078    2568 scope.go:117] "RemoveContainer" containerID="0628415b84877b2c8c6d5f3143428e0e5e8fa4ac4a372d95278c5caf5561def2"
Sep 15 09:33:08.460976 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.460948    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"]
Sep 15 09:33:08.464616 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.464592    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w2-577f23-openshift-default-6c695c85db-t6ktw"]
Sep 15 09:33:08.574009 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.573982    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"
Sep 15 09:33:08.736568 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.736487    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2377f024-ae32-4aa4-8871-a675e2375825-maas-api-service-ca\") pod \"2377f024-ae32-4aa4-8871-a675e2375825\" (UID: \"2377f024-ae32-4aa4-8871-a675e2375825\") "
Sep 15 09:33:08.736828 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.736806    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2377f024-ae32-4aa4-8871-a675e2375825-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2377f024-ae32-4aa4-8871-a675e2375825" (UID: "2377f024-ae32-4aa4-8871-a675e2375825"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:08.795772 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.795739    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" path="/var/lib/kubelet/pods/9df51671-7a22-4411-9fdf-7e5d21b33bd9/volumes"
Sep 15 09:33:08.838048 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:08.838021    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2377f024-ae32-4aa4-8871-a675e2375825-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:09.445628 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:09.445583    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n" event={"ID":"2377f024-ae32-4aa4-8871-a675e2375825","Type":"ContainerDied","Data":"8b67ce7e17dd7fcd9e543d8b902c1a34c54d9d7959142faba5fdd0ecab53b41a"}
Sep 15 09:33:09.445628 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:09.445624    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"
Sep 15 09:33:09.446039 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:09.445644    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8b67ce7e17dd7fcd9e543d8b902c1a34c54d9d7959142faba5fdd0ecab53b41a"
Sep 15 09:33:13.338481 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.338447    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"]
Sep 15 09:33:13.339292 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.339256    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb" podUID="e4940bed-872b-4d4b-b0a2-044aa5ceba8d" containerName="payload-processing" containerID="cri-o://74211d9ba7456eb8cebf9c8b42e16568744bc72be3b88ecdb93ced3855417feb" gracePeriod=30
Sep 15 09:33:13.347882 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.347837    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"]
Sep 15 09:33:13.348150 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.348125    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv" podUID="fa705466-771a-4a6b-a5c6-4f87a555f749" containerName="payload-pre-processing" containerID="cri-o://aba58d3f223a3a7c20c44e094362274c2dd44a61688294c34ccbded0ca50053a" gracePeriod=30
Sep 15 09:33:13.468783 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.468755    2568 generic.go:356] "Generic (PLEG): container finished" podID="fa705466-771a-4a6b-a5c6-4f87a555f749" containerID="aba58d3f223a3a7c20c44e094362274c2dd44a61688294c34ccbded0ca50053a" exitCode=0
Sep 15 09:33:13.468934 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.468825    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv" event={"ID":"fa705466-771a-4a6b-a5c6-4f87a555f749","Type":"ContainerDied","Data":"aba58d3f223a3a7c20c44e094362274c2dd44a61688294c34ccbded0ca50053a"}
Sep 15 09:33:13.470992 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.470962    2568 generic.go:356] "Generic (PLEG): container finished" podID="e4940bed-872b-4d4b-b0a2-044aa5ceba8d" containerID="74211d9ba7456eb8cebf9c8b42e16568744bc72be3b88ecdb93ced3855417feb" exitCode=0
Sep 15 09:33:13.471093 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.471015    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb" event={"ID":"e4940bed-872b-4d4b-b0a2-044aa5ceba8d","Type":"ContainerDied","Data":"74211d9ba7456eb8cebf9c8b42e16568744bc72be3b88ecdb93ced3855417feb"}
Sep 15 09:33:13.512795 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.512573    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"]
Sep 15 09:33:13.516153 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.515630    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w2-f032a1-z297t"]
Sep 15 09:33:13.628049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.627758    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:33:13.631317 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.631296    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:33:13.682221 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.682194    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa705466-771a-4a6b-a5c6-4f87a555f749-plugins-config-volume\") pod \"fa705466-771a-4a6b-a5c6-4f87a555f749\" (UID: \"fa705466-771a-4a6b-a5c6-4f87a555f749\") "
Sep 15 09:33:13.682406 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.682232    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zpxh8\" (UniqueName: \"kubernetes.io/projected/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-kube-api-access-zpxh8\") pod \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\" (UID: \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\") "
Sep 15 09:33:13.682406 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.682252    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjhhl\" (UniqueName: \"kubernetes.io/projected/fa705466-771a-4a6b-a5c6-4f87a555f749-kube-api-access-bjhhl\") pod \"fa705466-771a-4a6b-a5c6-4f87a555f749\" (UID: \"fa705466-771a-4a6b-a5c6-4f87a555f749\") "
Sep 15 09:33:13.682651 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.682620    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa705466-771a-4a6b-a5c6-4f87a555f749-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "fa705466-771a-4a6b-a5c6-4f87a555f749" (UID: "fa705466-771a-4a6b-a5c6-4f87a555f749"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:13.685161 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.685137    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa705466-771a-4a6b-a5c6-4f87a555f749-kube-api-access-bjhhl" (OuterVolumeSpecName: "kube-api-access-bjhhl") pod "fa705466-771a-4a6b-a5c6-4f87a555f749" (UID: "fa705466-771a-4a6b-a5c6-4f87a555f749"). InnerVolumeSpecName "kube-api-access-bjhhl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:13.685240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.685152    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-kube-api-access-zpxh8" (OuterVolumeSpecName: "kube-api-access-zpxh8") pod "e4940bed-872b-4d4b-b0a2-044aa5ceba8d" (UID: "e4940bed-872b-4d4b-b0a2-044aa5ceba8d"). InnerVolumeSpecName "kube-api-access-zpxh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:13.783444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.783414    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-plugins-config-volume\") pod \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\" (UID: \"e4940bed-872b-4d4b-b0a2-044aa5ceba8d\") "
Sep 15 09:33:13.783667 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.783640    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/fa705466-771a-4a6b-a5c6-4f87a555f749-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:13.783667 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.783664    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zpxh8\" (UniqueName: \"kubernetes.io/projected/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-kube-api-access-zpxh8\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:13.783834 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.783698    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjhhl\" (UniqueName: \"kubernetes.io/projected/fa705466-771a-4a6b-a5c6-4f87a555f749-kube-api-access-bjhhl\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:13.783834 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.783764    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e4940bed-872b-4d4b-b0a2-044aa5ceba8d" (UID: "e4940bed-872b-4d4b-b0a2-044aa5ceba8d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:13.884203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:13.884120    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e4940bed-872b-4d4b-b0a2-044aa5ceba8d-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:14.477779 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.477746    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"
Sep 15 09:33:14.478265 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.477782    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb" event={"ID":"e4940bed-872b-4d4b-b0a2-044aa5ceba8d","Type":"ContainerDied","Data":"c1053d94ba68c5591e7a4c08e9c656a704239b66a265161e27bb69604cc3230d"}
Sep 15 09:33:14.478265 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.477839    2568 scope.go:117] "RemoveContainer" containerID="74211d9ba7456eb8cebf9c8b42e16568744bc72be3b88ecdb93ced3855417feb"
Sep 15 09:33:14.479244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.479224    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv" event={"ID":"fa705466-771a-4a6b-a5c6-4f87a555f749","Type":"ContainerDied","Data":"e71d882193c073a64250ebe04d3524f308afca81e61019cfee83574e85cf530d"}
Sep 15 09:33:14.479333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.479259    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"
Sep 15 09:33:14.491418 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.491391    2568 scope.go:117] "RemoveContainer" containerID="aba58d3f223a3a7c20c44e094362274c2dd44a61688294c34ccbded0ca50053a"
Sep 15 09:33:14.506828 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.506806    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"]
Sep 15 09:33:14.508991 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.508969    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-f032a1-74c96f866f-zdpqb"]
Sep 15 09:33:14.525148 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.525121    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"]
Sep 15 09:33:14.531816 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.531790    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w2-f032a1-64c74c95cd-xt6rv"]
Sep 15 09:33:14.786044 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.786010    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5376d240-f349-4539-a7bb-c3c7c5851dff" path="/var/lib/kubelet/pods/5376d240-f349-4539-a7bb-c3c7c5851dff/volumes"
Sep 15 09:33:14.786533 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.786501    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e4940bed-872b-4d4b-b0a2-044aa5ceba8d" path="/var/lib/kubelet/pods/e4940bed-872b-4d4b-b0a2-044aa5ceba8d/volumes"
Sep 15 09:33:14.786912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:14.786893    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa705466-771a-4a6b-a5c6-4f87a555f749" path="/var/lib/kubelet/pods/fa705466-771a-4a6b-a5c6-4f87a555f749/volumes"
Sep 15 09:33:21.944411 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:21.944377    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"]
Sep 15 09:33:21.944915 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:21.944631    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd" podUID="52e5e249-ceeb-410f-aea4-4f1de1d31e91" containerName="payload-pre-processing" containerID="cri-o://1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f" gracePeriod=30
Sep 15 09:33:22.106566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.106532    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"]
Sep 15 09:33:22.112908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.112882    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-worker-w4-890f3e-h825n"]
Sep 15 09:33:22.203794 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.203704    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:33:22.247867 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.247817    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2csc\" (UniqueName: \"kubernetes.io/projected/52e5e249-ceeb-410f-aea4-4f1de1d31e91-kube-api-access-h2csc\") pod \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\" (UID: \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\") "
Sep 15 09:33:22.248046 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.247931    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52e5e249-ceeb-410f-aea4-4f1de1d31e91-plugins-config-volume\") pod \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\" (UID: \"52e5e249-ceeb-410f-aea4-4f1de1d31e91\") "
Sep 15 09:33:22.248402 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.248371    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/52e5e249-ceeb-410f-aea4-4f1de1d31e91-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "52e5e249-ceeb-410f-aea4-4f1de1d31e91" (UID: "52e5e249-ceeb-410f-aea4-4f1de1d31e91"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:33:22.250428 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.250394    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52e5e249-ceeb-410f-aea4-4f1de1d31e91-kube-api-access-h2csc" (OuterVolumeSpecName: "kube-api-access-h2csc") pod "52e5e249-ceeb-410f-aea4-4f1de1d31e91" (UID: "52e5e249-ceeb-410f-aea4-4f1de1d31e91"). InnerVolumeSpecName "kube-api-access-h2csc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:33:22.349016 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.348983    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2csc\" (UniqueName: \"kubernetes.io/projected/52e5e249-ceeb-410f-aea4-4f1de1d31e91-kube-api-access-h2csc\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.349016 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.349010    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/52e5e249-ceeb-410f-aea4-4f1de1d31e91-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:33:22.522834 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.522741    2568 generic.go:356] "Generic (PLEG): container finished" podID="52e5e249-ceeb-410f-aea4-4f1de1d31e91" containerID="1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f" exitCode=0
Sep 15 09:33:22.522834 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.522791    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"
Sep 15 09:33:22.522834 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.522799    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd" event={"ID":"52e5e249-ceeb-410f-aea4-4f1de1d31e91","Type":"ContainerDied","Data":"1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f"}
Sep 15 09:33:22.523085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.522860    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd" event={"ID":"52e5e249-ceeb-410f-aea4-4f1de1d31e91","Type":"ContainerDied","Data":"d667a31a8230603f1a354cf9a466f6d48202966fbbe643e00e39cbf48a71acc0"}
Sep 15 09:33:22.523085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.522893    2568 scope.go:117] "RemoveContainer" containerID="1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f"
Sep 15 09:33:22.532255 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.532239    2568 scope.go:117] "RemoveContainer" containerID="1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f"
Sep 15 09:33:22.532529 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:33:22.532511    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f\": container with ID starting with 1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f not found: ID does not exist" containerID="1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f"
Sep 15 09:33:22.532576 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.532538    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f"} err="failed to get container status \"1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f\": rpc error: code = NotFound desc = could not find container \"1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f\": container with ID starting with 1d29bb21c700999da52e12b289c1d52e5652386326017a3a48e814a442e8aa6f not found: ID does not exist"
Sep 15 09:33:22.544484 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.544437    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"]
Sep 15 09:33:22.546387 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.546367    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-worker-w4-890f3e-8674f4895d-w8rvd"]
Sep 15 09:33:22.785784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.785693    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2377f024-ae32-4aa4-8871-a675e2375825" path="/var/lib/kubelet/pods/2377f024-ae32-4aa4-8871-a675e2375825/volumes"
Sep 15 09:33:22.786176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:33:22.786155    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52e5e249-ceeb-410f-aea4-4f1de1d31e91" path="/var/lib/kubelet/pods/52e5e249-ceeb-410f-aea4-4f1de1d31e91/volumes"
Sep 15 09:35:05.124266 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:05.124230    2568 scope.go:117] "RemoveContainer" containerID="d828eba5e5c210c5b5ddb4e9239a61b006c41719a49c0d19389e0535a1cadb82"
Sep 15 09:35:27.499304 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499215    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"]
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499678    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52e5e249-ceeb-410f-aea4-4f1de1d31e91" containerName="payload-pre-processing"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499696    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="52e5e249-ceeb-410f-aea4-4f1de1d31e91" containerName="payload-pre-processing"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499710    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2377f024-ae32-4aa4-8871-a675e2375825" containerName="revoke-keys"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499718    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2377f024-ae32-4aa4-8871-a675e2375825" containerName="revoke-keys"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499740    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa705466-771a-4a6b-a5c6-4f87a555f749" containerName="payload-pre-processing"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499751    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa705466-771a-4a6b-a5c6-4f87a555f749" containerName="payload-pre-processing"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499761    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e4940bed-872b-4d4b-b0a2-044aa5ceba8d" containerName="payload-processing"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499770    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e4940bed-872b-4d4b-b0a2-044aa5ceba8d" containerName="payload-processing"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499789    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499798    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499812    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy"
Sep 15 09:35:27.499908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499820    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy"
Sep 15 09:35:27.500508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499928    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="52e5e249-ceeb-410f-aea4-4f1de1d31e91" containerName="payload-pre-processing"
Sep 15 09:35:27.500508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499942    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e4940bed-872b-4d4b-b0a2-044aa5ceba8d" containerName="payload-processing"
Sep 15 09:35:27.500508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499950    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy"
Sep 15 09:35:27.500508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499958    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9df51671-7a22-4411-9fdf-7e5d21b33bd9" containerName="istio-proxy"
Sep 15 09:35:27.500508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499967    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa705466-771a-4a6b-a5c6-4f87a555f749" containerName="payload-pre-processing"
Sep 15 09:35:27.500508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.499975    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2377f024-ae32-4aa4-8871-a675e2375825" containerName="revoke-keys"
Sep 15 09:35:27.504323 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.504300    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.507088 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.507067    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-f79800\"/\"openshift-service-ca.crt\""
Sep 15 09:35:27.508570 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.508545    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-w3-f79800\"/\"kube-root-ca.crt\""
Sep 15 09:35:27.508570 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.508563    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-f79800\"/\"default-dockercfg-f6pvl\""
Sep 15 09:35:27.508732 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.508573    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-w3-f79800\"/\"rate-test-model-f79800-kserve-self-signed-certs\""
Sep 15 09:35:27.510634 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.510612    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"]
Sep 15 09:35:27.608447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.608416    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tmp-dir\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.608447 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.608451    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jvjx\" (UniqueName: \"kubernetes.io/projected/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-kube-api-access-6jvjx\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.608669 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.608476    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-model-cache\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.608669 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.608559    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-home\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.608669 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.608612    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tls-certs\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.608768 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.608664    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-dshm\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.709905 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.709860    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-home\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.709905 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.709911    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tls-certs\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.710143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.709939    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-dshm\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.710143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.710014    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tmp-dir\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.710143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.710037    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jvjx\" (UniqueName: \"kubernetes.io/projected/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-kube-api-access-6jvjx\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.710143 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.710069    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-model-cache\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.710354 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.710254    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-home\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.710354 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.710337    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tmp-dir\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.710458 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.710414    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-model-cache\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.712470 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.712444    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-dshm\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.712746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.712726    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tls-certs\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.718103 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.718083    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jvjx\" (UniqueName: \"kubernetes.io/projected/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-kube-api-access-6jvjx\") pod \"rate-test-model-f79800-kserve-5cc6888cd7-rcmt4\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") " pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:27.814262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:27.814187    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:28.089532 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:28.089504    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"]
Sep 15 09:35:28.091899 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:35:28.091871    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6315f4f6_4090_45e8_bc50_b3d0e582d0c2.slice/crio-486eb2dca97288cd3c0a8ee2a830db60c2b431dfe89b1cfb1e3dcba8063bf4f5 WatchSource:0}: Error finding container 486eb2dca97288cd3c0a8ee2a830db60c2b431dfe89b1cfb1e3dcba8063bf4f5: Status 404 returned error can't find the container with id 486eb2dca97288cd3c0a8ee2a830db60c2b431dfe89b1cfb1e3dcba8063bf4f5
Sep 15 09:35:28.122189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:28.122163    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4" event={"ID":"6315f4f6-4090-45e8-bc50-b3d0e582d0c2","Type":"ContainerStarted","Data":"486eb2dca97288cd3c0a8ee2a830db60c2b431dfe89b1cfb1e3dcba8063bf4f5"}
Sep 15 09:35:29.129592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:29.129550    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4" event={"ID":"6315f4f6-4090-45e8-bc50-b3d0e582d0c2","Type":"ContainerStarted","Data":"a1542082626f9f42d385f05855e4211a4ee7f90406568eac7ca0f798d2f89699"}
Sep 15 09:35:29.148971 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:29.148921    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4" podStartSLOduration=2.148902113 podStartE2EDuration="2.148902113s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:35:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:35:29.148478685 +0000 UTC m=+1704.912050148" watchObservedRunningTime="2026-09-15 09:35:29.148902113 +0000 UTC m=+1704.912473585"
Sep 15 09:35:37.815187 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:37.815149    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:37.815692 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:37.815205    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:37.827491 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:37.827465    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:35:38.184126 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:35:38.184101    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:36:05.143067 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:05.143037    2568 scope.go:117] "RemoveContainer" containerID="bc57f76383d17b18aea4b7f476458701fb0e219b6fc5357a7609dea37f05518b"
Sep 15 09:36:38.385122 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:38.385084    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"]
Sep 15 09:36:45.627262 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.627221    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"]
Sep 15 09:36:45.630746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.630724    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:45.633695 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.633674    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-08aa53\""
Sep 15 09:36:45.633883 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.633761    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-08aa53-dockercfg-57xsf\""
Sep 15 09:36:45.641070 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.641050    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"]
Sep 15 09:36:45.669617 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.669588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkbqh\" (UniqueName: \"kubernetes.io/projected/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-kube-api-access-mkbqh\") pod \"payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62\" (UID: \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:45.669773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.669647    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62\" (UID: \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:45.673620 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.673599    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"]
Sep 15 09:36:45.676765 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.676751    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:45.687670 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.687647    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"]
Sep 15 09:36:45.770858 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.770817    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkbqh\" (UniqueName: \"kubernetes.io/projected/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-kube-api-access-mkbqh\") pod \"payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62\" (UID: \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:45.771060 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.770906    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62\" (UID: \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:45.771060 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.770954    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4wc8\" (UniqueName: \"kubernetes.io/projected/a1715660-e3ad-4125-9822-f8c517852a2b-kube-api-access-p4wc8\") pod \"payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk\" (UID: \"a1715660-e3ad-4125-9822-f8c517852a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:45.771060 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.770987    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1715660-e3ad-4125-9822-f8c517852a2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk\" (UID: \"a1715660-e3ad-4125-9822-f8c517852a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:45.771663 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.771639    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62\" (UID: \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:45.780148 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.780123    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkbqh\" (UniqueName: \"kubernetes.io/projected/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-kube-api-access-mkbqh\") pod \"payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62\" (UID: \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:45.872031 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.871990    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4wc8\" (UniqueName: \"kubernetes.io/projected/a1715660-e3ad-4125-9822-f8c517852a2b-kube-api-access-p4wc8\") pod \"payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk\" (UID: \"a1715660-e3ad-4125-9822-f8c517852a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:45.872031 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.872038    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1715660-e3ad-4125-9822-f8c517852a2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk\" (UID: \"a1715660-e3ad-4125-9822-f8c517852a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:45.872682 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.872663    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1715660-e3ad-4125-9822-f8c517852a2b-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk\" (UID: \"a1715660-e3ad-4125-9822-f8c517852a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:45.879981 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.879920    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4wc8\" (UniqueName: \"kubernetes.io/projected/a1715660-e3ad-4125-9822-f8c517852a2b-kube-api-access-p4wc8\") pod \"payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk\" (UID: \"a1715660-e3ad-4125-9822-f8c517852a2b\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:45.941752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.941717    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:45.986651 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:45.986613    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:46.217369 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.217344    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"]
Sep 15 09:36:46.218861 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:36:46.218824    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ae52313_2e5d_4fc7_aa6c_accbdd655b32.slice/crio-c73be229cb1bbfeb5b185a43b59317b7c5b096ea7d09643a06996e5699dc5f26 WatchSource:0}: Error finding container c73be229cb1bbfeb5b185a43b59317b7c5b096ea7d09643a06996e5699dc5f26: Status 404 returned error can't find the container with id c73be229cb1bbfeb5b185a43b59317b7c5b096ea7d09643a06996e5699dc5f26
Sep 15 09:36:46.268569 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.268545    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"]
Sep 15 09:36:46.270245 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:36:46.270223    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1715660_e3ad_4125_9822_f8c517852a2b.slice/crio-79808c60ccd0515af081a56a1cdfc15f9c4591a36fa52edd8f2dd295672ab757 WatchSource:0}: Error finding container 79808c60ccd0515af081a56a1cdfc15f9c4591a36fa52edd8f2dd295672ab757: Status 404 returned error can't find the container with id 79808c60ccd0515af081a56a1cdfc15f9c4591a36fa52edd8f2dd295672ab757
Sep 15 09:36:46.501484 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.501398    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk" event={"ID":"a1715660-e3ad-4125-9822-f8c517852a2b","Type":"ContainerStarted","Data":"f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3"}
Sep 15 09:36:46.501484 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.501454    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk" event={"ID":"a1715660-e3ad-4125-9822-f8c517852a2b","Type":"ContainerStarted","Data":"79808c60ccd0515af081a56a1cdfc15f9c4591a36fa52edd8f2dd295672ab757"}
Sep 15 09:36:46.501720 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.501529    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:46.503146 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.503122    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62" event={"ID":"6ae52313-2e5d-4fc7-aa6c-accbdd655b32","Type":"ContainerStarted","Data":"4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812"}
Sep 15 09:36:46.503270 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.503166    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62" event={"ID":"6ae52313-2e5d-4fc7-aa6c-accbdd655b32","Type":"ContainerStarted","Data":"c73be229cb1bbfeb5b185a43b59317b7c5b096ea7d09643a06996e5699dc5f26"}
Sep 15 09:36:46.503270 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.503228    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:36:46.518598 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.518554    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk" podStartSLOduration=1.51854168 podStartE2EDuration="1.51854168s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:46.51640903 +0000 UTC m=+1782.279980492" watchObservedRunningTime="2026-09-15 09:36:46.51854168 +0000 UTC m=+1782.282113122"
Sep 15 09:36:46.533032 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:46.532991    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62" podStartSLOduration=1.532978299 podStartE2EDuration="1.532978299s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:36:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:36:46.530671594 +0000 UTC m=+1782.294243043" watchObservedRunningTime="2026-09-15 09:36:46.532978299 +0000 UTC m=+1782.296549747"
Sep 15 09:36:53.404737 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.404670    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4" podUID="6315f4f6-4090-45e8-bc50-b3d0e582d0c2" containerName="main" containerID="cri-o://a1542082626f9f42d385f05855e4211a4ee7f90406568eac7ca0f798d2f89699" gracePeriod=45
Sep 15 09:36:53.539058 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.539029    2568 generic.go:356] "Generic (PLEG): container finished" podID="6315f4f6-4090-45e8-bc50-b3d0e582d0c2" containerID="a1542082626f9f42d385f05855e4211a4ee7f90406568eac7ca0f798d2f89699" exitCode=0
Sep 15 09:36:53.539234 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.539113    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4" event={"ID":"6315f4f6-4090-45e8-bc50-b3d0e582d0c2","Type":"ContainerDied","Data":"a1542082626f9f42d385f05855e4211a4ee7f90406568eac7ca0f798d2f89699"}
Sep 15 09:36:53.646301 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.646279    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:36:53.752073 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752039    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tls-certs\") pod \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") "
Sep 15 09:36:53.752247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752099    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-model-cache\") pod \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") "
Sep 15 09:36:53.752247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752131    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-dshm\") pod \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") "
Sep 15 09:36:53.752247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752192    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-home\") pod \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") "
Sep 15 09:36:53.752247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752226    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6jvjx\" (UniqueName: \"kubernetes.io/projected/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-kube-api-access-6jvjx\") pod \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") "
Sep 15 09:36:53.752474 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752285    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tmp-dir\") pod \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\" (UID: \"6315f4f6-4090-45e8-bc50-b3d0e582d0c2\") "
Sep 15 09:36:53.752474 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752402    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-model-cache" (OuterVolumeSpecName: "model-cache") pod "6315f4f6-4090-45e8-bc50-b3d0e582d0c2" (UID: "6315f4f6-4090-45e8-bc50-b3d0e582d0c2"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:53.752588 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752503    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-home" (OuterVolumeSpecName: "home") pod "6315f4f6-4090-45e8-bc50-b3d0e582d0c2" (UID: "6315f4f6-4090-45e8-bc50-b3d0e582d0c2"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:53.752588 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752550    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6315f4f6-4090-45e8-bc50-b3d0e582d0c2" (UID: "6315f4f6-4090-45e8-bc50-b3d0e582d0c2"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:53.752683 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752612    2568 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-home\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:36:53.752683 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752623    2568 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tmp-dir\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:36:53.752683 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.752634    2568 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-model-cache\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:36:53.754603 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.754575    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-kube-api-access-6jvjx" (OuterVolumeSpecName: "kube-api-access-6jvjx") pod "6315f4f6-4090-45e8-bc50-b3d0e582d0c2" (UID: "6315f4f6-4090-45e8-bc50-b3d0e582d0c2"). InnerVolumeSpecName "kube-api-access-6jvjx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:36:53.754895 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.754872    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6315f4f6-4090-45e8-bc50-b3d0e582d0c2" (UID: "6315f4f6-4090-45e8-bc50-b3d0e582d0c2"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:36:53.754996 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.754920    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-dshm" (OuterVolumeSpecName: "dshm") pod "6315f4f6-4090-45e8-bc50-b3d0e582d0c2" (UID: "6315f4f6-4090-45e8-bc50-b3d0e582d0c2"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:36:53.853407 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.853375    2568 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-tls-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:36:53.853407 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.853400    2568 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-dshm\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:36:53.853407 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:53.853409    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6jvjx\" (UniqueName: \"kubernetes.io/projected/6315f4f6-4090-45e8-bc50-b3d0e582d0c2-kube-api-access-6jvjx\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:36:54.549678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:54.549646    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"
Sep 15 09:36:54.549678 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:54.549664    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4" event={"ID":"6315f4f6-4090-45e8-bc50-b3d0e582d0c2","Type":"ContainerDied","Data":"486eb2dca97288cd3c0a8ee2a830db60c2b431dfe89b1cfb1e3dcba8063bf4f5"}
Sep 15 09:36:54.550208 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:54.549710    2568 scope.go:117] "RemoveContainer" containerID="a1542082626f9f42d385f05855e4211a4ee7f90406568eac7ca0f798d2f89699"
Sep 15 09:36:54.570362 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:54.570336    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"]
Sep 15 09:36:54.575958 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:54.575938    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-w3-f79800/rate-test-model-f79800-kserve-5cc6888cd7-rcmt4"]
Sep 15 09:36:54.785640 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:54.785609    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6315f4f6-4090-45e8-bc50-b3d0e582d0c2" path="/var/lib/kubelet/pods/6315f4f6-4090-45e8-bc50-b3d0e582d0c2/volumes"
Sep 15 09:36:57.510001 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:57.509922    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:36:57.510383 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:36:57.510076    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:37:15.689622 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.689590    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"]
Sep 15 09:37:15.690095 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.689953    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6315f4f6-4090-45e8-bc50-b3d0e582d0c2" containerName="main"
Sep 15 09:37:15.690095 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.689964    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6315f4f6-4090-45e8-bc50-b3d0e582d0c2" containerName="main"
Sep 15 09:37:15.690095 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.690015    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6315f4f6-4090-45e8-bc50-b3d0e582d0c2" containerName="main"
Sep 15 09:37:15.692901 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.692885    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:15.695286 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.695269    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-6920e5\""
Sep 15 09:37:15.702828 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.702809    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"]
Sep 15 09:37:15.744244 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.744216    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"]
Sep 15 09:37:15.745766 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.745746    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd\" (UID: \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:15.745853 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.745793    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcqdb\" (UniqueName: \"kubernetes.io/projected/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-kube-api-access-pcqdb\") pod \"payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd\" (UID: \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:15.747515 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.747500    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:15.750107 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.750091    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-6920e5-dockercfg-27vgt\""
Sep 15 09:37:15.758071 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.758053    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"]
Sep 15 09:37:15.846621 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.846588    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcqdb\" (UniqueName: \"kubernetes.io/projected/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-kube-api-access-pcqdb\") pod \"payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd\" (UID: \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:15.846797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.846630    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ztwq9\" (UniqueName: \"kubernetes.io/projected/f8781c4c-d1f5-47a2-a832-f613457bb68c-kube-api-access-ztwq9\") pod \"payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b\" (UID: \"f8781c4c-d1f5-47a2-a832-f613457bb68c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:15.846797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.846663    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8781c4c-d1f5-47a2-a832-f613457bb68c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b\" (UID: \"f8781c4c-d1f5-47a2-a832-f613457bb68c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:15.846797 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.846783    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd\" (UID: \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:15.847475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.847455    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd\" (UID: \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:15.855125 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.855104    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcqdb\" (UniqueName: \"kubernetes.io/projected/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-kube-api-access-pcqdb\") pod \"payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd\" (UID: \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:15.947690 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.947605    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ztwq9\" (UniqueName: \"kubernetes.io/projected/f8781c4c-d1f5-47a2-a832-f613457bb68c-kube-api-access-ztwq9\") pod \"payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b\" (UID: \"f8781c4c-d1f5-47a2-a832-f613457bb68c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:15.947690 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.947642    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8781c4c-d1f5-47a2-a832-f613457bb68c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b\" (UID: \"f8781c4c-d1f5-47a2-a832-f613457bb68c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:15.948430 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.948412    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8781c4c-d1f5-47a2-a832-f613457bb68c-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b\" (UID: \"f8781c4c-d1f5-47a2-a832-f613457bb68c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:15.956011 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:15.955986    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ztwq9\" (UniqueName: \"kubernetes.io/projected/f8781c4c-d1f5-47a2-a832-f613457bb68c-kube-api-access-ztwq9\") pod \"payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b\" (UID: \"f8781c4c-d1f5-47a2-a832-f613457bb68c\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:16.004895 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.004832    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:16.057566 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.057532    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:16.276423 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.276396    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"]
Sep 15 09:37:16.278088 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:37:16.278060    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde3f53ec_3ff2_4a32_a3a5_8ed5ebf45835.slice/crio-f5aaa0a26b9ee65c21c413d478b469ea94c9bef690a4305d69bf1d463932f082 WatchSource:0}: Error finding container f5aaa0a26b9ee65c21c413d478b469ea94c9bef690a4305d69bf1d463932f082: Status 404 returned error can't find the container with id f5aaa0a26b9ee65c21c413d478b469ea94c9bef690a4305d69bf1d463932f082
Sep 15 09:37:16.339607 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.339578    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"]
Sep 15 09:37:16.340738 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:37:16.340707    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8781c4c_d1f5_47a2_a832_f613457bb68c.slice/crio-a0afb7a3a230a96be98efd73d435085593dfffd5f0abf837c76965a446eca984 WatchSource:0}: Error finding container a0afb7a3a230a96be98efd73d435085593dfffd5f0abf837c76965a446eca984: Status 404 returned error can't find the container with id a0afb7a3a230a96be98efd73d435085593dfffd5f0abf837c76965a446eca984
Sep 15 09:37:16.659299 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.659261    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b" event={"ID":"f8781c4c-d1f5-47a2-a832-f613457bb68c","Type":"ContainerStarted","Data":"c8d9b4ed747e96ccf6689d08146600d32668365fbdeccadca3954429e408367f"}
Sep 15 09:37:16.659482 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.659330    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:16.659482 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.659355    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b" event={"ID":"f8781c4c-d1f5-47a2-a832-f613457bb68c","Type":"ContainerStarted","Data":"a0afb7a3a230a96be98efd73d435085593dfffd5f0abf837c76965a446eca984"}
Sep 15 09:37:16.660900 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.660876    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd" event={"ID":"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835","Type":"ContainerStarted","Data":"ed0eed62444d3923edc2e2dde5dd12720fb91c8d90a4f52f024df03b899270e9"}
Sep 15 09:37:16.660990 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.660918    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd" event={"ID":"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835","Type":"ContainerStarted","Data":"f5aaa0a26b9ee65c21c413d478b469ea94c9bef690a4305d69bf1d463932f082"}
Sep 15 09:37:16.661056 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.661038    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:16.677364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.677318    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b" podStartSLOduration=1.677302509 podStartE2EDuration="1.677302509s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:37:16.675166746 +0000 UTC m=+1812.438738194" watchObservedRunningTime="2026-09-15 09:37:16.677302509 +0000 UTC m=+1812.440874007"
Sep 15 09:37:16.691097 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:16.691047    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd" podStartSLOduration=1.691027226 podStartE2EDuration="1.691027226s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:37:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:37:16.690138664 +0000 UTC m=+1812.453710114" watchObservedRunningTime="2026-09-15 09:37:16.691027226 +0000 UTC m=+1812.454598675"
Sep 15 09:37:27.667881 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:27.667826    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:37:27.668265 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:27.667927    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:37:42.458370 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:42.458340    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2t2zf_f8518e94-5fcf-4716-9b97-eb29e84d7fdc/payload-processing/0.log"
Sep 15 09:37:42.569589 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:37:42.569556    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b_f8781c4c-d1f5-47a2-a832-f613457bb68c/payload-processing/0.log"
Sep 15 09:38:05.171893 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:05.171863    2568 scope.go:117] "RemoveContainer" containerID="ae73918939bf4afae1148ac27379d3f76ac977c7d023129a8f3af6fdb44c5b6e"
Sep 15 09:38:05.181672 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:05.181648    2568 scope.go:117] "RemoveContainer" containerID="d1d75cb2ef72780b0e70fb6028bbae5e14462375d079e6dae10a271b7445fca4"
Sep 15 09:38:18.314063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:18.314032    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62_6ae52313-2e5d-4fc7-aa6c-accbdd655b32/payload-processing/0.log"
Sep 15 09:38:18.441814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:18.441780    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2t2zf_f8518e94-5fcf-4716-9b97-eb29e84d7fdc/payload-processing/0.log"
Sep 15 09:38:18.557771 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:18.557743    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b_f8781c4c-d1f5-47a2-a832-f613457bb68c/payload-processing/0.log"
Sep 15 09:38:19.121878 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.121822    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"]
Sep 15 09:38:19.125526 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.125504    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.128705 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.128681    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-14495e-openshift-default-dockercfg-g9mm2\""
Sep 15 09:38:19.142714 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.142689    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"]
Sep 15 09:38:19.192246 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192212    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-data\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.192438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192256    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-istio-token\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.192438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192288    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srh22\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-kube-api-access-srh22\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.192438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192360    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-socket\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.192438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192402    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0ee65f-a25f-4da9-962a-108198f14720-istiod-ca-cert\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.192438 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192439    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-certs\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.192658 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192510    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-envoy\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.192658 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192557    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0ee65f-a25f-4da9-962a-108198f14720-istio-podinfo\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.192658 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.192588    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-credential-socket\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294031    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-data\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294077    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-istio-token\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294099    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srh22\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-kube-api-access-srh22\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294118    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-socket\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294140    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0ee65f-a25f-4da9-962a-108198f14720-istiod-ca-cert\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294174    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-certs\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294220    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-envoy\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294257    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0ee65f-a25f-4da9-962a-108198f14720-istio-podinfo\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294287    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-credential-socket\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294698 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294519    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-data\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294698 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294554    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-socket\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294706    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-certs\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294908 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294888    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-credential-socket\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.294982 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.294938    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0ee65f-a25f-4da9-962a-108198f14720-istiod-ca-cert\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.296747 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.296713    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-envoy\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.297229 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.297210    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0ee65f-a25f-4da9-962a-108198f14720-istio-podinfo\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.302560 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.302537    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-istio-token\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.303356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.303336    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srh22\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-kube-api-access-srh22\") pod \"e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") " pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.437356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.437319    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:19.731250 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.731213    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"]
Sep 15 09:38:19.734197 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:38:19.734169    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd0ee65f_a25f_4da9_962a_108198f14720.slice/crio-f6565d0e2467c1e8008625f9ae066d5825e852083c2d47880b176d6be2fc1afe WatchSource:0}: Error finding container f6565d0e2467c1e8008625f9ae066d5825e852083c2d47880b176d6be2fc1afe: Status 404 returned error can't find the container with id f6565d0e2467c1e8008625f9ae066d5825e852083c2d47880b176d6be2fc1afe
Sep 15 09:38:19.736855 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.736808    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:38:19.736935 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.736914    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:38:19.737003 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.736979    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:38:19.974640 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.974606    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" event={"ID":"dd0ee65f-a25f-4da9-962a-108198f14720","Type":"ContainerStarted","Data":"6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96"}
Sep 15 09:38:19.974820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:19.974660    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" event={"ID":"dd0ee65f-a25f-4da9-962a-108198f14720","Type":"ContainerStarted","Data":"f6565d0e2467c1e8008625f9ae066d5825e852083c2d47880b176d6be2fc1afe"}
Sep 15 09:38:20.009784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:20.009688    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podStartSLOduration=1.009670439 podStartE2EDuration="1.009670439s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:38:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:38:20.008768807 +0000 UTC m=+1875.772340273" watchObservedRunningTime="2026-09-15 09:38:20.009670439 +0000 UTC m=+1875.773241887"
Sep 15 09:38:20.438492 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:20.438453    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:20.440302 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:20.440280    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 15 09:38:20.440430 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:20.440327    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 15 09:38:21.442171 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:21.442137    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:21.984129 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:21.984096    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:21.985511 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:21.985492    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:25.529311 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.529224    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"]
Sep 15 09:38:25.532783 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.532768    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:25.535463 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.535439    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-14495e-dockercfg-qrdsv\""
Sep 15 09:38:25.535579 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.535444    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-14495e\""
Sep 15 09:38:25.542232 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.542210    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"]
Sep 15 09:38:25.657396 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.657345    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ae43d28-d551-4639-9ba4-be2e676c78f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb\" (UID: \"4ae43d28-d551-4639-9ba4-be2e676c78f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:25.657586 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.657424    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn68v\" (UniqueName: \"kubernetes.io/projected/4ae43d28-d551-4639-9ba4-be2e676c78f7-kube-api-access-hn68v\") pod \"payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb\" (UID: \"4ae43d28-d551-4639-9ba4-be2e676c78f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:25.758654 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.758617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ae43d28-d551-4639-9ba4-be2e676c78f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb\" (UID: \"4ae43d28-d551-4639-9ba4-be2e676c78f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:25.758814 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.758679    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn68v\" (UniqueName: \"kubernetes.io/projected/4ae43d28-d551-4639-9ba4-be2e676c78f7-kube-api-access-hn68v\") pod \"payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb\" (UID: \"4ae43d28-d551-4639-9ba4-be2e676c78f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:25.759330 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.759311    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ae43d28-d551-4639-9ba4-be2e676c78f7-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb\" (UID: \"4ae43d28-d551-4639-9ba4-be2e676c78f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:25.767013 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.766991    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn68v\" (UniqueName: \"kubernetes.io/projected/4ae43d28-d551-4639-9ba4-be2e676c78f7-kube-api-access-hn68v\") pod \"payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb\" (UID: \"4ae43d28-d551-4639-9ba4-be2e676c78f7\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:25.844169 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:25.844090    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:26.115779 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:26.115691    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"]
Sep 15 09:38:26.118984 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:38:26.118955    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ae43d28_d551_4639_9ba4_be2e676c78f7.slice/crio-1b397a20b9e7be720ed15fa0ebf68f30fca8829bc75108ee5c4d907b5a5b4973 WatchSource:0}: Error finding container 1b397a20b9e7be720ed15fa0ebf68f30fca8829bc75108ee5c4d907b5a5b4973: Status 404 returned error can't find the container with id 1b397a20b9e7be720ed15fa0ebf68f30fca8829bc75108ee5c4d907b5a5b4973
Sep 15 09:38:27.010455 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:27.010416    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb" event={"ID":"4ae43d28-d551-4639-9ba4-be2e676c78f7","Type":"ContainerStarted","Data":"08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd"}
Sep 15 09:38:27.010884 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:27.010472    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb" event={"ID":"4ae43d28-d551-4639-9ba4-be2e676c78f7","Type":"ContainerStarted","Data":"1b397a20b9e7be720ed15fa0ebf68f30fca8829bc75108ee5c4d907b5a5b4973"}
Sep 15 09:38:27.010884 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:27.010515    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:27.028075 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:27.028023    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb" podStartSLOduration=2.028004184 podStartE2EDuration="2.028004184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:38:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:38:27.026174385 +0000 UTC m=+1882.789745832" watchObservedRunningTime="2026-09-15 09:38:27.028004184 +0000 UTC m=+1882.791575634"
Sep 15 09:38:38.018187 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:38.018152    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:43.096621 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:43.096589    2568 generic.go:356] "Generic (PLEG): container finished" podID="dd0ee65f-a25f-4da9-962a-108198f14720" containerID="6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96" exitCode=0
Sep 15 09:38:43.097070 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:43.096666    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" event={"ID":"dd0ee65f-a25f-4da9-962a-108198f14720","Type":"ContainerDied","Data":"6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96"}
Sep 15 09:38:43.097121 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:43.097079    2568 scope.go:117] "RemoveContainer" containerID="6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96"
Sep 15 09:38:43.098261 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:43.098233    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:38:43.098319 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:43.098303    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:38:43.098356 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:43.098332    2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892144Ki","pods":"250"}
Sep 15 09:38:44.112313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:44.112264    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" event={"ID":"dd0ee65f-a25f-4da9-962a-108198f14720","Type":"ContainerStarted","Data":"37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2"}
Sep 15 09:38:44.437832 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:44.437793    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:44.438070 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:44.438048    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 15 09:38:44.438128 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:44.438109    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 15 09:38:45.438098 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:45.438059    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 15 09:38:45.438500 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:45.438134    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 15 09:38:46.438284 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:46.438249    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 15 09:38:46.438683 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:46.438322    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 15 09:38:47.437979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.437948    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 15 09:38:47.438161 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.438002    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 15 09:38:47.492405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.492368    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"]
Sep 15 09:38:47.497234 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.497202    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"
Sep 15 09:38:47.502667 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.502636    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:38:47.506150 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.506121    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"]
Sep 15 09:38:47.506288 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.506260    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:38:47.666265 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.666231    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf8c1088-d771-43d1-bada-1c741a9d58f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr\" (UID: \"bf8c1088-d771-43d1-bada-1c741a9d58f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"
Sep 15 09:38:47.767705 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.767617    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf8c1088-d771-43d1-bada-1c741a9d58f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr\" (UID: \"bf8c1088-d771-43d1-bada-1c741a9d58f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"
Sep 15 09:38:47.768350 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.768329    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf8c1088-d771-43d1-bada-1c741a9d58f4-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr\" (UID: \"bf8c1088-d771-43d1-bada-1c741a9d58f4\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"
Sep 15 09:38:47.816240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:47.815943    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"
Sep 15 09:38:48.095197 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:48.092134    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"]
Sep 15 09:38:48.134804 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:48.134750    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr" event={"ID":"bf8c1088-d771-43d1-bada-1c741a9d58f4","Type":"ContainerStarted","Data":"c7b723670eaa0e9c81925250a4ad8c9ca7246d330fd058b9256440a7ba3d34bb"}
Sep 15 09:38:48.438388 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:48.438362    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused" start-of-body=
Sep 15 09:38:48.438544 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:48.438408    2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.88:15021/healthz/ready\": dial tcp 10.134.0.88:15021: connect: connection refused"
Sep 15 09:38:49.140799 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:49.140762    2568 generic.go:356] "Generic (PLEG): container finished" podID="bf8c1088-d771-43d1-bada-1c741a9d58f4" containerID="2b7a045378279f29855c1a00db2d3977b1624244ecd8497fc10455d0c85e1082" exitCode=0
Sep 15 09:38:49.141223 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:49.140828    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr" event={"ID":"bf8c1088-d771-43d1-bada-1c741a9d58f4","Type":"ContainerDied","Data":"2b7a045378279f29855c1a00db2d3977b1624244ecd8497fc10455d0c85e1082"}
Sep 15 09:38:49.529114 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:49.529076    2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:49.529515 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:49.529492    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:49.531786 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:49.531766    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:38:50.282200 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:50.282175    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"
Sep 15 09:38:50.392561 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:50.392518    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf8c1088-d771-43d1-bada-1c741a9d58f4-maas-api-service-ca\") pod \"bf8c1088-d771-43d1-bada-1c741a9d58f4\" (UID: \"bf8c1088-d771-43d1-bada-1c741a9d58f4\") "
Sep 15 09:38:50.392927 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:50.392902    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bf8c1088-d771-43d1-bada-1c741a9d58f4-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bf8c1088-d771-43d1-bada-1c741a9d58f4" (UID: "bf8c1088-d771-43d1-bada-1c741a9d58f4"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:38:50.493247 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:50.493202    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bf8c1088-d771-43d1-bada-1c741a9d58f4-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:38:51.152400 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:51.152309    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"
Sep 15 09:38:51.152400 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:51.152338    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr" event={"ID":"bf8c1088-d771-43d1-bada-1c741a9d58f4","Type":"ContainerDied","Data":"c7b723670eaa0e9c81925250a4ad8c9ca7246d330fd058b9256440a7ba3d34bb"}
Sep 15 09:38:51.152400 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:51.152388    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7b723670eaa0e9c81925250a4ad8c9ca7246d330fd058b9256440a7ba3d34bb"
Sep 15 09:38:53.851001 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:53.850966    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"]
Sep 15 09:38:53.851993 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:53.851954    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb" podUID="4ae43d28-d551-4639-9ba4-be2e676c78f7" containerName="payload-pre-processing" containerID="cri-o://08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd" gracePeriod=30
Sep 15 09:38:54.091953 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.091912    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"]
Sep 15 09:38:54.094021 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.093992    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-cleanup-14495e-mvsvr"]
Sep 15 09:38:54.107065 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.107009    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:54.173164 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.173135    2568 generic.go:356] "Generic (PLEG): container finished" podID="4ae43d28-d551-4639-9ba4-be2e676c78f7" containerID="08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd" exitCode=0
Sep 15 09:38:54.173326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.173178    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"
Sep 15 09:38:54.173326 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.173228    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb" event={"ID":"4ae43d28-d551-4639-9ba4-be2e676c78f7","Type":"ContainerDied","Data":"08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd"}
Sep 15 09:38:54.173424 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.173328    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb" event={"ID":"4ae43d28-d551-4639-9ba4-be2e676c78f7","Type":"ContainerDied","Data":"1b397a20b9e7be720ed15fa0ebf68f30fca8829bc75108ee5c4d907b5a5b4973"}
Sep 15 09:38:54.173424 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.173365    2568 scope.go:117] "RemoveContainer" containerID="08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd"
Sep 15 09:38:54.182557 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.182540    2568 scope.go:117] "RemoveContainer" containerID="08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd"
Sep 15 09:38:54.182929 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:38:54.182905    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd\": container with ID starting with 08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd not found: ID does not exist" containerID="08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd"
Sep 15 09:38:54.182999 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.182939    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd"} err="failed to get container status \"08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd\": rpc error: code = NotFound desc = could not find container \"08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd\": container with ID starting with 08ced6ffe5ba224685c0726ca05cc53d4e03a519d8912c9ec087b9745f3c6bcd not found: ID does not exist"
Sep 15 09:38:54.231307 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.231275    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ae43d28-d551-4639-9ba4-be2e676c78f7-plugins-config-volume\") pod \"4ae43d28-d551-4639-9ba4-be2e676c78f7\" (UID: \"4ae43d28-d551-4639-9ba4-be2e676c78f7\") "
Sep 15 09:38:54.231307 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.231317    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hn68v\" (UniqueName: \"kubernetes.io/projected/4ae43d28-d551-4639-9ba4-be2e676c78f7-kube-api-access-hn68v\") pod \"4ae43d28-d551-4639-9ba4-be2e676c78f7\" (UID: \"4ae43d28-d551-4639-9ba4-be2e676c78f7\") "
Sep 15 09:38:54.231776 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.231744    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4ae43d28-d551-4639-9ba4-be2e676c78f7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "4ae43d28-d551-4639-9ba4-be2e676c78f7" (UID: "4ae43d28-d551-4639-9ba4-be2e676c78f7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:38:54.233736 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.233705    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4ae43d28-d551-4639-9ba4-be2e676c78f7-kube-api-access-hn68v" (OuterVolumeSpecName: "kube-api-access-hn68v") pod "4ae43d28-d551-4639-9ba4-be2e676c78f7" (UID: "4ae43d28-d551-4639-9ba4-be2e676c78f7"). InnerVolumeSpecName "kube-api-access-hn68v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:38:54.332594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.332561    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/4ae43d28-d551-4639-9ba4-be2e676c78f7-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:38:54.332594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.332588    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hn68v\" (UniqueName: \"kubernetes.io/projected/4ae43d28-d551-4639-9ba4-be2e676c78f7-kube-api-access-hn68v\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:38:54.497202 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.497162    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"]
Sep 15 09:38:54.501088 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.501063    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-14495e-d9dcdc78b-9tfkb"]
Sep 15 09:38:54.790103 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.790023    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4ae43d28-d551-4639-9ba4-be2e676c78f7" path="/var/lib/kubelet/pods/4ae43d28-d551-4639-9ba4-be2e676c78f7/volumes"
Sep 15 09:38:54.790368 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:38:54.790355    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf8c1088-d771-43d1-bada-1c741a9d58f4" path="/var/lib/kubelet/pods/bf8c1088-d771-43d1-bada-1c741a9d58f4/volumes"
Sep 15 09:39:00.396367 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:00.396338    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"]
Sep 15 09:39:00.396802 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:00.396535    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy" containerID="cri-o://37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2" gracePeriod=30
Sep 15 09:39:03.867059 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.867024    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"]
Sep 15 09:39:03.867497 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.867434    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4ae43d28-d551-4639-9ba4-be2e676c78f7" containerName="payload-pre-processing"
Sep 15 09:39:03.867497 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.867448    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4ae43d28-d551-4639-9ba4-be2e676c78f7" containerName="payload-pre-processing"
Sep 15 09:39:03.867497 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.867465    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf8c1088-d771-43d1-bada-1c741a9d58f4" containerName="revoke-keys"
Sep 15 09:39:03.867497 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.867471    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf8c1088-d771-43d1-bada-1c741a9d58f4" containerName="revoke-keys"
Sep 15 09:39:03.867654 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.867534    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf8c1088-d771-43d1-bada-1c741a9d58f4" containerName="revoke-keys"
Sep 15 09:39:03.867654 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.867544    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4ae43d28-d551-4639-9ba4-be2e676c78f7" containerName="payload-pre-processing"
Sep 15 09:39:03.871773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.871756    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"
Sep 15 09:39:03.874679 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.874648    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:39:03.875660 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.875636    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:39:03.878655 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.878626    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"]
Sep 15 09:39:03.909863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:03.909809    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/916c35ac-d981-46bc-9463-907fe2ff2a19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q\" (UID: \"916c35ac-d981-46bc-9463-907fe2ff2a19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"
Sep 15 09:39:04.011409 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:04.011372    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/916c35ac-d981-46bc-9463-907fe2ff2a19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q\" (UID: \"916c35ac-d981-46bc-9463-907fe2ff2a19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"
Sep 15 09:39:04.012033 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:04.012008    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/916c35ac-d981-46bc-9463-907fe2ff2a19-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q\" (UID: \"916c35ac-d981-46bc-9463-907fe2ff2a19\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"
Sep 15 09:39:04.183869 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:04.183816    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"
Sep 15 09:39:04.456229 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:04.456203    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"]
Sep 15 09:39:04.458486 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:39:04.458461    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod916c35ac_d981_46bc_9463_907fe2ff2a19.slice/crio-395746a758293293652d8aedb8dd034fe2fb63640ec31e50af528c6894acf608 WatchSource:0}: Error finding container 395746a758293293652d8aedb8dd034fe2fb63640ec31e50af528c6894acf608: Status 404 returned error can't find the container with id 395746a758293293652d8aedb8dd034fe2fb63640ec31e50af528c6894acf608
Sep 15 09:39:04.532033 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:04.532001    2568 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 15 09:39:04.532159 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:04.532055    2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 15 09:39:05.204049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.204022    2568 scope.go:117] "RemoveContainer" containerID="1ee5f4c99904a8f9030dd2759cc4991a9b31a0f13ab26baa899ce2a4fbb8e6b4"
Sep 15 09:39:05.212570 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.212546    2568 scope.go:117] "RemoveContainer" containerID="da5b7b57b84ccf08ab61df782ce4923c40c7df1bf7455290d4934a70c82aab2a"
Sep 15 09:39:05.222426 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.222403    2568 scope.go:117] "RemoveContainer" containerID="edc730430bb16e4519b55e15e9d2669671692492a2f553cc918617a14c8aa5dc"
Sep 15 09:39:05.231312 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.231286    2568 generic.go:356] "Generic (PLEG): container finished" podID="916c35ac-d981-46bc-9463-907fe2ff2a19" containerID="59f306abfabfa29ceb1bebc5d9c8bfdfca0fa476b4d3f6d67662e2ecf1a78877" exitCode=0
Sep 15 09:39:05.231448 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.231351    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q" event={"ID":"916c35ac-d981-46bc-9463-907fe2ff2a19","Type":"ContainerDied","Data":"59f306abfabfa29ceb1bebc5d9c8bfdfca0fa476b4d3f6d67662e2ecf1a78877"}
Sep 15 09:39:05.231448 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.231408    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q" event={"ID":"916c35ac-d981-46bc-9463-907fe2ff2a19","Type":"ContainerStarted","Data":"395746a758293293652d8aedb8dd034fe2fb63640ec31e50af528c6894acf608"}
Sep 15 09:39:05.649622 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.649596    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:39:05.727369 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727295    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-certs\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727369 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727326    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-data\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727369 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727358    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0ee65f-a25f-4da9-962a-108198f14720-istiod-ca-cert\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727407    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-socket\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727425    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-credential-socket\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727443    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0ee65f-a25f-4da9-962a-108198f14720-istio-podinfo\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727471    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srh22\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-kube-api-access-srh22\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727502    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-envoy\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727534    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-istio-token\") pod \"dd0ee65f-a25f-4da9-962a-108198f14720\" (UID: \"dd0ee65f-a25f-4da9-962a-108198f14720\") "
Sep 15 09:39:05.727656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727545    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:39:05.727656 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727559    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:39:05.728068 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727709    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:39:05.728068 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727738    2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:05.728068 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727773    2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-data\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:05.728068 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727774    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:39:05.728068 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.727787    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd0ee65f-a25f-4da9-962a-108198f14720-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:39:05.729979 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.729959    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:39:05.730113 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.730093    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 15 09:39:05.730308 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.730273    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd0ee65f-a25f-4da9-962a-108198f14720-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 15 09:39:05.730397 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.730276    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-kube-api-access-srh22" (OuterVolumeSpecName: "kube-api-access-srh22") pod "dd0ee65f-a25f-4da9-962a-108198f14720" (UID: "dd0ee65f-a25f-4da9-962a-108198f14720"). InnerVolumeSpecName "kube-api-access-srh22". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:39:05.829160 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.829125    2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-workload-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:05.829160 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.829153    2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-credential-socket\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:05.829160 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.829163    2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd0ee65f-a25f-4da9-962a-108198f14720-istio-podinfo\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:05.829401 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.829173    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srh22\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-kube-api-access-srh22\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:05.829401 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.829182    2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd0ee65f-a25f-4da9-962a-108198f14720-istio-envoy\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:05.829401 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.829190    2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd0ee65f-a25f-4da9-962a-108198f14720-istio-token\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:05.829401 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:05.829198    2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd0ee65f-a25f-4da9-962a-108198f14720-istiod-ca-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:06.239778 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.239745    2568 generic.go:356] "Generic (PLEG): container finished" podID="dd0ee65f-a25f-4da9-962a-108198f14720" containerID="37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2" exitCode=0
Sep 15 09:39:06.240242 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.239806    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"
Sep 15 09:39:06.240242 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.239831    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" event={"ID":"dd0ee65f-a25f-4da9-962a-108198f14720","Type":"ContainerDied","Data":"37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2"}
Sep 15 09:39:06.240242 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.239912    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls" event={"ID":"dd0ee65f-a25f-4da9-962a-108198f14720","Type":"ContainerDied","Data":"f6565d0e2467c1e8008625f9ae066d5825e852083c2d47880b176d6be2fc1afe"}
Sep 15 09:39:06.240242 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.239935    2568 scope.go:117] "RemoveContainer" containerID="37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2"
Sep 15 09:39:06.250565 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.250537    2568 scope.go:117] "RemoveContainer" containerID="6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96"
Sep 15 09:39:06.262457 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.262406    2568 scope.go:117] "RemoveContainer" containerID="37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2"
Sep 15 09:39:06.262974 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:39:06.262879    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2\": container with ID starting with 37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2 not found: ID does not exist" containerID="37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2"
Sep 15 09:39:06.262974 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.262916    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2"} err="failed to get container status \"37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2\": rpc error: code = NotFound desc = could not find container \"37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2\": container with ID starting with 37f4ed88415af97f37d1dfd6f2b25b5da190d4e8812ff74a35278ea6826aefe2 not found: ID does not exist"
Sep 15 09:39:06.262974 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.262944    2568 scope.go:117] "RemoveContainer" containerID="6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96"
Sep 15 09:39:06.263258 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:39:06.263226    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96\": container with ID starting with 6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96 not found: ID does not exist" containerID="6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96"
Sep 15 09:39:06.263322 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.263262    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96"} err="failed to get container status \"6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96\": rpc error: code = NotFound desc = could not find container \"6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96\": container with ID starting with 6c6eda4f09fb9661355d2fc8bbd6388adacb6bd63811e7c34b29e0f51af43d96 not found: ID does not exist"
Sep 15 09:39:06.265633 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.265609    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"]
Sep 15 09:39:06.271713 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.271691    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-14495e-openshift-default-769589479b-sfcls"]
Sep 15 09:39:06.372459 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.372439    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"
Sep 15 09:39:06.434155 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.434127    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/916c35ac-d981-46bc-9463-907fe2ff2a19-maas-api-service-ca\") pod \"916c35ac-d981-46bc-9463-907fe2ff2a19\" (UID: \"916c35ac-d981-46bc-9463-907fe2ff2a19\") "
Sep 15 09:39:06.434469 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.434446    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/916c35ac-d981-46bc-9463-907fe2ff2a19-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "916c35ac-d981-46bc-9463-907fe2ff2a19" (UID: "916c35ac-d981-46bc-9463-907fe2ff2a19"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:39:06.535261 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.535187    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/916c35ac-d981-46bc-9463-907fe2ff2a19-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:06.786007 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:06.785930    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" path="/var/lib/kubelet/pods/dd0ee65f-a25f-4da9-962a-108198f14720/volumes"
Sep 15 09:39:07.249592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:07.249553    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q" event={"ID":"916c35ac-d981-46bc-9463-907fe2ff2a19","Type":"ContainerDied","Data":"395746a758293293652d8aedb8dd034fe2fb63640ec31e50af528c6894acf608"}
Sep 15 09:39:07.249592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:07.249572    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"
Sep 15 09:39:07.249592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:07.249600    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="395746a758293293652d8aedb8dd034fe2fb63640ec31e50af528c6894acf608"
Sep 15 09:39:19.392523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.392483    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"]
Sep 15 09:39:19.393041 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.392743    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62" podUID="6ae52313-2e5d-4fc7-aa6c-accbdd655b32" containerName="payload-processing" containerID="cri-o://4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812" gracePeriod=30
Sep 15 09:39:19.401419 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.401265    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"]
Sep 15 09:39:19.401508 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.401483    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk" podUID="a1715660-e3ad-4125-9822-f8c517852a2b" containerName="payload-pre-processing" containerID="cri-o://f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3" gracePeriod=30
Sep 15 09:39:19.576830 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.576765    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"]
Sep 15 09:39:19.578876 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.578834    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-a-08aa53-7cq6q"]
Sep 15 09:39:19.683453 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.683427    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:39:19.686164 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.686147    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:39:19.752991 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.752961    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-plugins-config-volume\") pod \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\" (UID: \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\") "
Sep 15 09:39:19.753186 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.753007    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkbqh\" (UniqueName: \"kubernetes.io/projected/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-kube-api-access-mkbqh\") pod \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\" (UID: \"6ae52313-2e5d-4fc7-aa6c-accbdd655b32\") "
Sep 15 09:39:19.753186 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.753056    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1715660-e3ad-4125-9822-f8c517852a2b-plugins-config-volume\") pod \"a1715660-e3ad-4125-9822-f8c517852a2b\" (UID: \"a1715660-e3ad-4125-9822-f8c517852a2b\") "
Sep 15 09:39:19.753186 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.753095    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p4wc8\" (UniqueName: \"kubernetes.io/projected/a1715660-e3ad-4125-9822-f8c517852a2b-kube-api-access-p4wc8\") pod \"a1715660-e3ad-4125-9822-f8c517852a2b\" (UID: \"a1715660-e3ad-4125-9822-f8c517852a2b\") "
Sep 15 09:39:19.753410 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.753379    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6ae52313-2e5d-4fc7-aa6c-accbdd655b32" (UID: "6ae52313-2e5d-4fc7-aa6c-accbdd655b32"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:39:19.753885 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.753836    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a1715660-e3ad-4125-9822-f8c517852a2b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a1715660-e3ad-4125-9822-f8c517852a2b" (UID: "a1715660-e3ad-4125-9822-f8c517852a2b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:39:19.755936 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.755908    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a1715660-e3ad-4125-9822-f8c517852a2b-kube-api-access-p4wc8" (OuterVolumeSpecName: "kube-api-access-p4wc8") pod "a1715660-e3ad-4125-9822-f8c517852a2b" (UID: "a1715660-e3ad-4125-9822-f8c517852a2b"). InnerVolumeSpecName "kube-api-access-p4wc8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:39:19.756028 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.756005    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-kube-api-access-mkbqh" (OuterVolumeSpecName: "kube-api-access-mkbqh") pod "6ae52313-2e5d-4fc7-aa6c-accbdd655b32" (UID: "6ae52313-2e5d-4fc7-aa6c-accbdd655b32"). InnerVolumeSpecName "kube-api-access-mkbqh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:39:19.854773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.854733    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:19.854773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.854763    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkbqh\" (UniqueName: \"kubernetes.io/projected/6ae52313-2e5d-4fc7-aa6c-accbdd655b32-kube-api-access-mkbqh\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:19.854773 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.854777    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a1715660-e3ad-4125-9822-f8c517852a2b-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:19.855041 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:19.854789    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p4wc8\" (UniqueName: \"kubernetes.io/projected/a1715660-e3ad-4125-9822-f8c517852a2b-kube-api-access-p4wc8\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:39:20.318277 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.318239    2568 generic.go:356] "Generic (PLEG): container finished" podID="a1715660-e3ad-4125-9822-f8c517852a2b" containerID="f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3" exitCode=0
Sep 15 09:39:20.318459 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.318306    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"
Sep 15 09:39:20.318459 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.318320    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk" event={"ID":"a1715660-e3ad-4125-9822-f8c517852a2b","Type":"ContainerDied","Data":"f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3"}
Sep 15 09:39:20.318459 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.318376    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk" event={"ID":"a1715660-e3ad-4125-9822-f8c517852a2b","Type":"ContainerDied","Data":"79808c60ccd0515af081a56a1cdfc15f9c4591a36fa52edd8f2dd295672ab757"}
Sep 15 09:39:20.318459 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.318403    2568 scope.go:117] "RemoveContainer" containerID="f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3"
Sep 15 09:39:20.319760 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.319735    2568 generic.go:356] "Generic (PLEG): container finished" podID="6ae52313-2e5d-4fc7-aa6c-accbdd655b32" containerID="4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812" exitCode=0
Sep 15 09:39:20.319959 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.319763    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62" event={"ID":"6ae52313-2e5d-4fc7-aa6c-accbdd655b32","Type":"ContainerDied","Data":"4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812"}
Sep 15 09:39:20.320064 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.319984    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62" event={"ID":"6ae52313-2e5d-4fc7-aa6c-accbdd655b32","Type":"ContainerDied","Data":"c73be229cb1bbfeb5b185a43b59317b7c5b096ea7d09643a06996e5699dc5f26"}
Sep 15 09:39:20.320064 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.319784    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"
Sep 15 09:39:20.335882 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.335808    2568 scope.go:117] "RemoveContainer" containerID="f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3"
Sep 15 09:39:20.336270 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:39:20.336245    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3\": container with ID starting with f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3 not found: ID does not exist" containerID="f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3"
Sep 15 09:39:20.336344 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.336277    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3"} err="failed to get container status \"f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3\": rpc error: code = NotFound desc = could not find container \"f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3\": container with ID starting with f9f1f00becdf46324cfe74ca602fc85dd001f9fa7b315201c8ec3d69c4761ed3 not found: ID does not exist"
Sep 15 09:39:20.336344 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.336295    2568 scope.go:117] "RemoveContainer" containerID="4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812"
Sep 15 09:39:20.344609 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.344586    2568 scope.go:117] "RemoveContainer" containerID="4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812"
Sep 15 09:39:20.344925 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:39:20.344907    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812\": container with ID starting with 4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812 not found: ID does not exist" containerID="4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812"
Sep 15 09:39:20.344980 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.344933    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812"} err="failed to get container status \"4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812\": rpc error: code = NotFound desc = could not find container \"4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812\": container with ID starting with 4f6d0bf0cc2da416627b908030d0ffdcd527309c4f7cc02fffdf055fdfc34812 not found: ID does not exist"
Sep 15 09:39:20.350397 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.350374    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"]
Sep 15 09:39:20.352165 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.352145    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-08aa53-8655688949-qjs62"]
Sep 15 09:39:20.366647 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.366624    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"]
Sep 15 09:39:20.385442 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.385411    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-08aa53-66c8857cd-b8jqk"]
Sep 15 09:39:20.785885 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.785830    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ae52313-2e5d-4fc7-aa6c-accbdd655b32" path="/var/lib/kubelet/pods/6ae52313-2e5d-4fc7-aa6c-accbdd655b32/volumes"
Sep 15 09:39:20.786263 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.786215    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="916c35ac-d981-46bc-9463-907fe2ff2a19" path="/var/lib/kubelet/pods/916c35ac-d981-46bc-9463-907fe2ff2a19/volumes"
Sep 15 09:39:20.786559 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:39:20.786545    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a1715660-e3ad-4125-9822-f8c517852a2b" path="/var/lib/kubelet/pods/a1715660-e3ad-4125-9822-f8c517852a2b/volumes"
Sep 15 09:40:05.252969 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:05.252936    2568 scope.go:117] "RemoveContainer" containerID="b6dd0127dc504156fe0e9cd10a59550282d06b14f43f0b61054e52a46cb155a9"
Sep 15 09:40:08.648866 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.648816    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"]
Sep 15 09:40:08.649359 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649339    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="916c35ac-d981-46bc-9463-907fe2ff2a19" containerName="revoke-keys"
Sep 15 09:40:08.649444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649363    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="916c35ac-d981-46bc-9463-907fe2ff2a19" containerName="revoke-keys"
Sep 15 09:40:08.649444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649376    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy"
Sep 15 09:40:08.649444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649384    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy"
Sep 15 09:40:08.649444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649401    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ae52313-2e5d-4fc7-aa6c-accbdd655b32" containerName="payload-processing"
Sep 15 09:40:08.649444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649410    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ae52313-2e5d-4fc7-aa6c-accbdd655b32" containerName="payload-processing"
Sep 15 09:40:08.649444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649420    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a1715660-e3ad-4125-9822-f8c517852a2b" containerName="payload-pre-processing"
Sep 15 09:40:08.649444 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649429    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a1715660-e3ad-4125-9822-f8c517852a2b" containerName="payload-pre-processing"
Sep 15 09:40:08.649784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649518    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy"
Sep 15 09:40:08.649784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649531    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ae52313-2e5d-4fc7-aa6c-accbdd655b32" containerName="payload-processing"
Sep 15 09:40:08.649784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649545    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a1715660-e3ad-4125-9822-f8c517852a2b" containerName="payload-pre-processing"
Sep 15 09:40:08.649784 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.649554    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="916c35ac-d981-46bc-9463-907fe2ff2a19" containerName="revoke-keys"
Sep 15 09:40:08.652563 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.652542    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"
Sep 15 09:40:08.655230 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.655205    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:40:08.655329 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.655255    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:40:08.659200 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.659168    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"]
Sep 15 09:40:08.775212 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.775179    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36266523-979e-474d-a411-c29a3008ad6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28\" (UID: \"36266523-979e-474d-a411-c29a3008ad6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"
Sep 15 09:40:08.876549 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.876506    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36266523-979e-474d-a411-c29a3008ad6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28\" (UID: \"36266523-979e-474d-a411-c29a3008ad6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"
Sep 15 09:40:08.877184 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.877163    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36266523-979e-474d-a411-c29a3008ad6e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28\" (UID: \"36266523-979e-474d-a411-c29a3008ad6e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"
Sep 15 09:40:08.963811 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:08.963777    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"
Sep 15 09:40:09.235573 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:09.235548    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"]
Sep 15 09:40:09.237631 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:40:09.237601    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36266523_979e_474d_a411_c29a3008ad6e.slice/crio-e9d0e8847830786b20e7ce1ec65222294b33baa6c6bc1775235fb6b661b8e6a8 WatchSource:0}: Error finding container e9d0e8847830786b20e7ce1ec65222294b33baa6c6bc1775235fb6b661b8e6a8: Status 404 returned error can't find the container with id e9d0e8847830786b20e7ce1ec65222294b33baa6c6bc1775235fb6b661b8e6a8
Sep 15 09:40:09.552776 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:09.552748    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28" event={"ID":"36266523-979e-474d-a411-c29a3008ad6e","Type":"ContainerStarted","Data":"15d656a45f512028e1ca9311503b4903fdd74b3b451a15bb439cf1130f92723e"}
Sep 15 09:40:09.552942 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:09.552805    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28" event={"ID":"36266523-979e-474d-a411-c29a3008ad6e","Type":"ContainerStarted","Data":"e9d0e8847830786b20e7ce1ec65222294b33baa6c6bc1775235fb6b661b8e6a8"}
Sep 15 09:40:09.568669 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:09.568625    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28" podStartSLOduration=1.568610362 podStartE2EDuration="1.568610362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:40:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:40:09.566825542 +0000 UTC m=+1985.330396990" watchObservedRunningTime="2026-09-15 09:40:09.568610362 +0000 UTC m=+1985.332181811"
Sep 15 09:40:10.559165 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:10.559135    2568 generic.go:356] "Generic (PLEG): container finished" podID="36266523-979e-474d-a411-c29a3008ad6e" containerID="15d656a45f512028e1ca9311503b4903fdd74b3b451a15bb439cf1130f92723e" exitCode=0
Sep 15 09:40:10.559549 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:10.559182    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28" event={"ID":"36266523-979e-474d-a411-c29a3008ad6e","Type":"ContainerDied","Data":"15d656a45f512028e1ca9311503b4903fdd74b3b451a15bb439cf1130f92723e"}
Sep 15 09:40:11.694083 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:11.694059    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"
Sep 15 09:40:11.798940 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:11.798903    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36266523-979e-474d-a411-c29a3008ad6e-maas-api-service-ca\") pod \"36266523-979e-474d-a411-c29a3008ad6e\" (UID: \"36266523-979e-474d-a411-c29a3008ad6e\") "
Sep 15 09:40:11.799289 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:11.799269    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36266523-979e-474d-a411-c29a3008ad6e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "36266523-979e-474d-a411-c29a3008ad6e" (UID: "36266523-979e-474d-a411-c29a3008ad6e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:11.900572 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:11.900476    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/36266523-979e-474d-a411-c29a3008ad6e-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:12.571499 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:12.571457    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28" event={"ID":"36266523-979e-474d-a411-c29a3008ad6e","Type":"ContainerDied","Data":"e9d0e8847830786b20e7ce1ec65222294b33baa6c6bc1775235fb6b661b8e6a8"}
Sep 15 09:40:12.571715 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:12.571515    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e9d0e8847830786b20e7ce1ec65222294b33baa6c6bc1775235fb6b661b8e6a8"
Sep 15 09:40:12.571715 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:12.571465    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"
Sep 15 09:40:19.385522 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.385490    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"]
Sep 15 09:40:19.386047 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.385735    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b" podUID="f8781c4c-d1f5-47a2-a832-f613457bb68c" containerName="payload-processing" containerID="cri-o://c8d9b4ed747e96ccf6689d08146600d32668365fbdeccadca3954429e408367f" gracePeriod=30
Sep 15 09:40:19.394178 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.394153    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"]
Sep 15 09:40:19.394355 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.394335    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd" podUID="de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835" containerName="payload-pre-processing" containerID="cri-o://ed0eed62444d3923edc2e2dde5dd12720fb91c8d90a4f52f024df03b899270e9" gracePeriod=30
Sep 15 09:40:19.557349 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.557305    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"]
Sep 15 09:40:19.562877 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.562274    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ipp-b-6920e5-9tq28"]
Sep 15 09:40:19.608857 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.608793    2568 generic.go:356] "Generic (PLEG): container finished" podID="f8781c4c-d1f5-47a2-a832-f613457bb68c" containerID="c8d9b4ed747e96ccf6689d08146600d32668365fbdeccadca3954429e408367f" exitCode=0
Sep 15 09:40:19.608977 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.608875    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b" event={"ID":"f8781c4c-d1f5-47a2-a832-f613457bb68c","Type":"ContainerDied","Data":"c8d9b4ed747e96ccf6689d08146600d32668365fbdeccadca3954429e408367f"}
Sep 15 09:40:19.610717 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.610695    2568 generic.go:356] "Generic (PLEG): container finished" podID="de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835" containerID="ed0eed62444d3923edc2e2dde5dd12720fb91c8d90a4f52f024df03b899270e9" exitCode=0
Sep 15 09:40:19.610863 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.610743    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd" event={"ID":"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835","Type":"ContainerDied","Data":"ed0eed62444d3923edc2e2dde5dd12720fb91c8d90a4f52f024df03b899270e9"}
Sep 15 09:40:19.672991 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.672966    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:40:19.675775 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.675752    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:40:19.770507 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.770478    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pcqdb\" (UniqueName: \"kubernetes.io/projected/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-kube-api-access-pcqdb\") pod \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\" (UID: \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\") "
Sep 15 09:40:19.770701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.770532    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8781c4c-d1f5-47a2-a832-f613457bb68c-plugins-config-volume\") pod \"f8781c4c-d1f5-47a2-a832-f613457bb68c\" (UID: \"f8781c4c-d1f5-47a2-a832-f613457bb68c\") "
Sep 15 09:40:19.770701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.770560    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ztwq9\" (UniqueName: \"kubernetes.io/projected/f8781c4c-d1f5-47a2-a832-f613457bb68c-kube-api-access-ztwq9\") pod \"f8781c4c-d1f5-47a2-a832-f613457bb68c\" (UID: \"f8781c4c-d1f5-47a2-a832-f613457bb68c\") "
Sep 15 09:40:19.770701 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.770597    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-plugins-config-volume\") pod \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\" (UID: \"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835\") "
Sep 15 09:40:19.771052 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.771022    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f8781c4c-d1f5-47a2-a832-f613457bb68c-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f8781c4c-d1f5-47a2-a832-f613457bb68c" (UID: "f8781c4c-d1f5-47a2-a832-f613457bb68c"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:19.771052 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.771027    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835" (UID: "de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:19.772782 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.772762    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f8781c4c-d1f5-47a2-a832-f613457bb68c-kube-api-access-ztwq9" (OuterVolumeSpecName: "kube-api-access-ztwq9") pod "f8781c4c-d1f5-47a2-a832-f613457bb68c" (UID: "f8781c4c-d1f5-47a2-a832-f613457bb68c"). InnerVolumeSpecName "kube-api-access-ztwq9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:19.772833 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.772784    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-kube-api-access-pcqdb" (OuterVolumeSpecName: "kube-api-access-pcqdb") pod "de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835" (UID: "de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835"). InnerVolumeSpecName "kube-api-access-pcqdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:19.871592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.871555    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:19.871592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.871585    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pcqdb\" (UniqueName: \"kubernetes.io/projected/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835-kube-api-access-pcqdb\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:19.871592 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.871594    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f8781c4c-d1f5-47a2-a832-f613457bb68c-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:19.871820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:19.871604    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ztwq9\" (UniqueName: \"kubernetes.io/projected/f8781c4c-d1f5-47a2-a832-f613457bb68c-kube-api-access-ztwq9\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:20.616711 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.616677    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"
Sep 15 09:40:20.617213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.616677    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd" event={"ID":"de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835","Type":"ContainerDied","Data":"f5aaa0a26b9ee65c21c413d478b469ea94c9bef690a4305d69bf1d463932f082"}
Sep 15 09:40:20.617213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.616808    2568 scope.go:117] "RemoveContainer" containerID="ed0eed62444d3923edc2e2dde5dd12720fb91c8d90a4f52f024df03b899270e9"
Sep 15 09:40:20.618307 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.618260    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b" event={"ID":"f8781c4c-d1f5-47a2-a832-f613457bb68c","Type":"ContainerDied","Data":"a0afb7a3a230a96be98efd73d435085593dfffd5f0abf837c76965a446eca984"}
Sep 15 09:40:20.618381 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.618324    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"
Sep 15 09:40:20.628888 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.628828    2568 scope.go:117] "RemoveContainer" containerID="c8d9b4ed747e96ccf6689d08146600d32668365fbdeccadca3954429e408367f"
Sep 15 09:40:20.647045 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.647022    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"]
Sep 15 09:40:20.652718 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.652660    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-6920e5-66dfcff5c4-l22gd"]
Sep 15 09:40:20.664088 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.664068    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"]
Sep 15 09:40:20.667054 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.667033    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-6920e5-5bd9d56b77-ptj7b"]
Sep 15 09:40:20.785654 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.785619    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36266523-979e-474d-a411-c29a3008ad6e" path="/var/lib/kubelet/pods/36266523-979e-474d-a411-c29a3008ad6e/volumes"
Sep 15 09:40:20.786002 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.785989    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835" path="/var/lib/kubelet/pods/de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835/volumes"
Sep 15 09:40:20.786293 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:20.786283    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f8781c4c-d1f5-47a2-a832-f613457bb68c" path="/var/lib/kubelet/pods/f8781c4c-d1f5-47a2-a832-f613457bb68c/volumes"
Sep 15 09:40:26.391313 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391272    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"]
Sep 15 09:40:26.391860 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391820    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy"
Sep 15 09:40:26.391921 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391864    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy"
Sep 15 09:40:26.391921 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391896    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f8781c4c-d1f5-47a2-a832-f613457bb68c" containerName="payload-processing"
Sep 15 09:40:26.391921 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391906    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f8781c4c-d1f5-47a2-a832-f613457bb68c" containerName="payload-processing"
Sep 15 09:40:26.391921 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391918    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36266523-979e-474d-a411-c29a3008ad6e" containerName="revoke-keys"
Sep 15 09:40:26.392046 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391927    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="36266523-979e-474d-a411-c29a3008ad6e" containerName="revoke-keys"
Sep 15 09:40:26.392046 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391938    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835" containerName="payload-pre-processing"
Sep 15 09:40:26.392046 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.391947    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835" containerName="payload-pre-processing"
Sep 15 09:40:26.392046 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.392041    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="de3f53ec-3ff2-4a32-a3a5-8ed5ebf45835" containerName="payload-pre-processing"
Sep 15 09:40:26.392166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.392055    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="36266523-979e-474d-a411-c29a3008ad6e" containerName="revoke-keys"
Sep 15 09:40:26.392166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.392066    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f8781c4c-d1f5-47a2-a832-f613457bb68c" containerName="payload-processing"
Sep 15 09:40:26.392166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.392078    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd0ee65f-a25f-4da9-962a-108198f14720" containerName="istio-proxy"
Sep 15 09:40:26.396901 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.396875    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"
Sep 15 09:40:26.399820 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.399792    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:40:26.399996 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.399943    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:40:26.400203 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.400180    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"]
Sep 15 09:40:26.529152 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.529117    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4089d07f-1394-473a-bda9-9731e9b7b7bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78\" (UID: \"4089d07f-1394-473a-bda9-9731e9b7b7bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"
Sep 15 09:40:26.630126 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.630092    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4089d07f-1394-473a-bda9-9731e9b7b7bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78\" (UID: \"4089d07f-1394-473a-bda9-9731e9b7b7bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"
Sep 15 09:40:26.630852 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.630817    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4089d07f-1394-473a-bda9-9731e9b7b7bf-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78\" (UID: \"4089d07f-1394-473a-bda9-9731e9b7b7bf\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"
Sep 15 09:40:26.709659 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.709625    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"
Sep 15 09:40:26.979225 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:26.979153    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"]
Sep 15 09:40:26.982556 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:40:26.982535    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4089d07f_1394_473a_bda9_9731e9b7b7bf.slice/crio-6a91286763c6795cae3881b6ad34fd24dde479a05bdd79bea10e8044c95a4729 WatchSource:0}: Error finding container 6a91286763c6795cae3881b6ad34fd24dde479a05bdd79bea10e8044c95a4729: Status 404 returned error can't find the container with id 6a91286763c6795cae3881b6ad34fd24dde479a05bdd79bea10e8044c95a4729
Sep 15 09:40:27.653292 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:27.653255    2568 generic.go:356] "Generic (PLEG): container finished" podID="4089d07f-1394-473a-bda9-9731e9b7b7bf" containerID="a008acb43c48e8993c6b9ffd45d845c4f6de2995e75830080741031c38d2efbc" exitCode=0
Sep 15 09:40:27.653651 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:27.653339    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78" event={"ID":"4089d07f-1394-473a-bda9-9731e9b7b7bf","Type":"ContainerDied","Data":"a008acb43c48e8993c6b9ffd45d845c4f6de2995e75830080741031c38d2efbc"}
Sep 15 09:40:27.653651 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:27.653386    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78" event={"ID":"4089d07f-1394-473a-bda9-9731e9b7b7bf","Type":"ContainerStarted","Data":"6a91286763c6795cae3881b6ad34fd24dde479a05bdd79bea10e8044c95a4729"}
Sep 15 09:40:28.789008 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:28.788983    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"
Sep 15 09:40:28.950964 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:28.950890    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4089d07f-1394-473a-bda9-9731e9b7b7bf-maas-api-service-ca\") pod \"4089d07f-1394-473a-bda9-9731e9b7b7bf\" (UID: \"4089d07f-1394-473a-bda9-9731e9b7b7bf\") "
Sep 15 09:40:28.951260 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:28.951239    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4089d07f-1394-473a-bda9-9731e9b7b7bf-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4089d07f-1394-473a-bda9-9731e9b7b7bf" (UID: "4089d07f-1394-473a-bda9-9731e9b7b7bf"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:29.051994 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:29.051954    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4089d07f-1394-473a-bda9-9731e9b7b7bf-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:29.663526 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:29.663486    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"
Sep 15 09:40:29.663704 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:29.663490    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78" event={"ID":"4089d07f-1394-473a-bda9-9731e9b7b7bf","Type":"ContainerDied","Data":"6a91286763c6795cae3881b6ad34fd24dde479a05bdd79bea10e8044c95a4729"}
Sep 15 09:40:29.663704 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:29.663607    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6a91286763c6795cae3881b6ad34fd24dde479a05bdd79bea10e8044c95a4729"
Sep 15 09:40:36.879058 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:36.879014    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"]
Sep 15 09:40:36.881309 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:36.881286    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-w3-f79800-29824410-nfbm4"]
Sep 15 09:40:36.900213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:36.900185    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"]
Sep 15 09:40:36.900446 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:36.900405    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp" podUID="bc859519-88cc-4b00-96ee-dccd69b59f74" containerName="payload-processing" containerID="cri-o://c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6" gracePeriod=30
Sep 15 09:40:36.911433 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:36.910987    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"]
Sep 15 09:40:36.911433 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:36.911231    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz" podUID="5dd0902c-0792-4f1c-bffc-521a19ee9bff" containerName="payload-pre-processing" containerID="cri-o://ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8" gracePeriod=30
Sep 15 09:40:37.074388 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.074339    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"]
Sep 15 09:40:37.078269 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.078150    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-w3-f79800-npt78"]
Sep 15 09:40:37.159209 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.159182    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:40:37.185711 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.185686    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:40:37.326751 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.326717    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0902c-0792-4f1c-bffc-521a19ee9bff-plugins-config-volume\") pod \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\" (UID: \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\") "
Sep 15 09:40:37.326949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.326816    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f95dq\" (UniqueName: \"kubernetes.io/projected/5dd0902c-0792-4f1c-bffc-521a19ee9bff-kube-api-access-f95dq\") pod \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\" (UID: \"5dd0902c-0792-4f1c-bffc-521a19ee9bff\") "
Sep 15 09:40:37.326949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.326873    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6tp8r\" (UniqueName: \"kubernetes.io/projected/bc859519-88cc-4b00-96ee-dccd69b59f74-kube-api-access-6tp8r\") pod \"bc859519-88cc-4b00-96ee-dccd69b59f74\" (UID: \"bc859519-88cc-4b00-96ee-dccd69b59f74\") "
Sep 15 09:40:37.326949 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.326900    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc859519-88cc-4b00-96ee-dccd69b59f74-plugins-config-volume\") pod \"bc859519-88cc-4b00-96ee-dccd69b59f74\" (UID: \"bc859519-88cc-4b00-96ee-dccd69b59f74\") "
Sep 15 09:40:37.327291 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.327260    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5dd0902c-0792-4f1c-bffc-521a19ee9bff-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "5dd0902c-0792-4f1c-bffc-521a19ee9bff" (UID: "5dd0902c-0792-4f1c-bffc-521a19ee9bff"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:37.327417 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.327313    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bc859519-88cc-4b00-96ee-dccd69b59f74-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "bc859519-88cc-4b00-96ee-dccd69b59f74" (UID: "bc859519-88cc-4b00-96ee-dccd69b59f74"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:37.329027 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.329009    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5dd0902c-0792-4f1c-bffc-521a19ee9bff-kube-api-access-f95dq" (OuterVolumeSpecName: "kube-api-access-f95dq") pod "5dd0902c-0792-4f1c-bffc-521a19ee9bff" (UID: "5dd0902c-0792-4f1c-bffc-521a19ee9bff"). InnerVolumeSpecName "kube-api-access-f95dq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:37.329085 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.329064    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc859519-88cc-4b00-96ee-dccd69b59f74-kube-api-access-6tp8r" (OuterVolumeSpecName: "kube-api-access-6tp8r") pod "bc859519-88cc-4b00-96ee-dccd69b59f74" (UID: "bc859519-88cc-4b00-96ee-dccd69b59f74"). InnerVolumeSpecName "kube-api-access-6tp8r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:37.427514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.427482    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f95dq\" (UniqueName: \"kubernetes.io/projected/5dd0902c-0792-4f1c-bffc-521a19ee9bff-kube-api-access-f95dq\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:37.427514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.427509    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6tp8r\" (UniqueName: \"kubernetes.io/projected/bc859519-88cc-4b00-96ee-dccd69b59f74-kube-api-access-6tp8r\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:37.427514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.427520    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/bc859519-88cc-4b00-96ee-dccd69b59f74-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:37.427753 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.427529    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5dd0902c-0792-4f1c-bffc-521a19ee9bff-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:37.703387 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.703298    2568 generic.go:356] "Generic (PLEG): container finished" podID="bc859519-88cc-4b00-96ee-dccd69b59f74" containerID="c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6" exitCode=0
Sep 15 09:40:37.703387 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.703349    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"
Sep 15 09:40:37.703578 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.703396    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp" event={"ID":"bc859519-88cc-4b00-96ee-dccd69b59f74","Type":"ContainerDied","Data":"c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6"}
Sep 15 09:40:37.703578 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.703451    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp" event={"ID":"bc859519-88cc-4b00-96ee-dccd69b59f74","Type":"ContainerDied","Data":"d8878f3e8f9513113060d834a598e5c4cf9547a4fdcc39b220dc14a8bc224fd7"}
Sep 15 09:40:37.703578 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.703481    2568 scope.go:117] "RemoveContainer" containerID="c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6"
Sep 15 09:40:37.704930 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.704910    2568 generic.go:356] "Generic (PLEG): container finished" podID="5dd0902c-0792-4f1c-bffc-521a19ee9bff" containerID="ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8" exitCode=0
Sep 15 09:40:37.705062 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.704950    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"
Sep 15 09:40:37.705062 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.704986    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz" event={"ID":"5dd0902c-0792-4f1c-bffc-521a19ee9bff","Type":"ContainerDied","Data":"ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8"}
Sep 15 09:40:37.705062 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.705019    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz" event={"ID":"5dd0902c-0792-4f1c-bffc-521a19ee9bff","Type":"ContainerDied","Data":"136c32158a3f83ea08f91be385b6e0deafcf9e8193aac35521f16385989f3ef6"}
Sep 15 09:40:37.718260 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.718089    2568 scope.go:117] "RemoveContainer" containerID="c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6"
Sep 15 09:40:37.718489 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:40:37.718461    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6\": container with ID starting with c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6 not found: ID does not exist" containerID="c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6"
Sep 15 09:40:37.718601 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.718496    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6"} err="failed to get container status \"c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6\": rpc error: code = NotFound desc = could not find container \"c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6\": container with ID starting with c871fb241de5c07a6721e67c6edf90e37c5d83e79da5c14ebea26ee1c4f27ab6 not found: ID does not exist"
Sep 15 09:40:37.718601 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.718512    2568 scope.go:117] "RemoveContainer" containerID="ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8"
Sep 15 09:40:37.727031 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.727008    2568 scope.go:117] "RemoveContainer" containerID="ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8"
Sep 15 09:40:37.727372 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:40:37.727345    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8\": container with ID starting with ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8 not found: ID does not exist" containerID="ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8"
Sep 15 09:40:37.727477 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.727379    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8"} err="failed to get container status \"ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8\": rpc error: code = NotFound desc = could not find container \"ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8\": container with ID starting with ef12a57426926799db8e4e51900b7043d2e5a8bd992ca3eb0b7258cc5f12edc8 not found: ID does not exist"
Sep 15 09:40:37.729012 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.728990    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"]
Sep 15 09:40:37.732810 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.732789    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w3-f79800-85b645df8c-7bggp"]
Sep 15 09:40:37.745812 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.745789    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"]
Sep 15 09:40:37.749590 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:37.749569    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w3-f79800-7bb9b5d65d-prgfz"]
Sep 15 09:40:38.785381 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:38.785347    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4089d07f-1394-473a-bda9-9731e9b7b7bf" path="/var/lib/kubelet/pods/4089d07f-1394-473a-bda9-9731e9b7b7bf/volumes"
Sep 15 09:40:38.785756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:38.785689    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5dd0902c-0792-4f1c-bffc-521a19ee9bff" path="/var/lib/kubelet/pods/5dd0902c-0792-4f1c-bffc-521a19ee9bff/volumes"
Sep 15 09:40:38.785980 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:38.785967    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ba4c5c6-7710-4328-a3d2-5270c050788c" path="/var/lib/kubelet/pods/6ba4c5c6-7710-4328-a3d2-5270c050788c/volumes"
Sep 15 09:40:38.786252 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:38.786241    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc859519-88cc-4b00-96ee-dccd69b59f74" path="/var/lib/kubelet/pods/bc859519-88cc-4b00-96ee-dccd69b59f74/volumes"
Sep 15 09:40:43.796682 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.796636    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"]
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.796990    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc859519-88cc-4b00-96ee-dccd69b59f74" containerName="payload-processing"
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.797002    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc859519-88cc-4b00-96ee-dccd69b59f74" containerName="payload-processing"
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.797010    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4089d07f-1394-473a-bda9-9731e9b7b7bf" containerName="revoke-keys"
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.797017    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4089d07f-1394-473a-bda9-9731e9b7b7bf" containerName="revoke-keys"
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.797031    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5dd0902c-0792-4f1c-bffc-521a19ee9bff" containerName="payload-pre-processing"
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.797036    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5dd0902c-0792-4f1c-bffc-521a19ee9bff" containerName="payload-pre-processing"
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.797083    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5dd0902c-0792-4f1c-bffc-521a19ee9bff" containerName="payload-pre-processing"
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.797090    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc859519-88cc-4b00-96ee-dccd69b59f74" containerName="payload-processing"
Sep 15 09:40:43.797176 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.797097    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4089d07f-1394-473a-bda9-9731e9b7b7bf" containerName="revoke-keys"
Sep 15 09:40:43.801234 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.801207    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"
Sep 15 09:40:43.804066 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.804042    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:40:43.804224 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.804207    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:40:43.807927 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.807902    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"]
Sep 15 09:40:43.874581 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.874548    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6558498f-6c0d-43ef-a4a1-4acca475968b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr\" (UID: \"6558498f-6c0d-43ef-a4a1-4acca475968b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"
Sep 15 09:40:43.975166 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.975137    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6558498f-6c0d-43ef-a4a1-4acca475968b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr\" (UID: \"6558498f-6c0d-43ef-a4a1-4acca475968b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"
Sep 15 09:40:43.975711 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:43.975692    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6558498f-6c0d-43ef-a4a1-4acca475968b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr\" (UID: \"6558498f-6c0d-43ef-a4a1-4acca475968b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"
Sep 15 09:40:44.113484 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:44.113385    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"
Sep 15 09:40:44.385440 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:44.385361    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"]
Sep 15 09:40:44.388644 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:40:44.388613    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6558498f_6c0d_43ef_a4a1_4acca475968b.slice/crio-dec705a7153b2298ec59d0a8f441c3d8fd74ea8da7bd0f894dc5515aef2d5387 WatchSource:0}: Error finding container dec705a7153b2298ec59d0a8f441c3d8fd74ea8da7bd0f894dc5515aef2d5387: Status 404 returned error can't find the container with id dec705a7153b2298ec59d0a8f441c3d8fd74ea8da7bd0f894dc5515aef2d5387
Sep 15 09:40:44.747063 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:44.747031    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr" event={"ID":"6558498f-6c0d-43ef-a4a1-4acca475968b","Type":"ContainerStarted","Data":"a30abe003fb8ce5bd4a81567c9251dfe684e17005302942b56fc0e1beb5aa076"}
Sep 15 09:40:44.747195 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:44.747079    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr" event={"ID":"6558498f-6c0d-43ef-a4a1-4acca475968b","Type":"ContainerStarted","Data":"dec705a7153b2298ec59d0a8f441c3d8fd74ea8da7bd0f894dc5515aef2d5387"}
Sep 15 09:40:44.764320 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:44.764270    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr" podStartSLOduration=1.7642539130000001 podStartE2EDuration="1.764253913s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:40:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:40:44.762366291 +0000 UTC m=+2020.525937740" watchObservedRunningTime="2026-09-15 09:40:44.764253913 +0000 UTC m=+2020.527825404"
Sep 15 09:40:45.752962 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:45.752914    2568 generic.go:356] "Generic (PLEG): container finished" podID="6558498f-6c0d-43ef-a4a1-4acca475968b" containerID="a30abe003fb8ce5bd4a81567c9251dfe684e17005302942b56fc0e1beb5aa076" exitCode=0
Sep 15 09:40:45.753337 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:45.752995    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr" event={"ID":"6558498f-6c0d-43ef-a4a1-4acca475968b","Type":"ContainerDied","Data":"a30abe003fb8ce5bd4a81567c9251dfe684e17005302942b56fc0e1beb5aa076"}
Sep 15 09:40:46.884723 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:46.884699    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"
Sep 15 09:40:46.896270 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:46.896250    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6558498f-6c0d-43ef-a4a1-4acca475968b-maas-api-service-ca\") pod \"6558498f-6c0d-43ef-a4a1-4acca475968b\" (UID: \"6558498f-6c0d-43ef-a4a1-4acca475968b\") "
Sep 15 09:40:46.896581 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:46.896558    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6558498f-6c0d-43ef-a4a1-4acca475968b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6558498f-6c0d-43ef-a4a1-4acca475968b" (UID: "6558498f-6c0d-43ef-a4a1-4acca475968b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:46.996899 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:46.996867    2568 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6558498f-6c0d-43ef-a4a1-4acca475968b-maas-api-service-ca\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:47.763805 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:47.763779    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"
Sep 15 09:40:47.763805 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:47.763797    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr" event={"ID":"6558498f-6c0d-43ef-a4a1-4acca475968b","Type":"ContainerDied","Data":"dec705a7153b2298ec59d0a8f441c3d8fd74ea8da7bd0f894dc5515aef2d5387"}
Sep 15 09:40:47.764035 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:47.763864    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dec705a7153b2298ec59d0a8f441c3d8fd74ea8da7bd0f894dc5515aef2d5387"
Sep 15 09:40:54.301627 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.301594    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"]
Sep 15 09:40:54.303179 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.303146    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-w3-8dd3bd-29824410-lsscf"]
Sep 15 09:40:54.326789 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.326757    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"]
Sep 15 09:40:54.327296 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.327050    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z" podUID="ebe5abc0-6951-4c37-af6c-b5f5f88d22d6" containerName="payload-processing" containerID="cri-o://e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184" gracePeriod=30
Sep 15 09:40:54.333378 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.333350    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"]
Sep 15 09:40:54.333827 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.333764    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427" podUID="f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd" containerName="payload-pre-processing" containerID="cri-o://758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45" gracePeriod=30
Sep 15 09:40:54.503912 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.503834    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"]
Sep 15 09:40:54.517729 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.517696    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-8dd3bd-btncr"]
Sep 15 09:40:54.606038 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.606012    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:40:54.608748 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.608729    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:40:54.656525 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.656490    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsv87\" (UniqueName: \"kubernetes.io/projected/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-kube-api-access-lsv87\") pod \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\" (UID: \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\") "
Sep 15 09:40:54.656720 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.656559    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-plugins-config-volume\") pod \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\" (UID: \"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6\") "
Sep 15 09:40:54.656720 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.656602    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-plugins-config-volume\") pod \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\" (UID: \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\") "
Sep 15 09:40:54.656883 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.656782    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j95r5\" (UniqueName: \"kubernetes.io/projected/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-kube-api-access-j95r5\") pod \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\" (UID: \"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd\") "
Sep 15 09:40:54.657518 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.657472    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd" (UID: "f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:54.657898 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.657513    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ebe5abc0-6951-4c37-af6c-b5f5f88d22d6" (UID: "ebe5abc0-6951-4c37-af6c-b5f5f88d22d6"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 15 09:40:54.660162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.660129    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-kube-api-access-j95r5" (OuterVolumeSpecName: "kube-api-access-j95r5") pod "f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd" (UID: "f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd"). InnerVolumeSpecName "kube-api-access-j95r5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:54.660558 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.660537    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-kube-api-access-lsv87" (OuterVolumeSpecName: "kube-api-access-lsv87") pod "ebe5abc0-6951-4c37-af6c-b5f5f88d22d6" (UID: "ebe5abc0-6951-4c37-af6c-b5f5f88d22d6"). InnerVolumeSpecName "kube-api-access-lsv87". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:40:54.758422 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.758384    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.758422 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.758415    2568 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-plugins-config-volume\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.758422 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.758424    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j95r5\" (UniqueName: \"kubernetes.io/projected/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd-kube-api-access-j95r5\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.758422 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.758432    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsv87\" (UniqueName: \"kubernetes.io/projected/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6-kube-api-access-lsv87\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:40:54.787343 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.787313    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6558498f-6c0d-43ef-a4a1-4acca475968b" path="/var/lib/kubelet/pods/6558498f-6c0d-43ef-a4a1-4acca475968b/volumes"
Sep 15 09:40:54.787599 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.787586    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b433925c-b453-4790-b608-806286917058" path="/var/lib/kubelet/pods/b433925c-b453-4790-b608-806286917058/volumes"
Sep 15 09:40:54.799999 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.799973    2568 generic.go:356] "Generic (PLEG): container finished" podID="ebe5abc0-6951-4c37-af6c-b5f5f88d22d6" containerID="e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184" exitCode=0
Sep 15 09:40:54.800119 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.800018    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"
Sep 15 09:40:54.800119 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.800055    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z" event={"ID":"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6","Type":"ContainerDied","Data":"e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184"}
Sep 15 09:40:54.800119 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.800114    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z" event={"ID":"ebe5abc0-6951-4c37-af6c-b5f5f88d22d6","Type":"ContainerDied","Data":"5c5022084bd4a174ea1d632166cfda9b9e0c0abaab1262a10f4c7a0f2f1faaed"}
Sep 15 09:40:54.800278 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.800142    2568 scope.go:117] "RemoveContainer" containerID="e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184"
Sep 15 09:40:54.801533 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.801506    2568 generic.go:356] "Generic (PLEG): container finished" podID="f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd" containerID="758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45" exitCode=0
Sep 15 09:40:54.801616 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.801539    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427" event={"ID":"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd","Type":"ContainerDied","Data":"758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45"}
Sep 15 09:40:54.801616 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.801582    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427" event={"ID":"f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd","Type":"ContainerDied","Data":"e201d2db1ae4cec1ab8f0e89f492f701c1ee1c7b100c3410f3daa1ddb2cfb8a7"}
Sep 15 09:40:54.801728 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.801657    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"
Sep 15 09:40:54.811553 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.811535    2568 scope.go:117] "RemoveContainer" containerID="e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184"
Sep 15 09:40:54.811854 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:40:54.811821    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184\": container with ID starting with e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184 not found: ID does not exist" containerID="e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184"
Sep 15 09:40:54.811938 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.811867    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184"} err="failed to get container status \"e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184\": rpc error: code = NotFound desc = could not find container \"e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184\": container with ID starting with e6470bb6f4a1b068ee796cd43b450f7808ff66c1d61e5cf7a2b27bc3b3385184 not found: ID does not exist"
Sep 15 09:40:54.811938 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.811892    2568 scope.go:117] "RemoveContainer" containerID="758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45"
Sep 15 09:40:54.820365 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.820343    2568 scope.go:117] "RemoveContainer" containerID="758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45"
Sep 15 09:40:54.820699 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:40:54.820677    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45\": container with ID starting with 758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45 not found: ID does not exist" containerID="758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45"
Sep 15 09:40:54.820746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.820707    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45"} err="failed to get container status \"758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45\": rpc error: code = NotFound desc = could not find container \"758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45\": container with ID starting with 758382e6852ef535760f7c600ff3f53fc4aa275202401100d776ab7e2b36ac45 not found: ID does not exist"
Sep 15 09:40:54.821335 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.821317    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"]
Sep 15 09:40:54.825001 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.824981    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w3-8dd3bd-84b56fb75f-wc67z"]
Sep 15 09:40:54.836519 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.836455    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"]
Sep 15 09:40:54.839758 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:54.839735    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-8dd3bd-695cdcf9db-82427"]
Sep 15 09:40:56.785100 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:56.785069    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ebe5abc0-6951-4c37-af6c-b5f5f88d22d6" path="/var/lib/kubelet/pods/ebe5abc0-6951-4c37-af6c-b5f5f88d22d6/volumes"
Sep 15 09:40:56.785487 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:40:56.785417    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd" path="/var/lib/kubelet/pods/f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd/volumes"
Sep 15 09:41:03.800950 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:03.800916    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7594f95958-pg2hv"]
Sep 15 09:41:03.801341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:03.801092    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7594f95958-pg2hv" podUID="46878f80-0dd9-483e-a0b0-7682dc097220" containerName="manager" containerID="cri-o://928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993" gracePeriod=30
Sep 15 09:41:04.050874 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.050832    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:41:04.143540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.143465    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-webhook-cert\") pod \"46878f80-0dd9-483e-a0b0-7682dc097220\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") "
Sep 15 09:41:04.143540 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.143502    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dxz2c\" (UniqueName: \"kubernetes.io/projected/46878f80-0dd9-483e-a0b0-7682dc097220-kube-api-access-dxz2c\") pod \"46878f80-0dd9-483e-a0b0-7682dc097220\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") "
Sep 15 09:41:04.143717 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.143565    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-metrics-certs\") pod \"46878f80-0dd9-483e-a0b0-7682dc097220\" (UID: \"46878f80-0dd9-483e-a0b0-7682dc097220\") "
Sep 15 09:41:04.145815 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.145782    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "46878f80-0dd9-483e-a0b0-7682dc097220" (UID: "46878f80-0dd9-483e-a0b0-7682dc097220"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:41:04.145955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.145830    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46878f80-0dd9-483e-a0b0-7682dc097220-kube-api-access-dxz2c" (OuterVolumeSpecName: "kube-api-access-dxz2c") pod "46878f80-0dd9-483e-a0b0-7682dc097220" (UID: "46878f80-0dd9-483e-a0b0-7682dc097220"). InnerVolumeSpecName "kube-api-access-dxz2c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:41:04.145955 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.145832    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "46878f80-0dd9-483e-a0b0-7682dc097220" (UID: "46878f80-0dd9-483e-a0b0-7682dc097220"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:41:04.244728 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.244688    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dxz2c\" (UniqueName: \"kubernetes.io/projected/46878f80-0dd9-483e-a0b0-7682dc097220-kube-api-access-dxz2c\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.244728 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.244719    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-metrics-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.244728 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.244733    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46878f80-0dd9-483e-a0b0-7682dc097220-webhook-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:41:04.853429 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.853388    2568 generic.go:356] "Generic (PLEG): container finished" podID="46878f80-0dd9-483e-a0b0-7682dc097220" containerID="928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993" exitCode=0
Sep 15 09:41:04.853429 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.853419    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-pg2hv" event={"ID":"46878f80-0dd9-483e-a0b0-7682dc097220","Type":"ContainerDied","Data":"928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993"}
Sep 15 09:41:04.853964 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.853449    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-pg2hv"
Sep 15 09:41:04.853964 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.853470    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-pg2hv" event={"ID":"46878f80-0dd9-483e-a0b0-7682dc097220","Type":"ContainerDied","Data":"c83c36caa36971214c2bb0d0ac6412564752c5cdb6b61bb68b0e1f9f20e5a083"}
Sep 15 09:41:04.853964 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.853490    2568 scope.go:117] "RemoveContainer" containerID="928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993"
Sep 15 09:41:04.864049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.864030    2568 scope.go:117] "RemoveContainer" containerID="928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993"
Sep 15 09:41:04.864354 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:41:04.864335    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993\": container with ID starting with 928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993 not found: ID does not exist" containerID="928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993"
Sep 15 09:41:04.864431 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.864362    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993"} err="failed to get container status \"928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993\": rpc error: code = NotFound desc = could not find container \"928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993\": container with ID starting with 928ac2531a5f31d8c30d7c483c8ebe663bd8d91cf8b5346fe940d9531cca1993 not found: ID does not exist"
Sep 15 09:41:04.872799 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.872769    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7594f95958-pg2hv"]
Sep 15 09:41:04.874250 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:04.874224    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7594f95958-pg2hv"]
Sep 15 09:41:05.281210 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:05.281184    2568 scope.go:117] "RemoveContainer" containerID="5623ac328fe2fe4ab6a8af3fe3ef1e6707c209b550c3cf3ad1cb4d4b1b115f3f"
Sep 15 09:41:05.288899 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:05.288882    2568 scope.go:117] "RemoveContainer" containerID="ab55e7ed53c7fb50ac00f4db25910b23826b84558c36b696dabba0f5e54cc3a2"
Sep 15 09:41:06.785493 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:41:06.785459    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46878f80-0dd9-483e-a0b0-7682dc097220" path="/var/lib/kubelet/pods/46878f80-0dd9-483e-a0b0-7682dc097220/volumes"
Sep 15 09:42:05.661146 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661109    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7594f95958-ptdrm"]
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661403    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd" containerName="payload-pre-processing"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661413    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd" containerName="payload-pre-processing"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661423    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46878f80-0dd9-483e-a0b0-7682dc097220" containerName="manager"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661429    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="46878f80-0dd9-483e-a0b0-7682dc097220" containerName="manager"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661435    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ebe5abc0-6951-4c37-af6c-b5f5f88d22d6" containerName="payload-processing"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661441    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ebe5abc0-6951-4c37-af6c-b5f5f88d22d6" containerName="payload-processing"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661446    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6558498f-6c0d-43ef-a4a1-4acca475968b" containerName="revoke-keys"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661450    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6558498f-6c0d-43ef-a4a1-4acca475968b" containerName="revoke-keys"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661499    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="46878f80-0dd9-483e-a0b0-7682dc097220" containerName="manager"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661510    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6558498f-6c0d-43ef-a4a1-4acca475968b" containerName="revoke-keys"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661517    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ebe5abc0-6951-4c37-af6c-b5f5f88d22d6" containerName="payload-processing"
Sep 15 09:42:05.661605 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.661522    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="f5fd5e3d-033b-41b1-b37a-0ebe3c5064dd" containerName="payload-pre-processing"
Sep 15 09:42:05.664347 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.664330    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.668256 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.668225    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 09:42:05.668378 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.668273    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 09:42:05.668378 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.668272    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 09:42:05.668378 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.668277    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tsfjp\""
Sep 15 09:42:05.672756 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.672736    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7594f95958-ptdrm"]
Sep 15 09:42:05.744880 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.744823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4dmv6\" (UniqueName: \"kubernetes.io/projected/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-kube-api-access-4dmv6\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.744880 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.744883    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-metrics-certs\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.745115 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.744978    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-webhook-cert\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.846147 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.846112    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4dmv6\" (UniqueName: \"kubernetes.io/projected/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-kube-api-access-4dmv6\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.846291 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.846158    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-metrics-certs\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.846291 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.846210    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-webhook-cert\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.848808 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.848778    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-metrics-certs\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.848963 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.848942    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-webhook-cert\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.854340 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.854318    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4dmv6\" (UniqueName: \"kubernetes.io/projected/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-kube-api-access-4dmv6\") pod \"maas-controller-7594f95958-ptdrm\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") " pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:05.975137 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:05.975062    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:06.243727 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:06.243699    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7594f95958-ptdrm"]
Sep 15 09:42:06.246450 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:42:06.246423    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d4a78dc_9d46_4d5b_a97a_efc03cf1878e.slice/crio-3dcf41f39afec00a51dadb66c7dad3777ee74cae41037360739a0c1b51cad92f WatchSource:0}: Error finding container 3dcf41f39afec00a51dadb66c7dad3777ee74cae41037360739a0c1b51cad92f: Status 404 returned error can't find the container with id 3dcf41f39afec00a51dadb66c7dad3777ee74cae41037360739a0c1b51cad92f
Sep 15 09:42:06.248169 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:06.248152    2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 15 09:42:07.119523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:07.119430    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-ptdrm" event={"ID":"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e","Type":"ContainerStarted","Data":"9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82"}
Sep 15 09:42:07.119523 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:07.119483    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-ptdrm" event={"ID":"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e","Type":"ContainerStarted","Data":"3dcf41f39afec00a51dadb66c7dad3777ee74cae41037360739a0c1b51cad92f"}
Sep 15 09:42:07.119944 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:07.119560    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:07.136702 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:07.136657    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7594f95958-ptdrm" podStartSLOduration=1.643078185 podStartE2EDuration="2.136640842s" totalImagesPullingTime="493.562657ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:42:07.135070995 +0000 UTC m=+2102.898642435" watchObservedRunningTime="2026-09-15 09:42:07.136640842 +0000 UTC m=+2102.900212311"
Sep 15 09:42:18.125958 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:18.125929    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:25.349514 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.349476    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7594f95958-ptdrm"]
Sep 15 09:42:25.350043 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.349695    2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-7594f95958-ptdrm" podUID="0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" containerName="manager" containerID="cri-o://9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82" gracePeriod=30
Sep 15 09:42:25.589086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.589063    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:25.726636 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.726607    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-webhook-cert\") pod \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") "
Sep 15 09:42:25.726810 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.726668    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-metrics-certs\") pod \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") "
Sep 15 09:42:25.726810 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.726697    2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4dmv6\" (UniqueName: \"kubernetes.io/projected/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-kube-api-access-4dmv6\") pod \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\" (UID: \"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e\") "
Sep 15 09:42:25.728998 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.728965    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" (UID: "0d4a78dc-9d46-4d5b-a97a-efc03cf1878e"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:42:25.729140 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.728991    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" (UID: "0d4a78dc-9d46-4d5b-a97a-efc03cf1878e"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 15 09:42:25.729140 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.729004    2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-kube-api-access-4dmv6" (OuterVolumeSpecName: "kube-api-access-4dmv6") pod "0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" (UID: "0d4a78dc-9d46-4d5b-a97a-efc03cf1878e"). InnerVolumeSpecName "kube-api-access-4dmv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 15 09:42:25.827475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.827441    2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-webhook-cert\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:42:25.827475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.827468    2568 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-metrics-certs\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:42:25.827475 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:25.827477    2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4dmv6\" (UniqueName: \"kubernetes.io/projected/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e-kube-api-access-4dmv6\") on node \"ip-10-0-141-185.ec2.internal\" DevicePath \"\""
Sep 15 09:42:26.206702 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.206671    2568 generic.go:356] "Generic (PLEG): container finished" podID="0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" containerID="9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82" exitCode=0
Sep 15 09:42:26.206911 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.206720    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-ptdrm"
Sep 15 09:42:26.206911 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.206719    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-ptdrm" event={"ID":"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e","Type":"ContainerDied","Data":"9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82"}
Sep 15 09:42:26.206911 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.206874    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-ptdrm" event={"ID":"0d4a78dc-9d46-4d5b-a97a-efc03cf1878e","Type":"ContainerDied","Data":"3dcf41f39afec00a51dadb66c7dad3777ee74cae41037360739a0c1b51cad92f"}
Sep 15 09:42:26.206911 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.206904    2568 scope.go:117] "RemoveContainer" containerID="9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82"
Sep 15 09:42:26.221290 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.221271    2568 scope.go:117] "RemoveContainer" containerID="9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82"
Sep 15 09:42:26.221571 ip-10-0-141-185 kubenswrapper[2568]: E0915 09:42:26.221548    2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82\": container with ID starting with 9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82 not found: ID does not exist" containerID="9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82"
Sep 15 09:42:26.221624 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.221584    2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82"} err="failed to get container status \"9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82\": rpc error: code = NotFound desc = could not find container \"9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82\": container with ID starting with 9dc8065a468ad0e2100c10482150fce8d84905a9037c0334e1dfff8fcd39bc82 not found: ID does not exist"
Sep 15 09:42:26.231229 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.231205    2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7594f95958-ptdrm"]
Sep 15 09:42:26.235162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.235142    2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7594f95958-ptdrm"]
Sep 15 09:42:26.784989 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:26.784959    2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" path="/var/lib/kubelet/pods/0d4a78dc-9d46-4d5b-a97a-efc03cf1878e/volumes"
Sep 15 09:42:27.232513 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.232484    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7594f95958-gtl8g"]
Sep 15 09:42:27.232777 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.232765    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" containerName="manager"
Sep 15 09:42:27.232830 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.232779    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" containerName="manager"
Sep 15 09:42:27.232898 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.232835    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d4a78dc-9d46-4d5b-a97a-efc03cf1878e" containerName="manager"
Sep 15 09:42:27.236916 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.236901    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.241064 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.241038    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 15 09:42:27.241064 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.241062    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tsfjp\""
Sep 15 09:42:27.241263 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.241044    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 15 09:42:27.241263 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.241042    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 15 09:42:27.247155 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.247132    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7594f95958-gtl8g"]
Sep 15 09:42:27.339775 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.339746    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-metrics-certs\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.339775 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.339788    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stxqg\" (UniqueName: \"kubernetes.io/projected/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-kube-api-access-stxqg\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.340034 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.339823    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-webhook-cert\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.441056 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.441020    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-metrics-certs\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.441056 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.441059    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stxqg\" (UniqueName: \"kubernetes.io/projected/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-kube-api-access-stxqg\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.441334 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.441087    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-webhook-cert\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.443724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.443690    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-metrics-certs\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.443724 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.443709    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-webhook-cert\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.449240 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.449205    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stxqg\" (UniqueName: \"kubernetes.io/projected/a37d6fa8-5be9-4f3c-974d-9beeb2e75b98-kube-api-access-stxqg\") pod \"maas-controller-7594f95958-gtl8g\" (UID: \"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98\") " pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.548040 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.547963    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:27.818057 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:27.818031    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7594f95958-gtl8g"]
Sep 15 09:42:27.820539 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:42:27.820497    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda37d6fa8_5be9_4f3c_974d_9beeb2e75b98.slice/crio-b7f79ceba1c0b07299ef35f0b7bbcc5f99dc54a3c854abc9c51a29664c1771e9 WatchSource:0}: Error finding container b7f79ceba1c0b07299ef35f0b7bbcc5f99dc54a3c854abc9c51a29664c1771e9: Status 404 returned error can't find the container with id b7f79ceba1c0b07299ef35f0b7bbcc5f99dc54a3c854abc9c51a29664c1771e9
Sep 15 09:42:28.217858 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:28.217815    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-gtl8g" event={"ID":"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98","Type":"ContainerStarted","Data":"b7f79ceba1c0b07299ef35f0b7bbcc5f99dc54a3c854abc9c51a29664c1771e9"}
Sep 15 09:42:29.223687 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:29.223651    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7594f95958-gtl8g" event={"ID":"a37d6fa8-5be9-4f3c-974d-9beeb2e75b98","Type":"ContainerStarted","Data":"b05b564e65addc7827b3ddb2e3ff2f631155478a6f95d2183bb844950d86b77a"}
Sep 15 09:42:29.224139 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:29.223727    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:42:29.242237 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:29.242185    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-7594f95958-gtl8g" podStartSLOduration=1.8818226139999998 podStartE2EDuration="2.242145732s" totalImagesPullingTime="360.323118ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:42:29.240799161 +0000 UTC m=+2125.004370631" watchObservedRunningTime="2026-09-15 09:42:29.242145732 +0000 UTC m=+2125.005717179"
Sep 15 09:42:40.229970 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:42:40.229940    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7594f95958-gtl8g"
Sep 15 09:45:00.132019 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.131986    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x"]
Sep 15 09:45:00.135190 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.135173    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x"
Sep 15 09:45:00.137706 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.137683    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-b4dqq\""
Sep 15 09:45:00.141401 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.141354    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x"]
Sep 15 09:45:00.146273 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.146257    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x"
Sep 15 09:45:00.418737 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.418638    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x"]
Sep 15 09:45:00.420813 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:45:00.420782    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58b35aea_4f3a_42ef_8124_26958861711f.slice/crio-bedfbaba48b2a11c2a0effaa610555710c555ef179d7bf97004a0a23b9121fdd WatchSource:0}: Error finding container bedfbaba48b2a11c2a0effaa610555710c555ef179d7bf97004a0a23b9121fdd: Status 404 returned error can't find the container with id bedfbaba48b2a11c2a0effaa610555710c555ef179d7bf97004a0a23b9121fdd
Sep 15 09:45:00.886491 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.886455    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x" event={"ID":"58b35aea-4f3a-42ef-8124-26958861711f","Type":"ContainerStarted","Data":"a5b2e4b984ce479061f12dafdb77a358846c1bb8a8a124734590780556400768"}
Sep 15 09:45:00.886662 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.886506    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x" event={"ID":"58b35aea-4f3a-42ef-8124-26958861711f","Type":"ContainerStarted","Data":"bedfbaba48b2a11c2a0effaa610555710c555ef179d7bf97004a0a23b9121fdd"}
Sep 15 09:45:00.902333 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:00.902290    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x" podStartSLOduration=0.902274092 podStartE2EDuration="902.274092ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:45:00.901084603 +0000 UTC m=+2276.664656054" watchObservedRunningTime="2026-09-15 09:45:00.902274092 +0000 UTC m=+2276.665845562"
Sep 15 09:45:01.893807 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:01.893776    2568 generic.go:356] "Generic (PLEG): container finished" podID="58b35aea-4f3a-42ef-8124-26958861711f" containerID="a5b2e4b984ce479061f12dafdb77a358846c1bb8a8a124734590780556400768" exitCode=0
Sep 15 09:45:01.894218 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:01.893813    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x" event={"ID":"58b35aea-4f3a-42ef-8124-26958861711f","Type":"ContainerDied","Data":"a5b2e4b984ce479061f12dafdb77a358846c1bb8a8a124734590780556400768"}
Sep 15 09:45:03.023346 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:03.023322    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x"
Sep 15 09:45:03.903386 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:03.903355    2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x"
Sep 15 09:45:03.903386 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:03.903372    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29824425-w2v9x" event={"ID":"58b35aea-4f3a-42ef-8124-26958861711f","Type":"ContainerDied","Data":"bedfbaba48b2a11c2a0effaa610555710c555ef179d7bf97004a0a23b9121fdd"}
Sep 15 09:45:03.903600 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:03.903414    2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bedfbaba48b2a11c2a0effaa610555710c555ef179d7bf97004a0a23b9121fdd"
Sep 15 09:45:05.351052 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:05.351025    2568 scope.go:117] "RemoveContainer" containerID="59f306abfabfa29ceb1bebc5d9c8bfdfca0fa476b4d3f6d67662e2ecf1a78877"
Sep 15 09:45:05.358786 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:45:05.358769    2568 scope.go:117] "RemoveContainer" containerID="2b7a045378279f29855c1a00db2d3977b1624244ecd8497fc10455d0c85e1082"
Sep 15 09:46:32.511158 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.511122    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"]
Sep 15 09:46:32.511655 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.511436    2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58b35aea-4f3a-42ef-8124-26958861711f" containerName="cleanup"
Sep 15 09:46:32.511655 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.511447    2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="58b35aea-4f3a-42ef-8124-26958861711f" containerName="cleanup"
Sep 15 09:46:32.511655 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.511492    2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="58b35aea-4f3a-42ef-8124-26958861711f" containerName="cleanup"
Sep 15 09:46:32.514432 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.514410    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.517494 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.517471    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 15 09:46:32.518719 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.518691    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 15 09:46:32.518719 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.518706    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 15 09:46:32.518897 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.518749    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 15 09:46:32.518897 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.518835    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-ptrgq\""
Sep 15 09:46:32.523791 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.523770    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"]
Sep 15 09:46:32.579177 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.579137    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-maas-api-tls\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.579177 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.579184    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkjnz\" (UniqueName: \"kubernetes.io/projected/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-kube-api-access-lkjnz\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.579417 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.579253    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-openshift-service-ca\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.579417 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.579294    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-metrics-certs\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.680571 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.680534    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-maas-api-tls\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.680571 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.680578    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkjnz\" (UniqueName: \"kubernetes.io/projected/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-kube-api-access-lkjnz\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.680887 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.680604    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-openshift-service-ca\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.680887 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.680627    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-metrics-certs\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.681294 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.681275    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-openshift-service-ca\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.683162 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.683138    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-metrics-certs\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.683271 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.683173    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-maas-api-tls\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.696405 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.696382    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkjnz\" (UniqueName: \"kubernetes.io/projected/f77b4c8b-25c6-4cb7-b79a-6b47685267e3-kube-api-access-lkjnz\") pod \"maas-api-94fbc46d8-4r77l\" (UID: \"f77b4c8b-25c6-4cb7-b79a-6b47685267e3\") " pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:32.825868 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:32.825746    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:33.097025 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:33.096955    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"]
Sep 15 09:46:33.099734 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:46:33.099699    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf77b4c8b_25c6_4cb7_b79a_6b47685267e3.slice/crio-ddef99802637fab0b30d11832cad2a56cb6e4f3d4e7455055b1c1ae85423380f WatchSource:0}: Error finding container ddef99802637fab0b30d11832cad2a56cb6e4f3d4e7455055b1c1ae85423380f: Status 404 returned error can't find the container with id ddef99802637fab0b30d11832cad2a56cb6e4f3d4e7455055b1c1ae85423380f
Sep 15 09:46:33.286195 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:33.286156    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l" event={"ID":"f77b4c8b-25c6-4cb7-b79a-6b47685267e3","Type":"ContainerStarted","Data":"ddef99802637fab0b30d11832cad2a56cb6e4f3d4e7455055b1c1ae85423380f"}
Sep 15 09:46:35.297691 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:35.297609    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l" event={"ID":"f77b4c8b-25c6-4cb7-b79a-6b47685267e3","Type":"ContainerStarted","Data":"cd1b6e1c21de480682d25b16c6d1840a72d1ce414f0674e3563a3360f394faf5"}
Sep 15 09:46:35.298049 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:35.297732    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:46:35.332983 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:35.332934    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l" podStartSLOduration=1.494664388 podStartE2EDuration="3.332918158s" totalImagesPullingTime="1.83825377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-15 09:46:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:46:35.331087123 +0000 UTC m=+2371.094658573" watchObservedRunningTime="2026-09-15 09:46:35.332918158 +0000 UTC m=+2371.096489606"
Sep 15 09:46:41.307627 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:46:41.307597    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-94fbc46d8-4r77l"
Sep 15 09:47:00.297418 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:00.297386    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7594f95958-gtl8g_a37d6fa8-5be9-4f3c-974d-9beeb2e75b98/manager/0.log"
Sep 15 09:47:00.406861 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:00.406827    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cltxs_6031c05a-26b0-437f-acb8-2e9abed11026/server/0.log"
Sep 15 09:47:00.526265 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:00.526231    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m8wp4_9df41f09-282a-4017-a5c0-50840a09b58a/manager/0.log"
Sep 15 09:47:00.750246 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:00.750218    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dcfd7f98-h2q96_cee1e606-68c8-4093-b76c-0801295cb76b/manager/0.log"
Sep 15 09:47:00.755518 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:00.755498    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dcfd7f98-h2q96_cee1e606-68c8-4093-b76c-0801295cb76b/copy-manifests/0.log"
Sep 15 09:47:01.331082 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:01.331049    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-94fbc46d8-4r77l_f77b4c8b-25c6-4cb7-b79a-6b47685267e3/maas-api/0.log"
Sep 15 09:47:01.434225 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:01.434193    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824410-27vm7_88e2b8af-591a-47ee-8022-a9b876c66ced/cleanup/0.log"
Sep 15 09:47:01.537210 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:01.537178    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29824425-w2v9x_58b35aea-4f3a-42ef-8124-26958861711f/cleanup/0.log"
Sep 15 09:47:03.446530 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:03.446502    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cxlkds_3d34d984-e2d1-4d61-bf78-027e6a11e3bd/istio-proxy/0.log"
Sep 15 09:47:03.579086 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:03.579059    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nkwh5_a4de6ff6-417e-4fe2-9764-757a46945108/discovery/0.log"
Sep 15 09:47:04.152697 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:04.152668    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2t2zf_f8518e94-5fcf-4716-9b97-eb29e84d7fdc/payload-processing/0.log"
Sep 15 09:47:04.743091 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:04.743058    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-dcdjg_2891d30f-588b-47a2-8046-b04ea4aafd8d/main/0.log"
Sep 15 09:47:04.963976 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:04.963949    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-7zh66_b3d27ab2-227a-4eec-bd97-915a2fe84dee/main/0.log"
Sep 15 09:47:05.384858 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:05.384817    2568 scope.go:117] "RemoveContainer" containerID="a30abe003fb8ce5bd4a81567c9251dfe684e17005302942b56fc0e1beb5aa076"
Sep 15 09:47:05.392702 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:05.392672    2568 scope.go:117] "RemoveContainer" containerID="a008acb43c48e8993c6b9ffd45d845c4f6de2995e75830080741031c38d2efbc"
Sep 15 09:47:05.399752 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:05.399735    2568 scope.go:117] "RemoveContainer" containerID="15d656a45f512028e1ca9311503b4903fdd74b3b451a15bb439cf1130f92723e"
Sep 15 09:47:14.160141 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:14.160103    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-g5zwg_ba958dd0-84bc-46c3-b5d8-e2cbb5c49b75/global-pull-secret-syncer/0.log"
Sep 15 09:47:14.285914 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:14.285884    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-jvgdb_f03ff181-7ce3-4846-915e-d4575ad8c86d/konnectivity-agent/0.log"
Sep 15 09:47:14.389794 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:14.389768    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-185.ec2.internal_b75d22eafcad6f42168b54bcbeb68b91/haproxy/0.log"
Sep 15 09:47:21.402007 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:21.401978    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4dsh_2c145344-f8e6-427f-a5c0-b4387b63cc60/node-exporter/0.log"
Sep 15 09:47:21.429147 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:21.429122    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4dsh_2c145344-f8e6-427f-a5c0-b4387b63cc60/kube-rbac-proxy/0.log"
Sep 15 09:47:21.450347 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:21.450327    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-m4dsh_2c145344-f8e6-427f-a5c0-b4387b63cc60/init-textfile/0.log"
Sep 15 09:47:24.849744 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.849712    2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"]
Sep 15 09:47:24.853082 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.853063    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:24.856349 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.856321    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mwkv\"/\"openshift-service-ca.crt\""
Sep 15 09:47:24.862503 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.862478    2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mwkv\"/\"kube-root-ca.crt\""
Sep 15 09:47:24.863352 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.863101    2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mwkv\"/\"default-dockercfg-r2jw9\""
Sep 15 09:47:24.865965 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.865676    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"]
Sep 15 09:47:24.909939 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.909911    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-proc\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:24.910096 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.909956    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-lib-modules\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:24.910096 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.910019    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-sys\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:24.910096 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.910039    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvp2w\" (UniqueName: \"kubernetes.io/projected/212b160b-98f1-4602-bb8f-51bae8f2c8ab-kube-api-access-wvp2w\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:24.910252 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:24.910093    2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-podres\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011388 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011330    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-podres\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011419    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-proc\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011467    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-lib-modules\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011503    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-podres\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011520    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-sys\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011533    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-proc\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011559    2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvp2w\" (UniqueName: \"kubernetes.io/projected/212b160b-98f1-4602-bb8f-51bae8f2c8ab-kube-api-access-wvp2w\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011594 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011570    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-sys\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.011918 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.011666    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/212b160b-98f1-4602-bb8f-51bae8f2c8ab-lib-modules\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.020028 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.020006    2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvp2w\" (UniqueName: \"kubernetes.io/projected/212b160b-98f1-4602-bb8f-51bae8f2c8ab-kube-api-access-wvp2w\") pod \"perf-node-gather-daemonset-qnc6f\" (UID: \"212b160b-98f1-4602-bb8f-51bae8f2c8ab\") " pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.169194 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.169168    2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:25.449348 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.449326    2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"]
Sep 15 09:47:25.451606 ip-10-0-141-185 kubenswrapper[2568]: W0915 09:47:25.451578    2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod212b160b_98f1_4602_bb8f_51bae8f2c8ab.slice/crio-4542c3d3ef3b23235950e7767b494dfd37f0c1406e83ec209006c6d8633bc5c9 WatchSource:0}: Error finding container 4542c3d3ef3b23235950e7767b494dfd37f0c1406e83ec209006c6d8633bc5c9: Status 404 returned error can't find the container with id 4542c3d3ef3b23235950e7767b494dfd37f0c1406e83ec209006c6d8633bc5c9
Sep 15 09:47:25.505691 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:25.505665    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f" event={"ID":"212b160b-98f1-4602-bb8f-51bae8f2c8ab","Type":"ContainerStarted","Data":"4542c3d3ef3b23235950e7767b494dfd37f0c1406e83ec209006c6d8633bc5c9"}
Sep 15 09:47:26.511191 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:26.511153    2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f" event={"ID":"212b160b-98f1-4602-bb8f-51bae8f2c8ab","Type":"ContainerStarted","Data":"f24385627d0465a006187beb932de2009029cb7809cf3e4c7ed36af37d2c7d23"}
Sep 15 09:47:26.511608 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:26.511235    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:26.527160 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:26.527111    2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f" podStartSLOduration=2.527091353 podStartE2EDuration="2.527091353s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-15 09:47:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-15 09:47:26.526860985 +0000 UTC m=+2422.290432424" watchObservedRunningTime="2026-09-15 09:47:26.527091353 +0000 UTC m=+2422.290662815"
Sep 15 09:47:26.908611 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:26.908581    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tb9nd_8d84ca7c-c39f-4083-986e-39aae6f63b36/dns/0.log"
Sep 15 09:47:26.927625 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:26.927597    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-tb9nd_8d84ca7c-c39f-4083-986e-39aae6f63b36/kube-rbac-proxy/0.log"
Sep 15 09:47:27.029614 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:27.029588    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jpcpb_99c61bfb-71bd-4d37-b343-89b569e86fd2/dns-node-resolver/0.log"
Sep 15 09:47:27.702826 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:27.702795    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xz2vc_e3ac22ec-26d7-4931-877b-e458578e0266/node-ca/0.log"
Sep 15 09:47:28.767556 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:28.767526    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cxlkds_3d34d984-e2d1-4d61-bf78-027e6a11e3bd/istio-proxy/0.log"
Sep 15 09:47:29.582341 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:29.582304    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nkwh5_a4de6ff6-417e-4fe2-9764-757a46945108/discovery/0.log"
Sep 15 09:47:29.752213 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:29.752181    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2t2zf_f8518e94-5fcf-4716-9b97-eb29e84d7fdc/payload-processing/0.log"
Sep 15 09:47:30.679364 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:30.679311    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xh9pz_1fc6bc2b-a480-45e8-b599-7a7047c22563/serve-healthcheck-canary/0.log"
Sep 15 09:47:31.278201 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:31.278175    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4gpd_034d6e55-ea9d-4daa-beee-79acc09b4c8b/kube-rbac-proxy/0.log"
Sep 15 09:47:31.299107 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:31.299079    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4gpd_034d6e55-ea9d-4daa-beee-79acc09b4c8b/exporter/0.log"
Sep 15 09:47:31.321189 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:31.321137    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-k4gpd_034d6e55-ea9d-4daa-beee-79acc09b4c8b/extractor/0.log"
Sep 15 09:47:32.526235 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:32.526209    2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mwkv/perf-node-gather-daemonset-qnc6f"
Sep 15 09:47:34.168836 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:34.168787    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-7594f95958-gtl8g_a37d6fa8-5be9-4f3c-974d-9beeb2e75b98/manager/0.log"
Sep 15 09:47:34.189942 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:34.189913    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-cltxs_6031c05a-26b0-437f-acb8-2e9abed11026/server/0.log"
Sep 15 09:47:34.347553 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:34.347521    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-m8wp4_9df41f09-282a-4017-a5c0-50840a09b58a/manager/0.log"
Sep 15 09:47:34.425442 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:34.425347    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dcfd7f98-h2q96_cee1e606-68c8-4093-b76c-0801295cb76b/manager/0.log"
Sep 15 09:47:34.444320 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:34.444296    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-77dcfd7f98-h2q96_cee1e606-68c8-4093-b76c-0801295cb76b/copy-manifests/0.log"
Sep 15 09:47:34.877897 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:34.877876    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cxlkds_3d34d984-e2d1-4d61-bf78-027e6a11e3bd/istio-proxy/0.log"
Sep 15 09:47:35.714427 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:35.714395    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nkwh5_a4de6ff6-417e-4fe2-9764-757a46945108/discovery/0.log"
Sep 15 09:47:35.836358 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:35.836328    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2t2zf_f8518e94-5fcf-4716-9b97-eb29e84d7fdc/payload-processing/0.log"
Sep 15 09:47:35.971495 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:35.971421    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f667c6f8-zf5fv_eeb8b038-cad4-491c-b23d-c6ecf8f60bd4/manager/0.log"
Sep 15 09:47:37.425538 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:37.425504    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cxlkds_3d34d984-e2d1-4d61-bf78-027e6a11e3bd/istio-proxy/0.log"
Sep 15 09:47:38.249746 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:38.249709    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-nkwh5_a4de6ff6-417e-4fe2-9764-757a46945108/discovery/0.log"
Sep 15 09:47:38.375578 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:38.375544    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-2t2zf_f8518e94-5fcf-4716-9b97-eb29e84d7fdc/payload-processing/0.log"
Sep 15 09:47:42.663953 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:42.663920    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9szt_9ea37f1c-c822-4eca-b5c3-c9ef40af8a29/kube-multus-additional-cni-plugins/0.log"
Sep 15 09:47:42.698445 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:42.698404    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9szt_9ea37f1c-c822-4eca-b5c3-c9ef40af8a29/egress-router-binary-copy/0.log"
Sep 15 09:47:42.718512 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:42.718485    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9szt_9ea37f1c-c822-4eca-b5c3-c9ef40af8a29/cni-plugins/0.log"
Sep 15 09:47:42.740757 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:42.740718    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9szt_9ea37f1c-c822-4eca-b5c3-c9ef40af8a29/bond-cni-plugin/0.log"
Sep 15 09:47:42.759654 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:42.759629    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9szt_9ea37f1c-c822-4eca-b5c3-c9ef40af8a29/routeoverride-cni/0.log"
Sep 15 09:47:42.782306 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:42.782285    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9szt_9ea37f1c-c822-4eca-b5c3-c9ef40af8a29/whereabouts-cni-bincopy/0.log"
Sep 15 09:47:42.808188 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:42.808167    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-s9szt_9ea37f1c-c822-4eca-b5c3-c9ef40af8a29/whereabouts-cni/0.log"
Sep 15 09:47:42.938082 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:42.937991    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-mr97v_cfdbfd7e-641f-4ef4-bcba-a565f7205787/kube-multus/0.log"
Sep 15 09:47:43.048652 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:43.048612    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8rxs2_3affebbf-2c05-4dfc-9102-9c1711221bba/network-metrics-daemon/0.log"
Sep 15 09:47:43.063604 ip-10-0-141-185 kubenswrapper[2568]: I0915 09:47:43.063569    2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-8rxs2_3affebbf-2c05-4dfc-9102-9c1711221bba/kube-rbac-proxy/0.log"