Sep 11 17:20:23.087499 ip-10-0-143-85 systemd[1]: Starting Kubernetes Kubelet...
Sep 11 17:20:23.515887 ip-10-0-143-85 kubenswrapper[2584]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:20:23.515887 ip-10-0-143-85 kubenswrapper[2584]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 11 17:20:23.515887 ip-10-0-143-85 kubenswrapper[2584]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:20:23.515887 ip-10-0-143-85 kubenswrapper[2584]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 11 17:20:23.515887 ip-10-0-143-85 kubenswrapper[2584]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 11 17:20:23.518055 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.517967    2584 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 11 17:20:23.522129 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522114    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:20:23.522129 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522129    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522133    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522136    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522140    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522143    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522146    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522150    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522153    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522156    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522159    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522162    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522165    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522170    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522187    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522190    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522193    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522196    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522199    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522202    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522205    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:20:23.522205 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522207    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522210    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522213    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522216    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522219    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522223    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522226    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522230    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522232    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522235    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522238    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522240    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522244    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522247    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522251    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522254    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522256    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522259    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522262    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:20:23.522695 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522265    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522269    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522271    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522274    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522277    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522280    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522282    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522285    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522287    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522289    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522292    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522294    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522297    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522299    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522301    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522305    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522308    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522310    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522313    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:20:23.523149 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522315    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522318    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522320    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522323    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522326    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522328    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522331    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522333    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522343    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522346    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522349    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522351    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522354    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522357    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522359    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522362    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522364    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522366    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522369    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522372    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:20:23.523910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522376    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522379    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522381    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522384    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522386    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522389    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522392    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522394    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522398    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522400    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522403    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522406    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522408    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522411    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522413    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522416    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522418    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522421    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522423    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.522426    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:20:23.524595 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523137    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523144    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523147    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523150    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523153    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523156    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523159    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523162    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523165    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523168    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523186    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523189    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523192    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523195    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523198    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523200    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523203    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523206    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523209    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523212    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:20:23.525231 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523215    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523218    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523221    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523224    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523226    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523229    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523232    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523234    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523237    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523240    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523242    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523245    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523248    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523250    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523253    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523255    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523258    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523261    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523263    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523266    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:20:23.525765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523268    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523271    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523273    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523276    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523279    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523320    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523369    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523374    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523379    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523387    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523394    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523400    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523405    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523410    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523415    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523420    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523424    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523429    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523439    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523443    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:20:23.526281 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523496    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523500    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523505    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523509    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523514    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523519    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523523    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523528    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523532    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523544    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523548    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523553    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523558    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523562    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523566    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523570    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523575    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523580    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523595    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:20:23.526786 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523600    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523605    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523609    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523619    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523623    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523628    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523633    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523638    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523642    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523647    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523651    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523655    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523659    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523663    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523667    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523676    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523680    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523684    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523688    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:20:23.527275 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.523695    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525062    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525072    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525077    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525080    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525083    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525087    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525090    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525093    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525096    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525099    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525102    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525104    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525107    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525110    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525112    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525115    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525118    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525120    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525123    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:20:23.527756 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525127    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525131    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525134    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525138    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525140    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525143    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525145    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525148    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525150    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525153    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525155    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525157    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525161    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525164    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525167    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525170    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525190    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525193    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525196    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525198    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:20:23.528271 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525201    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525204    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525207    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525209    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525212    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525214    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525217    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525220    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525222    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525225    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525227    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525230    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525233    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525236    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525239    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525241    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525244    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525247    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525250    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525252    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:20:23.528758 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525255    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525257    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525260    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525263    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525266    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525269    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525272    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525275    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525277    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525280    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525283    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525285    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525288    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525291    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525293    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525296    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525300    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525302    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525305    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:20:23.529274 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525307    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525310    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525312    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525315    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525317    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525320    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525322    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525326    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525330    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525333    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525335    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525338    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525340    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525343    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525347    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525351    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525354    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525358    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525361    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:20:23.529750 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525364    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.525367    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525431    2584 flags.go:64] FLAG: --address="0.0.0.0"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525465    2584 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525472    2584 flags.go:64] FLAG: --anonymous-auth="true"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525477    2584 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525481    2584 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525484    2584 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525489    2584 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525494    2584 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525497    2584 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525500    2584 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525504    2584 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525507    2584 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525510    2584 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525513    2584 flags.go:64] FLAG: --cgroup-root=""
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525516    2584 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525520    2584 flags.go:64] FLAG: --client-ca-file=""
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525522    2584 flags.go:64] FLAG: --cloud-provider="external"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525525    2584 flags.go:64] FLAG: --cluster-dns="[]"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525529    2584 flags.go:64] FLAG: --cluster-domain=""
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525532    2584 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525535    2584 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525538    2584 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 11 17:20:23.530237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525542    2584 flags.go:64] FLAG: --container-log-max-files="5"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525545    2584 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525549    2584 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525552    2584 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525555    2584 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525558    2584 flags.go:64] FLAG: --contention-profiling="false"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525562    2584 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525565    2584 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525568    2584 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525571    2584 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525578    2584 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525581    2584 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525584    2584 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525587    2584 flags.go:64] FLAG: --enable-load-reader="false"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525590    2584 flags.go:64] FLAG: --enable-server="true"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525593    2584 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525598    2584 flags.go:64] FLAG: --event-burst="100"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525601    2584 flags.go:64] FLAG: --event-qps="50"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525604    2584 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525607    2584 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525610    2584 flags.go:64] FLAG: --eviction-hard=""
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525613    2584 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525616    2584 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525619    2584 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525622    2584 flags.go:64] FLAG: --eviction-soft=""
Sep 11 17:20:23.530866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525625    2584 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525627    2584 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525630    2584 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525633    2584 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525636    2584 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525639    2584 flags.go:64] FLAG: --fail-swap-on="true"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525642    2584 flags.go:64] FLAG: --feature-gates=""
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525645    2584 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525648    2584 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525651    2584 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525654    2584 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525657    2584 flags.go:64] FLAG: --healthz-port="10248"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525661    2584 flags.go:64] FLAG: --help="false"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525664    2584 flags.go:64] FLAG: --hostname-override="ip-10-0-143-85.ec2.internal"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525667    2584 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525670    2584 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525674    2584 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525677    2584 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525680    2584 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525683    2584 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525686    2584 flags.go:64] FLAG: --image-service-endpoint=""
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525689    2584 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525692    2584 flags.go:64] FLAG: --kube-api-burst="100"
Sep 11 17:20:23.531480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525694    2584 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525698    2584 flags.go:64] FLAG: --kube-api-qps="50"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525700    2584 flags.go:64] FLAG: --kube-reserved=""
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525703    2584 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525706    2584 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525709    2584 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525711    2584 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525714    2584 flags.go:64] FLAG: --lock-file=""
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525717    2584 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525720    2584 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525723    2584 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525728    2584 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525731    2584 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525734    2584 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525737    2584 flags.go:64] FLAG: --logging-format="text"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525740    2584 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525743    2584 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525746    2584 flags.go:64] FLAG: --manifest-url=""
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525749    2584 flags.go:64] FLAG: --manifest-url-header=""
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525753    2584 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525755    2584 flags.go:64] FLAG: --max-open-files="1000000"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525759    2584 flags.go:64] FLAG: --max-pods="110"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525762    2584 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525765    2584 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525771    2584 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 11 17:20:23.532064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525775    2584 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525778    2584 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525781    2584 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525784    2584 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525791    2584 flags.go:64] FLAG: --node-status-max-images="50"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525794    2584 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525797    2584 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525801    2584 flags.go:64] FLAG: --pod-cidr=""
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525804    2584 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:eee392dbe3ac2ed4a38bca29ae3bd486f5b7780406c62c600154cd1906871b10"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525809    2584 flags.go:64] FLAG: --pod-manifest-path=""
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525812    2584 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525815    2584 flags.go:64] FLAG: --pods-per-core="0"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525818    2584 flags.go:64] FLAG: --port="10250"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525821    2584 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525823    2584 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0b364a31bb3c060f1"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525827    2584 flags.go:64] FLAG: --qos-reserved=""
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525830    2584 flags.go:64] FLAG: --read-only-port="10255"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525833    2584 flags.go:64] FLAG: --register-node="true"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525836    2584 flags.go:64] FLAG: --register-with-taints=""
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525840    2584 flags.go:64] FLAG: --registry-burst="10"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525843    2584 flags.go:64] FLAG: --registry-qps="5"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525846    2584 flags.go:64] FLAG: --reserved-cpus=""
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525849    2584 flags.go:64] FLAG: --reserved-memory=""
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525853    2584 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525856    2584 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 11 17:20:23.532720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525859    2584 flags.go:64] FLAG: --rotate-certificates="false"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525861    2584 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525864    2584 flags.go:64] FLAG: --runonce="false"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525867    2584 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525870    2584 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525873    2584 flags.go:64] FLAG: --seccomp-default="false"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525877    2584 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525880    2584 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525883    2584 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525887    2584 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525890    2584 flags.go:64] FLAG: --storage-driver-password="root"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525893    2584 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525896    2584 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525899    2584 flags.go:64] FLAG: --storage-driver-user="root"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525902    2584 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525904    2584 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525907    2584 flags.go:64] FLAG: --system-cgroups=""
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525910    2584 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525915    2584 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525918    2584 flags.go:64] FLAG: --tls-cert-file=""
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525921    2584 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525925    2584 flags.go:64] FLAG: --tls-min-version=""
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525928    2584 flags.go:64] FLAG: --tls-private-key-file=""
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525930    2584 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525935    2584 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 11 17:20:23.533347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525938    2584 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525941    2584 flags.go:64] FLAG: --v="2"
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525944    2584 flags.go:64] FLAG: --version="false"
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525948    2584 flags.go:64] FLAG: --vmodule=""
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525952    2584 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.525955    2584 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526080    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526084    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526087    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526091    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526094    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526096    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526099    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526103    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526106    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526109    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526111    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526114    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526116    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526119    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:20:23.533991 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526122    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526124    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526127    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526130    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526132    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526134    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526137    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526140    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526142    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526145    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526149    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526153    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526156    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526159    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526162    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526164    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526167    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526169    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526194    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:20:23.534517 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526197    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526199    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526202    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526205    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526208    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526210    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526215    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526217    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526220    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526224    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526227    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526230    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526232    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526235    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526238    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526240    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526243    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526246    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526248    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526251    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:20:23.534984 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526254    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526256    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526259    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526262    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526265    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526268    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526271    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526273    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526276    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526279    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526283    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526286    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526290    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526293    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526295    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526298    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526301    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526303    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526307    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526310    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:20:23.535492 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526312    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526315    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526318    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526321    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526323    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526326    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526328    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526331    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526333    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526343    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526347    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526351    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526355    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526358    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526361    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526363    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526367    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526370    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526374    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526377    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:20:23.535983 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526380    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526383    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526386    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526389    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526391    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.526394    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.526403    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.533960    2584 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.533975    2584 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.534796    2584 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.534809    2584 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534859    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534865    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534869    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:20:23.536491 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534874    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534877    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534880    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534884    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534887    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534890    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534892    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534896    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534900    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534903    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534906    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534909    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534912    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534916    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534920    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534924    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534926    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534929    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534932    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:20:23.536846 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534935    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534937    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534940    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534943    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534945    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534948    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534950    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534953    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534956    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534958    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534961    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534964    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534966    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534969    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534973    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534975    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534978    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534981    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534983    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534986    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:20:23.537354 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534989    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534991    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534994    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534996    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.534999    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535002    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535004    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535007    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535009    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535012    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535015    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535017    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535020    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535023    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535025    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535028    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535030    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535033    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535035    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535038    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:20:23.537836 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535040    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535043    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535046    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535049    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535051    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535054    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535056    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535060    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535062    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535065    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535067    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535070    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535072    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535075    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535078    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535080    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535083    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535086    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535088    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535091    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:20:23.538472 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535093    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535096    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535099    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535101    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535104    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535107    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535110    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535112    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535115    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535117    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535120    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535122    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535125    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535127    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535130    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535132    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:20:23.538959 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535134    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.535139    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535258    2584 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535263    2584 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535267    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535270    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535273    2584 feature_gate.go:328] unrecognized feature gate: Example
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535276    2584 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535279    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535282    2584 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535284    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535287    2584 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535290    2584 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535292    2584 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535295    2584 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 11 17:20:23.539342 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535299    2584 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535302    2584 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535305    2584 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535308    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535311    2584 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535314    2584 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535317    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535321    2584 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535324    2584 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535326    2584 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535329    2584 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535332    2584 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535334    2584 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535337    2584 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535340    2584 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535342    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535345    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535347    2584 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535350    2584 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535352    2584 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 11 17:20:23.539714 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535355    2584 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535358    2584 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535361    2584 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535363    2584 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535366    2584 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535368    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535371    2584 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535373    2584 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535376    2584 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535378    2584 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535381    2584 feature_gate.go:328] unrecognized feature gate: Example2
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535383    2584 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535386    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535389    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535391    2584 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535395    2584 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535398    2584 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535401    2584 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535404    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 11 17:20:23.540222 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535407    2584 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535410    2584 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535413    2584 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535416    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535419    2584 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535422    2584 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535424    2584 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535428    2584 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535430    2584 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535433    2584 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535435    2584 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535438    2584 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535440    2584 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535443    2584 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535445    2584 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535448    2584 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535451    2584 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535453    2584 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535456    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535458    2584 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 11 17:20:23.540674 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535461    2584 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535464    2584 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535466    2584 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535469    2584 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535471    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535474    2584 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535476    2584 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535479    2584 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535481    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535484    2584 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535486    2584 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535489    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535492    2584 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535494    2584 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535497    2584 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535500    2584 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535504    2584 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535507    2584 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535509    2584 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535512    2584 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 11 17:20:23.541186 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535515    2584 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535517    2584 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535520    2584 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535522    2584 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535526    2584 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535528    2584 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:23.535531    2584 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.535536    2584 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.535632    2584 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.537917    2584 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.539022    2584 server.go:1019] "Starting client certificate rotation"
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.539113    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 17:20:23.541671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.539148    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 11 17:20:23.542065 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.542052    2584 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 17:20:23.543779 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.543763    2584 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 11 17:20:23.550604 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.550588    2584 log.go:25] "Validated CRI v1 runtime API"
Sep 11 17:20:23.555062 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.555043    2584 log.go:25] "Validated CRI v1 image API"
Sep 11 17:20:23.555973 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.555957    2584 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 11 17:20:23.560042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.560023    2584 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 b11b28cf-7610-4ffd-a961-03adbf77a92b:/dev/nvme0n1p3 b4010fa6-f990-42f1-8ce8-840b73db3cf0:/dev/nvme0n1p4]
Sep 11 17:20:23.560121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.560041    2584 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 11 17:20:23.566138 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.566033    2584 manager.go:216] Machine: {Timestamp:2026-09-11 17:20:23.563546672 +0000 UTC m=+0.368462448 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099662 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e3e8139c0de337bc25a86e17dcb4b SystemUUID:ec2e3e81-39c0-de33-7bc2-5a86e17dcb4b BootID:078280a2-08af-401c-8c5e-33863baa57b7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:d9:ff:35:8a:5d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:d9:ff:35:8a:5d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:13:4b:d6:22:27 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 11 17:20:23.566138 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.566132    2584 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 11 17:20:23.566273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.566219    2584 manager.go:232] Version: {KernelVersion:5.14.0-570.140.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260908-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 11 17:20:23.568502 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.568484    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 17:20:23.569753 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.569732    2584 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 11 17:20:23.569880 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.569758    2584 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-85.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 11 17:20:23.571285 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.571273    2584 topology_manager.go:138] "Creating topology manager with none policy"
Sep 11 17:20:23.571330 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.571288    2584 container_manager_linux.go:309] "Creating device plugin manager"
Sep 11 17:20:23.571330 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.571296    2584 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 17:20:23.571965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.571955    2584 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 11 17:20:23.573261 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.573251    2584 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 11 17:20:23.578026 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578015    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 17:20:23.578143 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578134    2584 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 11 17:20:23.578188 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578162    2584 kubelet.go:486] "Attempting to sync node with API server"
Sep 11 17:20:23.578188 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578185    2584 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 11 17:20:23.578241 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578209    2584 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 11 17:20:23.578241 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578221    2584 kubelet.go:398] "Adding apiserver pod source"
Sep 11 17:20:23.578241 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578231    2584 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 11 17:20:23.578579 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578567    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 17:20:23.578634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.578585    2584 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 11 17:20:23.581489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.581473    2584 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 11 17:20:23.583743 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.583727    2584 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 11 17:20:23.583821 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.583767    2584 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 11 17:20:23.585775 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585762    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 11 17:20:23.585854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585781    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 11 17:20:23.585854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585789    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 11 17:20:23.585854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585797    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 11 17:20:23.585854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585809    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 11 17:20:23.585854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585816    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 11 17:20:23.585854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585836    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 11 17:20:23.585854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585844    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 11 17:20:23.585854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585853    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 11 17:20:23.586118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585864    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 11 17:20:23.586118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585883    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 11 17:20:23.586118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.585892    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 11 17:20:23.586808 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.586796    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 11 17:20:23.586867 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.586811    2584 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 11 17:20:23.589095 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.589069    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 11 17:20:23.589095 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.589072    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 11 17:20:23.589272 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.589146    2584 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-85.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 11 17:20:23.590675 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.590660    2584 server.go:1268] "Started kubelet"
Sep 11 17:20:23.590761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.590715    2584 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 11 17:20:23.590806 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.590754    2584 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 11 17:20:23.590844 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.590820    2584 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 11 17:20:23.591496 ip-10-0-143-85 systemd[1]: Started Kubernetes Kubelet.
Sep 11 17:20:23.593053 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.592952    2584 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 11 17:20:23.593384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.593371    2584 server.go:310] "Adding debug handlers to kubelet server"
Sep 11 17:20:23.598263 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.598242    2584 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 11 17:20:23.600563 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.600541    2584 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 11 17:20:23.601226 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.601209    2584 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 11 17:20:23.601334 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.601315    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:23.602005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.601987    2584 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 11 17:20:23.602005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.602008    2584 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 11 17:20:23.602100 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.601987    2584 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 11 17:20:23.602100 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.602089    2584 reconstruct.go:97] "Volume reconstruction finished"
Sep 11 17:20:23.602100 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.602093    2584 reconciler.go:29] "Reconciler: start to sync state"
Sep 11 17:20:23.602769 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.602752    2584 factory.go:55] Registering systemd factory
Sep 11 17:20:23.602854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.602772    2584 factory.go:223] Registration of the systemd container factory successfully
Sep 11 17:20:23.602981 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.602968    2584 factory.go:153] Registering CRI-O factory
Sep 11 17:20:23.603034 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.602983    2584 factory.go:223] Registration of the crio container factory successfully
Sep 11 17:20:23.603034 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.603027    2584 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 11 17:20:23.603128 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.603041    2584 factory.go:103] Registering Raw factory
Sep 11 17:20:23.603128 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.603052    2584 manager.go:1196] Started watching for new ooms in manager
Sep 11 17:20:23.604400 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.604267    2584 manager.go:349] Starting recovery of all containers
Sep 11 17:20:23.606166 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.606135    2584 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 11 17:20:23.606325 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.606307    2584 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-85.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 11 17:20:23.607310 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.606122    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d453eba8feff23  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-11 17:20:23.590633251 +0000 UTC m=+0.395549026,LastTimestamp:2026-09-11 17:20:23.590633251 +0000 UTC m=+0.395549026,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 11 17:20:23.614370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.614354    2584 manager.go:354] Recovery completed
Sep 11 17:20:23.619323 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.619309    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:20:23.621115 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.621094    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:20:23.621206 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.621135    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:20:23.621206 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.621150    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:20:23.621641 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.621630    2584 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 11 17:20:23.621641 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.621639    2584 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 11 17:20:23.621726 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.621652    2584 state_mem.go:36] "Initialized new in-memory state store"
Sep 11 17:20:23.621726 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.621685    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:20:23.622452 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.622429    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:20:23.622517 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.622466    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:20:23.622517 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.622483    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:20:23.623290 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.623214    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d453ebaad02255  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-11 17:20:23.621116501 +0000 UTC m=+0.426032285,LastTimestamp:2026-09-11 17:20:23.621116501 +0000 UTC m=+0.426032285,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 11 17:20:23.623470 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.623453    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brzh4"
Sep 11 17:20:23.632052 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.632027    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-brzh4"
Sep 11 17:20:23.634030 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.633968    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d453ebaad08bfc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-11 17:20:23.621143548 +0000 UTC m=+0.426059324,LastTimestamp:2026-09-11 17:20:23.621143548 +0000 UTC m=+0.426059324,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 11 17:20:23.643680 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.643611    2584 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d453ebaad0b4d7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-11 17:20:23.621154007 +0000 UTC m=+0.426069783,LastTimestamp:2026-09-11 17:20:23.621154007 +0000 UTC m=+0.426069783,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 11 17:20:23.652959 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.652908    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-85.ec2.internal.18d453ebaad02255\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d453ebaad02255  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-11 17:20:23.621116501 +0000 UTC m=+0.426032285,LastTimestamp:2026-09-11 17:20:23.622451403 +0000 UTC m=+0.427367181,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 11 17:20:23.663645 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.663584    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-85.ec2.internal.18d453ebaad08bfc\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d453ebaad08bfc  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-11 17:20:23.621143548 +0000 UTC m=+0.426059324,LastTimestamp:2026-09-11 17:20:23.622472931 +0000 UTC m=+0.427388707,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 11 17:20:23.675070 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.675018    2584 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-143-85.ec2.internal.18d453ebaad0b4d7\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-85.ec2.internal.18d453ebaad0b4d7  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-85.ec2.internal,UID:ip-10-0-143-85.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-143-85.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-143-85.ec2.internal,},FirstTimestamp:2026-09-11 17:20:23.621154007 +0000 UTC m=+0.426069783,LastTimestamp:2026-09-11 17:20:23.622488842 +0000 UTC m=+0.427404619,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-85.ec2.internal,}"
Sep 11 17:20:23.702144 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.702128    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:23.763680 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.763660    2584 policy_none.go:49] "None policy: Start"
Sep 11 17:20:23.763761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.763683    2584 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 11 17:20:23.763761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.763699    2584 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 11 17:20:23.765807 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.765793    2584 policy_none.go:47] "Start"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.793748    2584 manager.go:337] "Starting Device Plugin manager"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.793780    2584 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.793793    2584 server.go:87] "Starting device plugin registration server"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.794092    2584 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.794104    2584 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.794223    2584 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.794284    2584 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.794293    2584 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.794832    2584 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 11 17:20:23.797664 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.794883    2584 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:23.811677 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.811654    2584 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-143-85.ec2.internal\" not found" node="ip-10-0-143-85.ec2.internal"
Sep 11 17:20:23.847409 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.847379    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 11 17:20:23.848566 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.848550    2584 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 11 17:20:23.848616 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.848606    2584 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 11 17:20:23.848656 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.848630    2584 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 11 17:20:23.848703 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.848673    2584 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 11 17:20:23.850630 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.850613    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:20:23.894306 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.894292    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:20:23.895168 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.895151    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:20:23.895273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.895200    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:20:23.895273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.895215    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:20:23.895273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.895243    2584 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-85.ec2.internal"
Sep 11 17:20:23.904227 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.904213    2584 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-85.ec2.internal"
Sep 11 17:20:23.904293 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.904231    2584 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-85.ec2.internal\": node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:23.933280 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.933259    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:23.949351 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.949332    2584 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"]
Sep 11 17:20:23.949412 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.949408    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:20:23.950205 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.950191    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:20:23.950273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.950216    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:20:23.950273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.950226    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:20:23.952611 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.952598    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:20:23.952739 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.952725    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:23.952799 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.952758    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:20:23.953255 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.953239    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:20:23.953326 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.953244    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:20:23.953326 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.953307    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:20:23.953326 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.953268    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:20:23.953466 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.953322    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:20:23.953466 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.953341    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:20:23.955634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.955620    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:23.955689 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.955644    2584 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 11 17:20:23.956269 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.956247    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientMemory"
Sep 11 17:20:23.956269 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.956268    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasNoDiskPressure"
Sep 11 17:20:23.956355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:23.956282    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeHasSufficientPID"
Sep 11 17:20:23.981675 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.981658    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-85.ec2.internal\" not found" node="ip-10-0-143-85.ec2.internal"
Sep 11 17:20:23.984920 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:23.984907    2584 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-85.ec2.internal\" not found" node="ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.003548 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.003530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fd76400f9433d06743f51faa0c5dcb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-85.ec2.internal\" (UID: \"d8fd76400f9433d06743f51faa0c5dcb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.003603 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.003559    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.003603 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.003576    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.033891 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:24.033871    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:24.103790 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.103770    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fd76400f9433d06743f51faa0c5dcb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-85.ec2.internal\" (UID: \"d8fd76400f9433d06743f51faa0c5dcb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.103848 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.103793    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.103848 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.103816    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.103909 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.103853    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.103909 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.103871    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d8fd76400f9433d06743f51faa0c5dcb-config\") pod \"kube-apiserver-proxy-ip-10-0-143-85.ec2.internal\" (UID: \"d8fd76400f9433d06743f51faa0c5dcb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.103909 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:24.103875    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/cd79124a262d4d1f4b0672083ba4d2cd-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal\" (UID: \"cd79124a262d4d1f4b0672083ba4d2cd\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:24.134927 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:24.134901    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:24.235388 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:24.235360    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:26.133753 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.133716    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:26.138761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.138581    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:26.186639 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.186610    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:26.287145 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.287116    2584 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-85.ec2.internal\" not found"
Sep 11 17:20:26.325354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.325331    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:20:26.352487 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.352463    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:26.366288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.366271    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 17:20:26.367631 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.367617    2584 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal"
Sep 11 17:20:26.375929 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.375912    2584 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 11 17:20:26.388455 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.388389    2584 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 11 17:20:26.388570 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.388541    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 17:20:26.388628 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.388573    2584 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 11 17:20:26.429297 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.429277    2584 apiserver.go:52] "Watching apiserver"
Sep 11 17:20:26.443906 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.443883    2584 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 11 17:20:26.444209 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.444189    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-fdflt","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8","openshift-image-registry/node-ca-8dgdw","openshift-multus/multus-additional-cni-plugins-dsg54","openshift-multus/multus-t6x69","openshift-multus/network-metrics-daemon-gvrhz","openshift-network-diagnostics/network-check-target-kqwjl","openshift-network-operator/iptables-alerter-vh8np","kube-system/global-pull-secret-syncer-xxpwt","kube-system/konnectivity-agent-l4mw7","kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal","openshift-cluster-node-tuning-operator/tuned-sdhv7","openshift-dns/node-resolver-rhwpb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal"]
Sep 11 17:20:26.446734 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.446720    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:26.448932 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.448909    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 11 17:20:26.449016 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.448971    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.449085 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.449018    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 11 17:20:26.449085 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.449024    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-vmr96\""
Sep 11 17:20:26.450932 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.450911    2584 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 11 17:20:26.451241 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.451211    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 11 17:20:26.451574 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.451542    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 11 17:20:26.451703 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.451680    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qwnzq\""
Sep 11 17:20:26.451963 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.451945    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.453002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.452984    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 11 17:20:26.454188 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.454175    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 11 17:20:26.454575 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.454559    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 11 17:20:26.454690 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.454676    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.454757 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.454738    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 11 17:20:26.454811 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.454793    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-xg2nl\""
Sep 11 17:20:26.456851 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.456833    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shrvz\" (UniqueName: \"kubernetes.io/projected/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-kube-api-access-shrvz\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.456954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.456861    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-ovn\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.456954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.456905    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.456954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.456916    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.456954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.456944    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-ovnkube-config\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.456966    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-serviceca\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.456997    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-kubelet\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457019    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-systemd\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457024    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457040    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-env-overrides\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457072    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-socket-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457112    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-slash\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457142    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-log-socket\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457165    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lp92\" (UniqueName: \"kubernetes.io/projected/39e2442f-4119-4111-91ee-3deb60db2897-kube-api-access-5lp92\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457215    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5ljh\" (UniqueName: \"kubernetes.io/projected/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-kube-api-access-w5ljh\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457255    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-run-netns\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457283    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-cni-bin\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457315    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457388    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-device-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457464    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-sys-fs\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457498    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-var-lib-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457522    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-registration-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457549    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-etc-selinux\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.457588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457573    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-host\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457593    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d2ee351-3a92-4965-9297-d51915b67a78-agent-certs\") pod \"konnectivity-agent-l4mw7\" (UID: \"9d2ee351-3a92-4965-9297-d51915b67a78\") " pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457708    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-etc-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457732    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-node-log\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457758    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-cni-netd\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457785    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39e2442f-4119-4111-91ee-3deb60db2897-ovn-node-metrics-cert\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457801    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-ovnkube-script-lib\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457815    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457833    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-systemd-units\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d2ee351-3a92-4965-9297-d51915b67a78-konnectivity-ca\") pod \"konnectivity-agent-l4mw7\" (UID: \"9d2ee351-3a92-4965-9297-d51915b67a78\") " pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457956    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457970    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457975    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457974    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-z7hq6\""
Sep 11 17:20:26.458037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.457976    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 11 17:20:26.459092 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.459076    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2fb2w\""
Sep 11 17:20:26.459140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.459078    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 11 17:20:26.459140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.459124    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 11 17:20:26.459293 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.459281    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.460359 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.460342    2584 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 11 17:20:26.461217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.461202    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:20:26.461410 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.461383    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 11 17:20:26.461490 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.461383    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ppmm6\""
Sep 11 17:20:26.461562 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.461546    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.463296 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.463280    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 11 17:20:26.463735 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.463722    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.463875 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.463831    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 11 17:20:26.463875 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.463844    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 11 17:20:26.464041 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.463849    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6msk6\""
Sep 11 17:20:26.464041 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.463836    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 11 17:20:26.464163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.464150    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 11 17:20:26.465492 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.465479    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-vb66d\""
Sep 11 17:20:26.465965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.465946    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 11 17:20:26.466040 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.465998    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.466040 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.466036    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 11 17:20:26.466129 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.466075    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:26.466271 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.466258    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:20:26.468075 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.468058    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:26.468166 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.468125    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:26.470294 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.470277    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:26.470348 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.470335    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:26.472543 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.472528    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.474628 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.474614    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 11 17:20:26.474747 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.474729    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-nb4pr\""
Sep 11 17:20:26.486641 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.486623    2584 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tpfzb"
Sep 11 17:20:26.494935 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.494917    2584 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tpfzb"
Sep 11 17:20:26.499777 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.499759    2584 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:20:26.553091 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.553076    2584 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 11 17:20:26.559037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559010    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2b5d\" (UniqueName: \"kubernetes.io/projected/6abced10-d6ff-4cce-9779-3160eff4bb59-kube-api-access-f2b5d\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.559149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559044    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvrvd\" (UniqueName: \"kubernetes.io/projected/d8160bb7-c5a4-450d-bc41-a9e43eab4147-kube-api-access-qvrvd\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.559149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559075    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-systemd-units\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559096    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-system-cni-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.559149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559118    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-hostroot\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.559149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559126    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-systemd-units\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559139    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shrvz\" (UniqueName: \"kubernetes.io/projected/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-kube-api-access-shrvz\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559186    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-ovn\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559212    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559245    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-ovnkube-config\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559246    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-ovn\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559253    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-run-ovn-kubernetes\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559265    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-kubelet\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559281    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-sys\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559312    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-serviceca\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559374    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-kubelet\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559390    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8160bb7-c5a4-450d-bc41-a9e43eab4147-tmp-dir\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559425    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5lp92\" (UniqueName: \"kubernetes.io/projected/39e2442f-4119-4111-91ee-3deb60db2897-kube-api-access-5lp92\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559450    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-k8s-cni-cncf-io\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559451    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-kubelet\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559475    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-cni-bin\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.559489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559500    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-iptables-alerter-script\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-kubernetes\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559557    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5ljh\" (UniqueName: \"kubernetes.io/projected/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-kube-api-access-w5ljh\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-socket-dir-parent\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559615    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-conf-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559636    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdc9r\" (UniqueName: \"kubernetes.io/projected/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-kube-api-access-zdc9r\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559658    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysctl-conf\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559679    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p46gl\" (UniqueName: \"kubernetes.io/projected/fbd44662-b63a-40ac-b75f-2efcdef8b90c-kube-api-access-p46gl\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559701    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c18b7034-c197-4dd5-aa98-85db5ff80828-dbus\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559720    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-serviceca\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559725    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559799    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-ovnkube-config\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559804    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-device-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559828    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-sys-fs\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559843    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-host\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559859    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559892    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.560308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559902    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-sys-fs\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-etc-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559950    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-device-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559949    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39e2442f-4119-4111-91ee-3deb60db2897-ovn-node-metrics-cert\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559955    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-etc-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559956    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.559995    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-ovnkube-script-lib\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560038    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-cni-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560063    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-multus-certs\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560098    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysctl-d\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd44662-b63a-40ac-b75f-2efcdef8b90c-tmp\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560220    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560250    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560298    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-kubelet-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560310    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d2ee351-3a92-4965-9297-d51915b67a78-konnectivity-ca\") pod \"konnectivity-agent-l4mw7\" (UID: \"9d2ee351-3a92-4965-9297-d51915b67a78\") " pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560346    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560411    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-host-slash\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.561249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560437    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-tuned\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560462    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-systemd\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560484    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-env-overrides\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560487    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-ovnkube-script-lib\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560507    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-cni-multus\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560530    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-cnibin\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560540    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-run-systemd\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560528    2584 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c879f\" (UniqueName: \"kubernetes.io/projected/26e9c773-0ea1-4f93-98b4-1357abe71e58-kube-api-access-c879f\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560654    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-lib-modules\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-socket-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560685    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-slash\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560699    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-log-socket\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560714    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkjgv\" (UniqueName: \"kubernetes.io/projected/d60920d5-6202-4ebf-99cd-f5bddf867f35-kube-api-access-mkjgv\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560739    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-daemon-config\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560763    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-log-socket\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560763    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-var-lib-kubelet\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.562142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560798    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-run-netns\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560805    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-slash\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560818    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/9d2ee351-3a92-4965-9297-d51915b67a78-konnectivity-ca\") pod \"konnectivity-agent-l4mw7\" (UID: \"9d2ee351-3a92-4965-9297-d51915b67a78\") " pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560821    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-cni-bin\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/39e2442f-4119-4111-91ee-3deb60db2897-env-overrides\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560865    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-cni-bin\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560878    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560894    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-run-netns\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560899    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-socket-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560913    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-system-cni-dir\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560919    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560938    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.560993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561020    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysconfig\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561042    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-systemd\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-var-lib-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561086    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-cnibin\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.562968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-var-lib-openvswitch\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561107    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8160bb7-c5a4-450d-bc41-a9e43eab4147-hosts-file\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561129    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-modprobe-d\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561150    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c18b7034-c197-4dd5-aa98-85db5ff80828-kubelet-config\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561173    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-registration-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561210    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-etc-selinux\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561234    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-host\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561255    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-run\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561270    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-etc-kubernetes\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561285    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d2ee351-3a92-4965-9297-d51915b67a78-agent-certs\") pod \"konnectivity-agent-l4mw7\" (UID: \"9d2ee351-3a92-4965-9297-d51915b67a78\") " pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-etc-selinux\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561288    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-registration-dir\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561302    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-node-log\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561334    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-host\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561354    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-node-log\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561364    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-cni-netd\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561390    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6abced10-d6ff-4cce-9779-3160eff4bb59-cni-binary-copy\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.563796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561390    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/39e2442f-4119-4111-91ee-3deb60db2897-host-cni-netd\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.564634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561431    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-netns\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.564634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.561454    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.564634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.563827    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/39e2442f-4119-4111-91ee-3deb60db2897-ovn-node-metrics-cert\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.564634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.563914    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/9d2ee351-3a92-4965-9297-d51915b67a78-agent-certs\") pod \"konnectivity-agent-l4mw7\" (UID: \"9d2ee351-3a92-4965-9297-d51915b67a78\") " pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:26.566870 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.566846    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shrvz\" (UniqueName: \"kubernetes.io/projected/4d38fa0a-54d9-47fe-85ab-01730aaa2b41-kube-api-access-shrvz\") pod \"aws-ebs-csi-driver-node-bs8s8\" (UID: \"4d38fa0a-54d9-47fe-85ab-01730aaa2b41\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.567415 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.567383    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5ljh\" (UniqueName: \"kubernetes.io/projected/ffdf1588-47ee-4828-a7e0-c3c45afe2e01-kube-api-access-w5ljh\") pod \"node-ca-8dgdw\" (UID: \"ffdf1588-47ee-4828-a7e0-c3c45afe2e01\") " pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.568390 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.568369    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lp92\" (UniqueName: \"kubernetes.io/projected/39e2442f-4119-4111-91ee-3deb60db2897-kube-api-access-5lp92\") pod \"ovnkube-node-fdflt\" (UID: \"39e2442f-4119-4111-91ee-3deb60db2897\") " pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.617412 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.617358    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-10 17:15:25 +0000 UTC" deadline="2028-03-23 14:09:35.618864249 +0000 UTC"
Sep 11 17:20:26.617412 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.617413    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13412h49m9.001453864s"
Sep 11 17:20:26.662567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662514    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-kubernetes\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.662567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662545    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-socket-dir-parent\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.662567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-conf-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdc9r\" (UniqueName: \"kubernetes.io/projected/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-kube-api-access-zdc9r\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662589    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysctl-conf\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-socket-dir-parent\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662650    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-conf-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p46gl\" (UniqueName: \"kubernetes.io/projected/fbd44662-b63a-40ac-b75f-2efcdef8b90c-kube-api-access-p46gl\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662697    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-kubernetes\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662724    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c18b7034-c197-4dd5-aa98-85db5ff80828-dbus\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:26.662787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662783    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-host\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662806    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662827    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c18b7034-c197-4dd5-aa98-85db5ff80828-dbus\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662833    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-cni-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662850    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-host\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662828    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysctl-conf\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662884    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-multus-certs\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662900    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-cni-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662907    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysctl-d\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.662911    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662924    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd44662-b63a-40ac-b75f-2efcdef8b90c-tmp\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.662953    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-multus-certs\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.663020    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret podName:c18b7034-c197-4dd5-aa98-85db5ff80828 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:27.162979592 +0000 UTC m=+2.117669490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret") pod "global-pull-secret-syncer-xxpwt" (UID: "c18b7034-c197-4dd5-aa98-85db5ff80828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663059    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysctl-d\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663068    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663113    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-host-slash\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-tuned\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.663256 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.663141    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663173    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-host-slash\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.663191    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs podName:d60920d5-6202-4ebf-99cd-f5bddf867f35 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:27.163173104 +0000 UTC m=+2.117862987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs") pod "network-metrics-daemon-gvrhz" (UID: "d60920d5-6202-4ebf-99cd-f5bddf867f35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663211    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-cni-multus\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663238    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-cnibin\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663261    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c879f\" (UniqueName: \"kubernetes.io/projected/26e9c773-0ea1-4f93-98b4-1357abe71e58-kube-api-access-c879f\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663284    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-lib-modules\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663293    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-cnibin\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663307    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-cni-multus\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663312    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkjgv\" (UniqueName: \"kubernetes.io/projected/d60920d5-6202-4ebf-99cd-f5bddf867f35-kube-api-access-mkjgv\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663350    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-daemon-config\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663373    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-var-lib-kubelet\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663412    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-system-cni-dir\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663436    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663442    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-lib-modules\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663458    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.664118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663497    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysconfig\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663525    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-systemd\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663552    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-cnibin\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8160bb7-c5a4-450d-bc41-a9e43eab4147-hosts-file\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-modprobe-d\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663604    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663623    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c18b7034-c197-4dd5-aa98-85db5ff80828-kubelet-config\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663649    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-run\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663665    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-cnibin\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663672    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-etc-kubernetes\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663703    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6abced10-d6ff-4cce-9779-3160eff4bb59-cni-binary-copy\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663710    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-sysconfig\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663727    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-netns\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663752    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2b5d\" (UniqueName: \"kubernetes.io/projected/6abced10-d6ff-4cce-9779-3160eff4bb59-kube-api-access-f2b5d\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663982    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-var-lib-kubelet\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663987    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvrvd\" (UniqueName: \"kubernetes.io/projected/d8160bb7-c5a4-450d-bc41-a9e43eab4147-kube-api-access-qvrvd\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663815    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/d8160bb7-c5a4-450d-bc41-a9e43eab4147-hosts-file\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.664772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663869    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-modprobe-d\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663937    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664012    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/6abced10-d6ff-4cce-9779-3160eff4bb59-multus-daemon-config\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664022    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-system-cni-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663787    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c18b7034-c197-4dd5-aa98-85db5ff80828-kubelet-config\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663753    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-systemd\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.663576    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-system-cni-dir\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664039    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/26e9c773-0ea1-4f93-98b4-1357abe71e58-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664081    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-hostroot\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664136    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-run\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664184    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-etc-kubernetes\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664211    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-system-cni-dir\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664218    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/26e9c773-0ea1-4f93-98b4-1357abe71e58-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664230    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-hostroot\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664256    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-netns\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6abced10-d6ff-4cce-9779-3160eff4bb59-cni-binary-copy\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664317    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-kubelet\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664338    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-sys\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.665288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664368    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-kubelet\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664372    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8160bb7-c5a4-450d-bc41-a9e43eab4147-tmp-dir\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664391    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fbd44662-b63a-40ac-b75f-2efcdef8b90c-sys\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664423    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-k8s-cni-cncf-io\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664447    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-cni-bin\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664471    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-iptables-alerter-script\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664448    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-run-k8s-cni-cncf-io\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/6abced10-d6ff-4cce-9779-3160eff4bb59-host-var-lib-cni-bin\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.664599    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d8160bb7-c5a4-450d-bc41-a9e43eab4147-tmp-dir\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.665035    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-iptables-alerter-script\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.665603    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/fbd44662-b63a-40ac-b75f-2efcdef8b90c-etc-tuned\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.665788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.665664    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fbd44662-b63a-40ac-b75f-2efcdef8b90c-tmp\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.671762 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.671742    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdc9r\" (UniqueName: \"kubernetes.io/projected/6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a-kube-api-access-zdc9r\") pod \"iptables-alerter-vh8np\" (UID: \"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a\") " pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.671762 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.671757    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p46gl\" (UniqueName: \"kubernetes.io/projected/fbd44662-b63a-40ac-b75f-2efcdef8b90c-kube-api-access-p46gl\") pod \"tuned-sdhv7\" (UID: \"fbd44662-b63a-40ac-b75f-2efcdef8b90c\") " pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.671982 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.671965    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkjgv\" (UniqueName: \"kubernetes.io/projected/d60920d5-6202-4ebf-99cd-f5bddf867f35-kube-api-access-mkjgv\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:26.672826 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.672808    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:20:26.672826 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.672825    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:20:26.672959 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.672835    2584 projected.go:196] Error preparing data for projected volume kube-api-access-fbdgd for pod openshift-network-diagnostics/network-check-target-kqwjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:26.672959 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:26.672893    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd podName:bc0414c4-36bd-4a47-a49d-c7d455ad9d60 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:27.172881309 +0000 UTC m=+2.127571223 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fbdgd" (UniqueName: "kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd") pod "network-check-target-kqwjl" (UID: "bc0414c4-36bd-4a47-a49d-c7d455ad9d60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:26.674059 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.674041    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2b5d\" (UniqueName: \"kubernetes.io/projected/6abced10-d6ff-4cce-9779-3160eff4bb59-kube-api-access-f2b5d\") pod \"multus-t6x69\" (UID: \"6abced10-d6ff-4cce-9779-3160eff4bb59\") " pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.678185 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.678165    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvrvd\" (UniqueName: \"kubernetes.io/projected/d8160bb7-c5a4-450d-bc41-a9e43eab4147-kube-api-access-qvrvd\") pod \"node-resolver-rhwpb\" (UID: \"d8160bb7-c5a4-450d-bc41-a9e43eab4147\") " pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.678840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.678824    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c879f\" (UniqueName: \"kubernetes.io/projected/26e9c773-0ea1-4f93-98b4-1357abe71e58-kube-api-access-c879f\") pod \"multus-additional-cni-plugins-dsg54\" (UID: \"26e9c773-0ea1-4f93-98b4-1357abe71e58\") " pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.699033 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.699011    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8fd76400f9433d06743f51faa0c5dcb.slice/crio-e37c3acb900d1069352f833b116b02ad271b81ecc5bff492899622d8a74095ba WatchSource:0}: Error finding container e37c3acb900d1069352f833b116b02ad271b81ecc5bff492899622d8a74095ba: Status 404 returned error can't find the container with id e37c3acb900d1069352f833b116b02ad271b81ecc5bff492899622d8a74095ba
Sep 11 17:20:26.700502 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.700348    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd79124a262d4d1f4b0672083ba4d2cd.slice/crio-4809e031bab370e3a83d399e82d6e4dc6e04166a82f25011a44c37465f199d2e WatchSource:0}: Error finding container 4809e031bab370e3a83d399e82d6e4dc6e04166a82f25011a44c37465f199d2e: Status 404 returned error can't find the container with id 4809e031bab370e3a83d399e82d6e4dc6e04166a82f25011a44c37465f199d2e
Sep 11 17:20:26.704513 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.704498    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:20:26.787620 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.787596    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:26.796811 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.796790    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d2ee351_3a92_4965_9297_d51915b67a78.slice/crio-f979c2bce676383b42b0bccb3a7124c362a5307e59819425ac4aba7c255e885c WatchSource:0}: Error finding container f979c2bce676383b42b0bccb3a7124c362a5307e59819425ac4aba7c255e885c: Status 404 returned error can't find the container with id f979c2bce676383b42b0bccb3a7124c362a5307e59819425ac4aba7c255e885c
Sep 11 17:20:26.804316 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.804300    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8"
Sep 11 17:20:26.811451 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.811429    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d38fa0a_54d9_47fe_85ab_01730aaa2b41.slice/crio-a5fab1f80bb520672ba090044c9841636f160c837e5c82f0925807d3a5ff0729 WatchSource:0}: Error finding container a5fab1f80bb520672ba090044c9841636f160c837e5c82f0925807d3a5ff0729: Status 404 returned error can't find the container with id a5fab1f80bb520672ba090044c9841636f160c837e5c82f0925807d3a5ff0729
Sep 11 17:20:26.826172 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.826156    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-8dgdw"
Sep 11 17:20:26.828341 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.828328    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:26.834556 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.834530    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffdf1588_47ee_4828_a7e0_c3c45afe2e01.slice/crio-ce3d42ccbe22db561a6e93c8a977a47fe5e6220f7d52651479877cd8e3ac7892 WatchSource:0}: Error finding container ce3d42ccbe22db561a6e93c8a977a47fe5e6220f7d52651479877cd8e3ac7892: Status 404 returned error can't find the container with id ce3d42ccbe22db561a6e93c8a977a47fe5e6220f7d52651479877cd8e3ac7892
Sep 11 17:20:26.836570 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.836540    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39e2442f_4119_4111_91ee_3deb60db2897.slice/crio-06a87cad25578f7a5f317b6034758e9bf43760910dbffe341a2ba4cf32c9e3b8 WatchSource:0}: Error finding container 06a87cad25578f7a5f317b6034758e9bf43760910dbffe341a2ba4cf32c9e3b8: Status 404 returned error can't find the container with id 06a87cad25578f7a5f317b6034758e9bf43760910dbffe341a2ba4cf32c9e3b8
Sep 11 17:20:26.852426 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.852396    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-rhwpb"
Sep 11 17:20:26.860540 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.860520    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8160bb7_c5a4_450d_bc41_a9e43eab4147.slice/crio-7da2dfdd4da80c23be886b49ab0db1d4b579930287656908651d51a12213339b WatchSource:0}: Error finding container 7da2dfdd4da80c23be886b49ab0db1d4b579930287656908651d51a12213339b: Status 404 returned error can't find the container with id 7da2dfdd4da80c23be886b49ab0db1d4b579930287656908651d51a12213339b
Sep 11 17:20:26.875220 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.875203    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sdhv7"
Sep 11 17:20:26.883467 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.883448    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbd44662_b63a_40ac_b75f_2efcdef8b90c.slice/crio-618df142711f83624afc6b5e383cf5669c372ea9a281d1a5b6559c04c0c98621 WatchSource:0}: Error finding container 618df142711f83624afc6b5e383cf5669c372ea9a281d1a5b6559c04c0c98621: Status 404 returned error can't find the container with id 618df142711f83624afc6b5e383cf5669c372ea9a281d1a5b6559c04c0c98621
Sep 11 17:20:26.886363 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.886347    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dsg54"
Sep 11 17:20:26.894067 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.894049    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod26e9c773_0ea1_4f93_98b4_1357abe71e58.slice/crio-295a8e23c571e50b13dd7eaa0ab317a0b6504d067aa92002ab6048707abe61ef WatchSource:0}: Error finding container 295a8e23c571e50b13dd7eaa0ab317a0b6504d067aa92002ab6048707abe61ef: Status 404 returned error can't find the container with id 295a8e23c571e50b13dd7eaa0ab317a0b6504d067aa92002ab6048707abe61ef
Sep 11 17:20:26.903370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.903353    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vh8np"
Sep 11 17:20:26.907931 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:26.907913    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-t6x69"
Sep 11 17:20:26.913227 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.913170    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cc02b8a_0b43_40ce_8d08_3d4cbe90e67a.slice/crio-2bc7813ca9968e9cdb120e00635832a1b037477952187af31b8cf314e84a3175 WatchSource:0}: Error finding container 2bc7813ca9968e9cdb120e00635832a1b037477952187af31b8cf314e84a3175: Status 404 returned error can't find the container with id 2bc7813ca9968e9cdb120e00635832a1b037477952187af31b8cf314e84a3175
Sep 11 17:20:26.917303 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:26.917281    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6abced10_d6ff_4cce_9779_3160eff4bb59.slice/crio-92abfd659a854e96619fbbf49dded3495891662875b1d9b6947335a798a681f1 WatchSource:0}: Error finding container 92abfd659a854e96619fbbf49dded3495891662875b1d9b6947335a798a681f1: Status 404 returned error can't find the container with id 92abfd659a854e96619fbbf49dded3495891662875b1d9b6947335a798a681f1
Sep 11 17:20:27.006076 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.006055    2584 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:20:27.169002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.168916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:27.169002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.168949    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:27.169200 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:27.169083    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:27.169200 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:27.169143    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret podName:c18b7034-c197-4dd5-aa98-85db5ff80828 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:28.169129787 +0000 UTC m=+3.123819681 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret") pod "global-pull-secret-syncer-xxpwt" (UID: "c18b7034-c197-4dd5-aa98-85db5ff80828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:27.169200 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:27.169172    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:27.169332 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:27.169240    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs podName:d60920d5-6202-4ebf-99cd-f5bddf867f35 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:28.169218825 +0000 UTC m=+3.123908706 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs") pod "network-metrics-daemon-gvrhz" (UID: "d60920d5-6202-4ebf-99cd-f5bddf867f35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:27.269590 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.269312    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:27.269590 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:27.269494    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:20:27.269590 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:27.269514    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:20:27.269590 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:27.269527    2584 projected.go:196] Error preparing data for projected volume kube-api-access-fbdgd for pod openshift-network-diagnostics/network-check-target-kqwjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:27.269590 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:27.269587    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd podName:bc0414c4-36bd-4a47-a49d-c7d455ad9d60 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:28.269562354 +0000 UTC m=+3.224252240 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fbdgd" (UniqueName: "kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd") pod "network-check-target-kqwjl" (UID: "bc0414c4-36bd-4a47-a49d-c7d455ad9d60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:27.497643 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.497476    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 17:15:26 +0000 UTC" deadline="2028-02-19 22:40:33.289610864 +0000 UTC"
Sep 11 17:20:27.497643 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.497540    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12629h20m5.792074935s"
Sep 11 17:20:27.531890 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.531683    2584 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:20:27.728524 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.728433    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8dgdw" event={"ID":"ffdf1588-47ee-4828-a7e0-c3c45afe2e01","Type":"ContainerStarted","Data":"ce3d42ccbe22db561a6e93c8a977a47fe5e6220f7d52651479877cd8e3ac7892"}
Sep 11 17:20:27.745061 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.744952    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l4mw7" event={"ID":"9d2ee351-3a92-4965-9297-d51915b67a78","Type":"ContainerStarted","Data":"f979c2bce676383b42b0bccb3a7124c362a5307e59819425ac4aba7c255e885c"}
Sep 11 17:20:27.765748 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.765673    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal" event={"ID":"d8fd76400f9433d06743f51faa0c5dcb","Type":"ContainerStarted","Data":"e37c3acb900d1069352f833b116b02ad271b81ecc5bff492899622d8a74095ba"}
Sep 11 17:20:27.790217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.790155    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal" event={"ID":"cd79124a262d4d1f4b0672083ba4d2cd","Type":"ContainerStarted","Data":"4809e031bab370e3a83d399e82d6e4dc6e04166a82f25011a44c37465f199d2e"}
Sep 11 17:20:27.802050 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.802022    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6x69" event={"ID":"6abced10-d6ff-4cce-9779-3160eff4bb59","Type":"ContainerStarted","Data":"92abfd659a854e96619fbbf49dded3495891662875b1d9b6947335a798a681f1"}
Sep 11 17:20:27.820923 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.820890    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vh8np" event={"ID":"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a","Type":"ContainerStarted","Data":"2bc7813ca9968e9cdb120e00635832a1b037477952187af31b8cf314e84a3175"}
Sep 11 17:20:27.824389 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.824348    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rhwpb" event={"ID":"d8160bb7-c5a4-450d-bc41-a9e43eab4147","Type":"ContainerStarted","Data":"7da2dfdd4da80c23be886b49ab0db1d4b579930287656908651d51a12213339b"}
Sep 11 17:20:27.841427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.839668    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8" event={"ID":"4d38fa0a-54d9-47fe-85ab-01730aaa2b41","Type":"ContainerStarted","Data":"a5fab1f80bb520672ba090044c9841636f160c837e5c82f0925807d3a5ff0729"}
Sep 11 17:20:27.845756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.845725    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsg54" event={"ID":"26e9c773-0ea1-4f93-98b4-1357abe71e58","Type":"ContainerStarted","Data":"295a8e23c571e50b13dd7eaa0ab317a0b6504d067aa92002ab6048707abe61ef"}
Sep 11 17:20:27.856773 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.856713    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdhv7" event={"ID":"fbd44662-b63a-40ac-b75f-2efcdef8b90c","Type":"ContainerStarted","Data":"618df142711f83624afc6b5e383cf5669c372ea9a281d1a5b6559c04c0c98621"}
Sep 11 17:20:27.870106 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:27.870076    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"06a87cad25578f7a5f317b6034758e9bf43760910dbffe341a2ba4cf32c9e3b8"}
Sep 11 17:20:28.152544 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.152514    2584 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 11 17:20:28.177849 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.177815    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:28.178007 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.177867    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:28.178007 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.177985    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:28.178138 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.178042    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs podName:d60920d5-6202-4ebf-99cd-f5bddf867f35 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:30.178024709 +0000 UTC m=+5.132714594 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs") pod "network-metrics-daemon-gvrhz" (UID: "d60920d5-6202-4ebf-99cd-f5bddf867f35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:28.178485 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.178467    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:28.178575 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.178522    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret podName:c18b7034-c197-4dd5-aa98-85db5ff80828 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:30.178505969 +0000 UTC m=+5.133195856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret") pod "global-pull-secret-syncer-xxpwt" (UID: "c18b7034-c197-4dd5-aa98-85db5ff80828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:28.278951 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.278916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:28.279203 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.279184    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:20:28.279293 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.279210    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:20:28.279293 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.279224    2584 projected.go:196] Error preparing data for projected volume kube-api-access-fbdgd for pod openshift-network-diagnostics/network-check-target-kqwjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:28.279293 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.279282    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd podName:bc0414c4-36bd-4a47-a49d-c7d455ad9d60 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:30.279264652 +0000 UTC m=+5.233954544 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fbdgd" (UniqueName: "kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd") pod "network-check-target-kqwjl" (UID: "bc0414c4-36bd-4a47-a49d-c7d455ad9d60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:28.497960 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.497879    2584 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-10 17:15:26 +0000 UTC" deadline="2028-05-02 10:23:26.162419138 +0000 UTC"
Sep 11 17:20:28.497960 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.497917    2584 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14369h2m57.664506579s"
Sep 11 17:20:28.700111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.700079    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:28.700111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.700109    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:28.700350 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.700231    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:28.700350 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.700289    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:28.700623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:28.700354    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:28.700623 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:28.700453    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:30.195496 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:30.194871    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:30.195496 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:30.194905    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:30.195496 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.195026    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:30.195496 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.195074    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs podName:d60920d5-6202-4ebf-99cd-f5bddf867f35 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:34.195062151 +0000 UTC m=+9.149752043 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs") pod "network-metrics-daemon-gvrhz" (UID: "d60920d5-6202-4ebf-99cd-f5bddf867f35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:30.195496 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.195395    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:30.195496 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.195457    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret podName:c18b7034-c197-4dd5-aa98-85db5ff80828 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:34.195442901 +0000 UTC m=+9.150132799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret") pod "global-pull-secret-syncer-xxpwt" (UID: "c18b7034-c197-4dd5-aa98-85db5ff80828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:30.295980 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:30.295386    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:30.295980 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.295585    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:20:30.295980 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.295604    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:20:30.295980 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.295617    2584 projected.go:196] Error preparing data for projected volume kube-api-access-fbdgd for pod openshift-network-diagnostics/network-check-target-kqwjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:30.295980 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.295671    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd podName:bc0414c4-36bd-4a47-a49d-c7d455ad9d60 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:34.295654341 +0000 UTC m=+9.250344237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fbdgd" (UniqueName: "kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd") pod "network-check-target-kqwjl" (UID: "bc0414c4-36bd-4a47-a49d-c7d455ad9d60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:30.700078 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:30.700041    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:30.700269 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.700179    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:30.700594 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:30.700576    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:30.700711 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.700683    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:30.700762 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:30.700727    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:30.700818 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:30.700802    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:32.699124 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:32.699076    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:32.699669 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:32.699091    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:32.699669 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:32.699226    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:32.699669 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:32.699076    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:32.699669 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:32.699317    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:32.699669 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:32.699416    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:34.229574 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:34.229527    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:34.229574 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:34.229579    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:34.230164 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.229697    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:34.230164 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.229768    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs podName:d60920d5-6202-4ebf-99cd-f5bddf867f35 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:42.229748761 +0000 UTC m=+17.184438642 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs") pod "network-metrics-daemon-gvrhz" (UID: "d60920d5-6202-4ebf-99cd-f5bddf867f35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:34.230164 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.229697    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:34.230164 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.229834    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret podName:c18b7034-c197-4dd5-aa98-85db5ff80828 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:42.229820769 +0000 UTC m=+17.184510664 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret") pod "global-pull-secret-syncer-xxpwt" (UID: "c18b7034-c197-4dd5-aa98-85db5ff80828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:34.330142 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:34.330049    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:34.330311 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.330221    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:20:34.330311 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.330246    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:20:34.330311 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.330259    2584 projected.go:196] Error preparing data for projected volume kube-api-access-fbdgd for pod openshift-network-diagnostics/network-check-target-kqwjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:34.330504 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.330322    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd podName:bc0414c4-36bd-4a47-a49d-c7d455ad9d60 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:42.330301949 +0000 UTC m=+17.284991830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fbdgd" (UniqueName: "kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd") pod "network-check-target-kqwjl" (UID: "bc0414c4-36bd-4a47-a49d-c7d455ad9d60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:34.699898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:34.699863    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:34.699898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:34.699894    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:34.700149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:34.699905    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:34.700149 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.700007    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:34.700149 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.700107    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:34.700293 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:34.700197    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:36.699515 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:36.699482    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:36.699980 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:36.699606    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:36.699980 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:36.699687    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:36.699980 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:36.699793    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:36.699980 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:36.699847    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:36.699980 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:36.699912    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:38.699901 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:38.699864    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:38.699901 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:38.699890    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:38.700371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:38.699995    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:38.700371 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:38.700007    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:38.700371 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:38.700084    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:38.700371 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:38.700155    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:40.699869 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:40.699832    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:40.699869 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:40.699857    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:40.700462 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:40.699846    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:40.700462 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:40.699965    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:40.700462 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:40.700035    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:40.700462 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:40.700140    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:42.290758 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:42.290722    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:42.291253 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:42.290810    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:42.291253 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.290895    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:42.291253 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.290898    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:42.291253 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.290952    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret podName:c18b7034-c197-4dd5-aa98-85db5ff80828 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:58.290938222 +0000 UTC m=+33.245628103 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret") pod "global-pull-secret-syncer-xxpwt" (UID: "c18b7034-c197-4dd5-aa98-85db5ff80828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:42.291253 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.290969    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs podName:d60920d5-6202-4ebf-99cd-f5bddf867f35 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:58.290960403 +0000 UTC m=+33.245650283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs") pod "network-metrics-daemon-gvrhz" (UID: "d60920d5-6202-4ebf-99cd-f5bddf867f35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:42.391873 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:42.391834    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:42.392064 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.392031    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:20:42.392064 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.392068    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:20:42.392230 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.392083    2584 projected.go:196] Error preparing data for projected volume kube-api-access-fbdgd for pod openshift-network-diagnostics/network-check-target-kqwjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:42.392230 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.392148    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd podName:bc0414c4-36bd-4a47-a49d-c7d455ad9d60 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:58.392128919 +0000 UTC m=+33.346818819 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fbdgd" (UniqueName: "kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd") pod "network-check-target-kqwjl" (UID: "bc0414c4-36bd-4a47-a49d-c7d455ad9d60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:42.699867 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:42.699833    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:42.700044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:42.699833    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:42.700044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:42.699850    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:42.700178 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.700081    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:42.700178 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.699950    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:42.700178 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:42.700148    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:44.700148 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:44.700078    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:44.700148 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:44.700102    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:44.700658 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:44.700096    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:44.700658 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:44.700207    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:44.700658 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:44.700303    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:44.700658 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:44.700377    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:46.699981 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.699695    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:46.700681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.699738    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:46.700681 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:46.700045    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:46.700681 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:46.700142    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:46.700681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.699747    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:46.700681 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:46.700244    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:46.917688 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.917616    2584 generic.go:356] "Generic (PLEG): container finished" podID="26e9c773-0ea1-4f93-98b4-1357abe71e58" containerID="5f2d65237e4cb27c7a457d330742e609d8e13a9d80107df21635ec88b1ade188" exitCode=0
Sep 11 17:20:46.917835 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.917701    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsg54" event={"ID":"26e9c773-0ea1-4f93-98b4-1357abe71e58","Type":"ContainerDied","Data":"5f2d65237e4cb27c7a457d330742e609d8e13a9d80107df21635ec88b1ade188"}
Sep 11 17:20:46.919208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.919145    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sdhv7" event={"ID":"fbd44662-b63a-40ac-b75f-2efcdef8b90c","Type":"ContainerStarted","Data":"33d99732023535f2d27e908238b4ecfc7aecd75124173db31bac9f0126f38a5f"}
Sep 11 17:20:46.922188 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.922164    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:20:46.922545 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.922525    2584 generic.go:356] "Generic (PLEG): container finished" podID="39e2442f-4119-4111-91ee-3deb60db2897" containerID="3f91d48167e314b993cf0c0d786f88d7397f229db5595fef1cf936f45298f385" exitCode=1
Sep 11 17:20:46.922634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.922592    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"43c727c97d9cd6425e0827fa0335fa9e98e4c821257884455c27b8e934257c62"}
Sep 11 17:20:46.922682 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.922667    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"e57b09739e94103907ca992e60ff6def51882cd43fdf7bf7832b0838a6d0fb13"}
Sep 11 17:20:46.922739 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.922725    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"30d1beef575b14de1683cb7e7822645161c662b8b45ea53bec0efe89696a7afe"}
Sep 11 17:20:46.922790 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.922779    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"0b23b9a0a15877840ed70ed25e4a8f44dea5e7b3625e107a1aaa295c5c805e98"}
Sep 11 17:20:46.922840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.922826    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerDied","Data":"3f91d48167e314b993cf0c0d786f88d7397f229db5595fef1cf936f45298f385"}
Sep 11 17:20:46.922877 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.922870    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"9eb73c9dab89ef0e742dc7861e023ecc3f4e7cbba12e0d895a4af8b6c381a1fa"}
Sep 11 17:20:46.924095 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.924078    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-8dgdw" event={"ID":"ffdf1588-47ee-4828-a7e0-c3c45afe2e01","Type":"ContainerStarted","Data":"210eba23e9c13d7c379106519fc364167e80e566ef5c5db758bc76aa8ba812ce"}
Sep 11 17:20:46.925511 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.925489    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-l4mw7" event={"ID":"9d2ee351-3a92-4965-9297-d51915b67a78","Type":"ContainerStarted","Data":"cabd223c57016128d1fcc130a7185a6c3e61c91aaacc7965bc2ff9f44f2e3174"}
Sep 11 17:20:46.926781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.926757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal" event={"ID":"d8fd76400f9433d06743f51faa0c5dcb","Type":"ContainerStarted","Data":"5bdb986684d480a28a0bbbd9d2aa7d7a47f9bd413abbed7f407882ffea1966ad"}
Sep 11 17:20:46.927967 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.927949    2584 generic.go:356] "Generic (PLEG): container finished" podID="cd79124a262d4d1f4b0672083ba4d2cd" containerID="774d69feab761827bf83948baf6d8a2ed33e8835b0d23cb83edd4093b6ba5d2c" exitCode=0
Sep 11 17:20:46.928035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.928008    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal" event={"ID":"cd79124a262d4d1f4b0672083ba4d2cd","Type":"ContainerDied","Data":"774d69feab761827bf83948baf6d8a2ed33e8835b0d23cb83edd4093b6ba5d2c"}
Sep 11 17:20:46.929561 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.929537    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-t6x69" event={"ID":"6abced10-d6ff-4cce-9779-3160eff4bb59","Type":"ContainerStarted","Data":"a47085d62d8e7da674792c8f021d7ac534c2e10461f3ef9976a771b1b9eeb03e"}
Sep 11 17:20:46.931082 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.931061    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-rhwpb" event={"ID":"d8160bb7-c5a4-450d-bc41-a9e43eab4147","Type":"ContainerStarted","Data":"f59bab68e6287106f320cbf248c23f2ede89dad6f43736d3136eb2fb06b155af"}
Sep 11 17:20:46.932352 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.932336    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8" event={"ID":"4d38fa0a-54d9-47fe-85ab-01730aaa2b41","Type":"ContainerStarted","Data":"a9fcf0b81102611e8de25397b9cde51afea9b4fe1d8c64efaea2e5ac003ee049"}
Sep 11 17:20:46.956848 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.956811    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-t6x69" podStartSLOduration=2.039257066 podStartE2EDuration="20.956796172s" totalImagesPullingTime="18.917539106s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:46.956527485 +0000 UTC m=+21.911217388" watchObservedRunningTime="2026-09-11 17:20:46.956796172 +0000 UTC m=+21.911486074"
Sep 11 17:20:46.982765 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.982726    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-85.ec2.internal" podStartSLOduration=20.982711807 podStartE2EDuration="20.982711807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:46.969500569 +0000 UTC m=+21.924190471" watchObservedRunningTime="2026-09-11 17:20:46.982711807 +0000 UTC m=+21.937401729"
Sep 11 17:20:46.997458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:46.997414    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-l4mw7" podStartSLOduration=10.468764307 podStartE2EDuration="21.997377945s" totalImagesPullingTime="11.528613638s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:46.996837954 +0000 UTC m=+21.951527856" watchObservedRunningTime="2026-09-11 17:20:46.997377945 +0000 UTC m=+21.952067849"
Sep 11 17:20:47.034657 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.034614    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sdhv7" podStartSLOduration=3.119983113 podStartE2EDuration="22.034599291s" totalImagesPullingTime="18.914616178s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:47.03429999 +0000 UTC m=+21.988989892" watchObservedRunningTime="2026-09-11 17:20:47.034599291 +0000 UTC m=+21.989289189"
Sep 11 17:20:47.034793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.034732    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-rhwpb" podStartSLOduration=3.097517873 podStartE2EDuration="22.034723555s" totalImagesPullingTime="18.937205682s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:47.012647234 +0000 UTC m=+21.967337137" watchObservedRunningTime="2026-09-11 17:20:47.034723555 +0000 UTC m=+21.989413458"
Sep 11 17:20:47.323452 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.323421    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:47.324070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.324051    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:47.345741 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.345691    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-8dgdw" podStartSLOduration=3.400212678 podStartE2EDuration="22.345675235s" totalImagesPullingTime="18.945462557s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:47.057712266 +0000 UTC m=+22.012402164" watchObservedRunningTime="2026-09-11 17:20:47.345675235 +0000 UTC m=+22.300365135"
Sep 11 17:20:47.923465 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.923229    2584 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 11 17:20:47.936509 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.936476    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal" event={"ID":"cd79124a262d4d1f4b0672083ba4d2cd","Type":"ContainerStarted","Data":"e91d7d9a912832852e7d3878964fe33f82160cf52b1d3ac5854493417634bb6f"}
Sep 11 17:20:47.938257 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.938233    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vh8np" event={"ID":"6cc02b8a-0b43-40ce-8d08-3d4cbe90e67a","Type":"ContainerStarted","Data":"831a49c081842c58de6cbc74be02269e8ba90d1f291c3e50d9b28cda7700756c"}
Sep 11 17:20:47.940455 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.940431    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8" event={"ID":"4d38fa0a-54d9-47fe-85ab-01730aaa2b41","Type":"ContainerStarted","Data":"97402bd97822b790701be2dc028c5ba0813d26d3f6e92f59f2a4c9e39ff27fa5"}
Sep 11 17:20:47.941473 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.941377    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:47.941759 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.941743    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-l4mw7"
Sep 11 17:20:47.951667 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.951621    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-85.ec2.internal" podStartSLOduration=21.951603664 podStartE2EDuration="21.951603664s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:47.951502761 +0000 UTC m=+22.906192663" watchObservedRunningTime="2026-09-11 17:20:47.951603664 +0000 UTC m=+22.906293567"
Sep 11 17:20:47.965149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:47.965103    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vh8np" podStartSLOduration=3.080637444 podStartE2EDuration="21.96508434s" totalImagesPullingTime="18.884446896s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:47.96451776 +0000 UTC m=+22.919207663" watchObservedRunningTime="2026-09-11 17:20:47.96508434 +0000 UTC m=+22.919774243"
Sep 11 17:20:48.656935 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:48.656811    2584 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-11T17:20:47.923459776Z","UUID":"a30d385b-fe88-4d95-b4e5-939a8df366ba","Handler":null,"Name":"","Endpoint":""}
Sep 11 17:20:48.658656 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:48.658629    2584 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 11 17:20:48.658805 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:48.658671    2584 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 11 17:20:48.699489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:48.699454    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:48.699703 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:48.699607    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:48.699703 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:48.699627    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:48.699842 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:48.699712    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:48.700140 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:48.700116    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:48.700246 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:48.700228    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:48.948384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:48.948276    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:20:48.949044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:48.948939    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"31d31d1a1f94520b29a85bc9231530587e83a398ee8efb94800c5c56ac14f772"}
Sep 11 17:20:49.953103 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:49.953063    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8" event={"ID":"4d38fa0a-54d9-47fe-85ab-01730aaa2b41","Type":"ContainerStarted","Data":"eeb729dcb0fd72ce461331ed7de377bfbc124a7053762d9891ea87111b1fd5a3"}
Sep 11 17:20:50.700072 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:50.700033    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:50.700252 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:50.700045    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:50.700252 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:50.700153    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:50.700252 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:50.700153    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:50.700418 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:50.700253    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:50.700418 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:50.700319    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:52.700093 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.699907    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:52.700551 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.699938    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:52.700551 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:52.700192    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:52.700551 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.699965    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:52.700551 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:52.700231    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:52.700551 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:52.700301    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:52.963196 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.963104    2584 generic.go:356] "Generic (PLEG): container finished" podID="26e9c773-0ea1-4f93-98b4-1357abe71e58" containerID="3a09f1d014c6db83c6a38bd89c7c225de88a0ce211e81987ba86a3023aa9047a" exitCode=0
Sep 11 17:20:52.963349 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.963188    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsg54" event={"ID":"26e9c773-0ea1-4f93-98b4-1357abe71e58","Type":"ContainerDied","Data":"3a09f1d014c6db83c6a38bd89c7c225de88a0ce211e81987ba86a3023aa9047a"}
Sep 11 17:20:52.966998 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.966980    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:20:52.970644 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.967776    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"bfad8a2ae17a8de12ac6fd6fae190bb5c610ed424a04c48eb58f8f1b4c63a1ca"}
Sep 11 17:20:52.970644 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.968362    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:52.970644 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.968529    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:52.970644 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.968568    2584 scope.go:117] "RemoveContainer" containerID="3f91d48167e314b993cf0c0d786f88d7397f229db5595fef1cf936f45298f385"
Sep 11 17:20:52.970644 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.968601    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:52.986742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.986692    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-bs8s8" podStartSLOduration=6.356256079 podStartE2EDuration="27.986672942s" totalImagesPullingTime="21.630416863s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:25 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:49.97417953 +0000 UTC m=+24.928869432" watchObservedRunningTime="2026-09-11 17:20:52.986672942 +0000 UTC m=+27.941362836"
Sep 11 17:20:52.987961 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.987919    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:52.988069 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:52.988055    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:20:53.837530 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:53.837491    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxpwt"]
Sep 11 17:20:53.838075 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:53.837624    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:53.838075 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:53.837738    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:53.841187 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:53.841159    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gvrhz"]
Sep 11 17:20:53.841320 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:53.841286    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:53.841505 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:53.841394    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:53.841913 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:53.841886    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kqwjl"]
Sep 11 17:20:53.842008 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:53.841989    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:53.842104 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:53.842083    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:53.974087 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:53.974060    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:20:53.974438 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:53.974396    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" event={"ID":"39e2442f-4119-4111-91ee-3deb60db2897","Type":"ContainerStarted","Data":"415377b8b01c9dc3e2089c7a32ea8db41b254c7d1d37b6682c40b24c07734aca"}
Sep 11 17:20:54.001171 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:54.001044    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt" podStartSLOduration=9.7919633 podStartE2EDuration="29.001023891s" totalImagesPullingTime="19.209060591s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:20:54.000714864 +0000 UTC m=+28.955404789" watchObservedRunningTime="2026-09-11 17:20:54.001023891 +0000 UTC m=+28.955713819"
Sep 11 17:20:54.980039 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:54.980006    2584 generic.go:356] "Generic (PLEG): container finished" podID="26e9c773-0ea1-4f93-98b4-1357abe71e58" containerID="97e9f70dcc78fb2cd4cd0f239cc8a98bc1af94c5b04574e7f707a0f3e5e0251b" exitCode=0
Sep 11 17:20:54.980688 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:54.980088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsg54" event={"ID":"26e9c773-0ea1-4f93-98b4-1357abe71e58","Type":"ContainerDied","Data":"97e9f70dcc78fb2cd4cd0f239cc8a98bc1af94c5b04574e7f707a0f3e5e0251b"}
Sep 11 17:20:55.701966 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:55.701797    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:55.702102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:55.701799    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:55.702102 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:55.702029    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:55.702102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:55.701828    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:55.702102 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:55.702096    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:55.702253 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:55.702160    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:56.987967 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:56.987936    2584 generic.go:356] "Generic (PLEG): container finished" podID="26e9c773-0ea1-4f93-98b4-1357abe71e58" containerID="534db14111752468ab079c514cd97120b8020fd0da9c1856890c53a80e3c61f0" exitCode=0
Sep 11 17:20:56.988318 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:56.987999    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsg54" event={"ID":"26e9c773-0ea1-4f93-98b4-1357abe71e58","Type":"ContainerDied","Data":"534db14111752468ab079c514cd97120b8020fd0da9c1856890c53a80e3c61f0"}
Sep 11 17:20:57.699542 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:57.699506    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:57.699731 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:57.699511    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:57.699731 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:57.699511    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:57.699731 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:57.699646    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xxpwt" podUID="c18b7034-c197-4dd5-aa98-85db5ff80828"
Sep 11 17:20:57.699888 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:57.699782    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gvrhz" podUID="d60920d5-6202-4ebf-99cd-f5bddf867f35"
Sep 11 17:20:57.699888 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:57.699862    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-kqwjl" podUID="bc0414c4-36bd-4a47-a49d-c7d455ad9d60"
Sep 11 17:20:58.308209 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.308169    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:58.308209 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.308211    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:58.308710 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:58.308316    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:58.308710 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:58.308327    2584 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:58.308710 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:58.308367    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs podName:d60920d5-6202-4ebf-99cd-f5bddf867f35 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:30.308354041 +0000 UTC m=+65.263043934 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs") pod "network-metrics-daemon-gvrhz" (UID: "d60920d5-6202-4ebf-99cd-f5bddf867f35") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 11 17:20:58.308710 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:58.308392    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret podName:c18b7034-c197-4dd5-aa98-85db5ff80828 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:30.308372848 +0000 UTC m=+65.263062742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret") pod "global-pull-secret-syncer-xxpwt" (UID: "c18b7034-c197-4dd5-aa98-85db5ff80828") : object "kube-system"/"original-pull-secret" not registered
Sep 11 17:20:58.409228 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.409192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:58.409393 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:58.409337    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 11 17:20:58.409393 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:58.409357    2584 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 11 17:20:58.409393 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:58.409368    2584 projected.go:196] Error preparing data for projected volume kube-api-access-fbdgd for pod openshift-network-diagnostics/network-check-target-kqwjl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:58.409567 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:58.409453    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd podName:bc0414c4-36bd-4a47-a49d-c7d455ad9d60 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:30.409433472 +0000 UTC m=+65.364123359 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fbdgd" (UniqueName: "kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd") pod "network-check-target-kqwjl" (UID: "bc0414c4-36bd-4a47-a49d-c7d455ad9d60") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 11 17:20:58.887155 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.887118    2584 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-85.ec2.internal" event="NodeReady"
Sep 11 17:20:58.887345 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.887263    2584 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 11 17:20:58.921654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.921614    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"]
Sep 11 17:20:58.935456 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.935423    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"]
Sep 11 17:20:58.935623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.935480    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:58.938907 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.938879    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xdswl"]
Sep 11 17:20:58.939264 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.939238    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 11 17:20:58.939653 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.939621    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 11 17:20:58.939931 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.939914    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nbpzt\""
Sep 11 17:20:58.940112 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.940095    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 11 17:20:58.944436 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.944414    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 11 17:20:58.956513 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.956487    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-wtwfn"]
Sep 11 17:20:58.956653 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.956606    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:58.959165 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.959133    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 11 17:20:58.959283 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.959222    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n6xk4\""
Sep 11 17:20:58.959283 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.959138    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 11 17:20:58.970159 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.970134    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wtwfn"]
Sep 11 17:20:58.970159 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.970171    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xdswl"]
Sep 11 17:20:58.970371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.970240    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wtwfn"
Sep 11 17:20:58.972639 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.972591    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 11 17:20:58.972754 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.972649    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 11 17:20:58.972813 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.972775    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-k28ks\""
Sep 11 17:20:58.973014 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:58.973002    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 11 17:20:59.014598 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.014568    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.014757 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.014610    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-bound-sa-token\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.014757 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.014639    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hspd5\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-kube-api-access-hspd5\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.014757 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.014658    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-trusted-ca\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.014757 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.014700    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-registry-certificates\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.014757 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.014718    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-image-registry-private-configuration\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.014917 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.014780    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/280095e9-ef82-46f3-b84e-40488da613bb-ca-trust-extracted\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.014917 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.014796    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-installation-pull-secrets\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.115632 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.115597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/280095e9-ef82-46f3-b84e-40488da613bb-ca-trust-extracted\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.115632 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.115633    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-installation-pull-secrets\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.115859 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.115654    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.115895 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.115871    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:20:59.115895 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.115885    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdcb8ffc7-7slbb: secret "image-registry-tls" not found
Sep 11 17:20:59.115970 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.115931    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prsjl\" (UniqueName: \"kubernetes.io/projected/b072962d-d307-4d17-8b94-89ff1b2f0ec7-kube-api-access-prsjl\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.115970 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.115945    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls podName:280095e9-ef82-46f3-b84e-40488da613bb nodeName:}" failed. No retries permitted until 2026-09-11 17:20:59.61592716 +0000 UTC m=+34.570617062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls") pod "image-registry-6bdcb8ffc7-7slbb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb") : secret "image-registry-tls" not found
Sep 11 17:20:59.116048 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.115969    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/280095e9-ef82-46f3-b84e-40488da613bb-ca-trust-extracted\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.116048 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.115972    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-bound-sa-token\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.116048 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116013    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b072962d-d307-4d17-8b94-89ff1b2f0ec7-tmp-dir\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.116048 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116037    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c3980f-2355-4a62-8c25-07d8f7cd520b-cert\") pod \"ingress-canary-wtwfn\" (UID: \"49c3980f-2355-4a62-8c25-07d8f7cd520b\") " pod="openshift-ingress-canary/ingress-canary-wtwfn"
Sep 11 17:20:59.116234 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116068    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hspd5\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-kube-api-access-hspd5\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.116234 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116099    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-trusted-ca\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.116234 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116114    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvn5q\" (UniqueName: \"kubernetes.io/projected/49c3980f-2355-4a62-8c25-07d8f7cd520b-kube-api-access-vvn5q\") pod \"ingress-canary-wtwfn\" (UID: \"49c3980f-2355-4a62-8c25-07d8f7cd520b\") " pod="openshift-ingress-canary/ingress-canary-wtwfn"
Sep 11 17:20:59.116234 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116131    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b072962d-d307-4d17-8b94-89ff1b2f0ec7-config-volume\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.116234 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116155    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.116234 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116203    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-registry-certificates\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.116548 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-image-registry-private-configuration\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.116815 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.116787    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-registry-certificates\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.117040 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.117023    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-trusted-ca\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.119615 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.119595    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-installation-pull-secrets\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.119615 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.119612    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-image-registry-private-configuration\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.124579 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.124556    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-bound-sa-token\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.124731 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.124714    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hspd5\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-kube-api-access-hspd5\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.216873 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.216790    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c3980f-2355-4a62-8c25-07d8f7cd520b-cert\") pod \"ingress-canary-wtwfn\" (UID: \"49c3980f-2355-4a62-8c25-07d8f7cd520b\") " pod="openshift-ingress-canary/ingress-canary-wtwfn"
Sep 11 17:20:59.216873 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.216837    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvn5q\" (UniqueName: \"kubernetes.io/projected/49c3980f-2355-4a62-8c25-07d8f7cd520b-kube-api-access-vvn5q\") pod \"ingress-canary-wtwfn\" (UID: \"49c3980f-2355-4a62-8c25-07d8f7cd520b\") " pod="openshift-ingress-canary/ingress-canary-wtwfn"
Sep 11 17:20:59.216873 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.216856    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b072962d-d307-4d17-8b94-89ff1b2f0ec7-config-volume\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.216873 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.216873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.217186 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.216964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prsjl\" (UniqueName: \"kubernetes.io/projected/b072962d-d307-4d17-8b94-89ff1b2f0ec7-kube-api-access-prsjl\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.217186 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.216993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b072962d-d307-4d17-8b94-89ff1b2f0ec7-tmp-dir\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.217186 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.217041    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:20:59.217186 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.217135    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls podName:b072962d-d307-4d17-8b94-89ff1b2f0ec7 nodeName:}" failed. No retries permitted until 2026-09-11 17:20:59.717111436 +0000 UTC m=+34.671801334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls") pod "dns-default-xdswl" (UID: "b072962d-d307-4d17-8b94-89ff1b2f0ec7") : secret "dns-default-metrics-tls" not found
Sep 11 17:20:59.217336 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.217285    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b072962d-d307-4d17-8b94-89ff1b2f0ec7-tmp-dir\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.217493 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.217475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b072962d-d307-4d17-8b94-89ff1b2f0ec7-config-volume\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.219258 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.219240    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/49c3980f-2355-4a62-8c25-07d8f7cd520b-cert\") pod \"ingress-canary-wtwfn\" (UID: \"49c3980f-2355-4a62-8c25-07d8f7cd520b\") " pod="openshift-ingress-canary/ingress-canary-wtwfn"
Sep 11 17:20:59.225386 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.225361    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prsjl\" (UniqueName: \"kubernetes.io/projected/b072962d-d307-4d17-8b94-89ff1b2f0ec7-kube-api-access-prsjl\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.225614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.225597    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvn5q\" (UniqueName: \"kubernetes.io/projected/49c3980f-2355-4a62-8c25-07d8f7cd520b-kube-api-access-vvn5q\") pod \"ingress-canary-wtwfn\" (UID: \"49c3980f-2355-4a62-8c25-07d8f7cd520b\") " pod="openshift-ingress-canary/ingress-canary-wtwfn"
Sep 11 17:20:59.278394 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.278361    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-wtwfn"
Sep 11 17:20:59.583703 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.583631    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-wtwfn"]
Sep 11 17:20:59.588224 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:20:59.588192    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49c3980f_2355_4a62_8c25_07d8f7cd520b.slice/crio-ba8566834090a301211dcba37a6c0b5d1e46fcb12d7ba4a487202140dd2bb592 WatchSource:0}: Error finding container ba8566834090a301211dcba37a6c0b5d1e46fcb12d7ba4a487202140dd2bb592: Status 404 returned error can't find the container with id ba8566834090a301211dcba37a6c0b5d1e46fcb12d7ba4a487202140dd2bb592
Sep 11 17:20:59.620193 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.620000    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:20:59.620340 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.620141    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:20:59.620340 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.620269    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdcb8ffc7-7slbb: secret "image-registry-tls" not found
Sep 11 17:20:59.620340 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.620336    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls podName:280095e9-ef82-46f3-b84e-40488da613bb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:00.620321112 +0000 UTC m=+35.575010996 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls") pod "image-registry-6bdcb8ffc7-7slbb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb") : secret "image-registry-tls" not found
Sep 11 17:20:59.700039 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.699997    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:20:59.700039 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.700037    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:20:59.700267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.699999    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:20:59.702853 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.702827    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 17:20:59.702853 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.702828    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 17:20:59.703052 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.702828    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f9zbq\""
Sep 11 17:20:59.703052 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.702881    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-47wvr\""
Sep 11 17:20:59.703052 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.702828    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 17:20:59.703052 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.702828    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 17:20:59.724176 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.724151    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:20:59.724332 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.724315    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:20:59.724433 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:20:59.724420    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls podName:b072962d-d307-4d17-8b94-89ff1b2f0ec7 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:00.724379464 +0000 UTC m=+35.679069356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls") pod "dns-default-xdswl" (UID: "b072962d-d307-4d17-8b94-89ff1b2f0ec7") : secret "dns-default-metrics-tls" not found
Sep 11 17:20:59.996550 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:20:59.996498    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wtwfn" event={"ID":"49c3980f-2355-4a62-8c25-07d8f7cd520b","Type":"ContainerStarted","Data":"ba8566834090a301211dcba37a6c0b5d1e46fcb12d7ba4a487202140dd2bb592"}
Sep 11 17:21:00.632186 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:00.632150    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:21:00.632674 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:00.632294    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:21:00.632674 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:00.632313    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdcb8ffc7-7slbb: secret "image-registry-tls" not found
Sep 11 17:21:00.632674 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:00.632384    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls podName:280095e9-ef82-46f3-b84e-40488da613bb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:02.632365629 +0000 UTC m=+37.587055512 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls") pod "image-registry-6bdcb8ffc7-7slbb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb") : secret "image-registry-tls" not found
Sep 11 17:21:00.732548 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:00.732495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:21:00.732720 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:00.732681    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:21:00.732778 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:00.732760    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls podName:b072962d-d307-4d17-8b94-89ff1b2f0ec7 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:02.732744548 +0000 UTC m=+37.687434433 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls") pod "dns-default-xdswl" (UID: "b072962d-d307-4d17-8b94-89ff1b2f0ec7") : secret "dns-default-metrics-tls" not found
Sep 11 17:21:02.649018 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:02.648985    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:21:02.649525 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:02.649161    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:21:02.649525 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:02.649186    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdcb8ffc7-7slbb: secret "image-registry-tls" not found
Sep 11 17:21:02.649525 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:02.649261    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls podName:280095e9-ef82-46f3-b84e-40488da613bb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:06.649239516 +0000 UTC m=+41.603929396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls") pod "image-registry-6bdcb8ffc7-7slbb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb") : secret "image-registry-tls" not found
Sep 11 17:21:02.749683 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:02.749642    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:21:02.749868 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:02.749773    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:21:02.749868 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:02.749840    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls podName:b072962d-d307-4d17-8b94-89ff1b2f0ec7 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:06.74982012 +0000 UTC m=+41.704510019 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls") pod "dns-default-xdswl" (UID: "b072962d-d307-4d17-8b94-89ff1b2f0ec7") : secret "dns-default-metrics-tls" not found
Sep 11 17:21:05.014552 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:05.014457    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-wtwfn" event={"ID":"49c3980f-2355-4a62-8c25-07d8f7cd520b","Type":"ContainerStarted","Data":"414bfc5acb89da0d80d65ca974040acccd9c1f085e2da5ec8922505b2c9e3f09"}
Sep 11 17:21:05.018464 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:05.018434    2584 generic.go:356] "Generic (PLEG): container finished" podID="26e9c773-0ea1-4f93-98b4-1357abe71e58" containerID="61e6aababe2d2b4fee64f53e5d50aff626b1b8ee32fdb469299b191275aaaa43" exitCode=0
Sep 11 17:21:05.018614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:05.018497    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsg54" event={"ID":"26e9c773-0ea1-4f93-98b4-1357abe71e58","Type":"ContainerDied","Data":"61e6aababe2d2b4fee64f53e5d50aff626b1b8ee32fdb469299b191275aaaa43"}
Sep 11 17:21:05.032008 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:05.031962    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-wtwfn" podStartSLOduration=2.541332625 podStartE2EDuration="7.031948001s" totalImagesPullingTime="4.490615376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:21:05.031259623 +0000 UTC m=+39.985949527" watchObservedRunningTime="2026-09-11 17:21:05.031948001 +0000 UTC m=+39.986637903"
Sep 11 17:21:06.023952 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:06.023919    2584 generic.go:356] "Generic (PLEG): container finished" podID="26e9c773-0ea1-4f93-98b4-1357abe71e58" containerID="ae49d5be423877a8bae6059778efdfc8d2e0c49ba62ad107b88de5c3f1e46565" exitCode=0
Sep 11 17:21:06.024341 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:06.023999    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsg54" event={"ID":"26e9c773-0ea1-4f93-98b4-1357abe71e58","Type":"ContainerDied","Data":"ae49d5be423877a8bae6059778efdfc8d2e0c49ba62ad107b88de5c3f1e46565"}
Sep 11 17:21:06.678471 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:06.678424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:21:06.678663 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:06.678572    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:21:06.678663 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:06.678595    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdcb8ffc7-7slbb: secret "image-registry-tls" not found
Sep 11 17:21:06.678663 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:06.678651    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls podName:280095e9-ef82-46f3-b84e-40488da613bb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:14.678635254 +0000 UTC m=+49.633325150 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls") pod "image-registry-6bdcb8ffc7-7slbb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb") : secret "image-registry-tls" not found
Sep 11 17:21:06.779065 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:06.779018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:21:06.779224 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:06.779136    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:21:06.779224 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:06.779189    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls podName:b072962d-d307-4d17-8b94-89ff1b2f0ec7 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:14.779176045 +0000 UTC m=+49.733865929 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls") pod "dns-default-xdswl" (UID: "b072962d-d307-4d17-8b94-89ff1b2f0ec7") : secret "dns-default-metrics-tls" not found
Sep 11 17:21:07.029877 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:07.029784    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsg54" event={"ID":"26e9c773-0ea1-4f93-98b4-1357abe71e58","Type":"ContainerStarted","Data":"29982d9c448cea4a402119d8d69e93461f56a1fb468c6f8ababda24c073e7d21"}
Sep 11 17:21:07.052201 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:07.052150    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dsg54" podStartSLOduration=7.489440534 podStartE2EDuration="41.052132265s" totalImagesPullingTime="33.562691731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:26 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:21:07.051720667 +0000 UTC m=+42.006410579" watchObservedRunningTime="2026-09-11 17:21:07.052132265 +0000 UTC m=+42.006822166"
Sep 11 17:21:14.737218 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:14.737180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:21:14.737640 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:14.737332    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:21:14.737640 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:14.737351    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdcb8ffc7-7slbb: secret "image-registry-tls" not found
Sep 11 17:21:14.737640 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:14.737428    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls podName:280095e9-ef82-46f3-b84e-40488da613bb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:30.73739174 +0000 UTC m=+65.692081620 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls") pod "image-registry-6bdcb8ffc7-7slbb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb") : secret "image-registry-tls" not found
Sep 11 17:21:14.838099 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:14.838052    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:21:14.838249 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:14.838188    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:21:14.838328 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:14.838257    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls podName:b072962d-d307-4d17-8b94-89ff1b2f0ec7 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:30.838238357 +0000 UTC m=+65.792928238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls") pod "dns-default-xdswl" (UID: "b072962d-d307-4d17-8b94-89ff1b2f0ec7") : secret "dns-default-metrics-tls" not found
Sep 11 17:21:24.990598 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:24.990568    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fdflt"
Sep 11 17:21:27.779263 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.779224    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"]
Sep 11 17:21:27.782271 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.782248    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:27.784618 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.784595    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Sep 11 17:21:27.785476 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.785456    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-nv6hz\""
Sep 11 17:21:27.785750 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.785734    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Sep 11 17:21:27.786254 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.786234    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:21:27.796321 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.796296    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"]
Sep 11 17:21:27.876961 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.876927    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw"]
Sep 11 17:21:27.878817 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.878796    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw"
Sep 11 17:21:27.881427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.881382    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cvkrv\""
Sep 11 17:21:27.891981 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.891949    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw"]
Sep 11 17:21:27.934266 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.934228    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:27.934489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:27.934280    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b7qqx\" (UniqueName: \"kubernetes.io/projected/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-kube-api-access-b7qqx\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:28.035722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.035617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xv26l\" (UniqueName: \"kubernetes.io/projected/81d77485-5283-45d2-8693-149c0c875c32-kube-api-access-xv26l\") pod \"network-check-source-6f8b768455-lc6tw\" (UID: \"81d77485-5283-45d2-8693-149c0c875c32\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw"
Sep 11 17:21:28.035722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.035687    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:28.035722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.035734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b7qqx\" (UniqueName: \"kubernetes.io/projected/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-kube-api-access-b7qqx\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:28.035933 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:28.035857    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:21:28.035933 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:28.035922    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls podName:3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:28.535903963 +0000 UTC m=+63.490593858 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t6qvv" (UID: "3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb") : secret "samples-operator-tls" not found
Sep 11 17:21:28.045924 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.045897    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b7qqx\" (UniqueName: \"kubernetes.io/projected/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-kube-api-access-b7qqx\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:28.136947 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.136913    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xv26l\" (UniqueName: \"kubernetes.io/projected/81d77485-5283-45d2-8693-149c0c875c32-kube-api-access-xv26l\") pod \"network-check-source-6f8b768455-lc6tw\" (UID: \"81d77485-5283-45d2-8693-149c0c875c32\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw"
Sep 11 17:21:28.146301 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.146273    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 11 17:21:28.156648 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.156627    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 11 17:21:28.166907 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.166877    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xv26l\" (UniqueName: \"kubernetes.io/projected/81d77485-5283-45d2-8693-149c0c875c32-kube-api-access-xv26l\") pod \"network-check-source-6f8b768455-lc6tw\" (UID: \"81d77485-5283-45d2-8693-149c0c875c32\") " pod="openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw"
Sep 11 17:21:28.186793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.186759    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw"
Sep 11 17:21:28.455900 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.455755    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw"]
Sep 11 17:21:28.458375 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:21:28.458348    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81d77485_5283_45d2_8693_149c0c875c32.slice/crio-c6aff9d3390b00544bde722422aac206d3c5ab5946db7019c36c6b573342c4c6 WatchSource:0}: Error finding container c6aff9d3390b00544bde722422aac206d3c5ab5946db7019c36c6b573342c4c6: Status 404 returned error can't find the container with id c6aff9d3390b00544bde722422aac206d3c5ab5946db7019c36c6b573342c4c6
Sep 11 17:21:28.540577 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:28.540516    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:28.540751 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:28.540674    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:21:28.540751 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:28.540742    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls podName:3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:29.540727587 +0000 UTC m=+64.495417480 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t6qvv" (UID: "3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb") : secret "samples-operator-tls" not found
Sep 11 17:21:29.083656 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:29.083620    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw" event={"ID":"81d77485-5283-45d2-8693-149c0c875c32","Type":"ContainerStarted","Data":"c6aff9d3390b00544bde722422aac206d3c5ab5946db7019c36c6b573342c4c6"}
Sep 11 17:21:29.548333 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:29.548293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:29.548526 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:29.548449    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:21:29.548526 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:29.548515    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls podName:3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:31.548498659 +0000 UTC m=+66.503188555 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t6qvv" (UID: "3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb") : secret "samples-operator-tls" not found
Sep 11 17:21:30.355255 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.355217    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:21:30.355625 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.355264    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:21:30.358506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.358487    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 11 17:21:30.358574 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.358558    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 11 17:21:30.365579 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:30.365560    2584 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 11 17:21:30.365630 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:30.365619    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs podName:d60920d5-6202-4ebf-99cd-f5bddf867f35 nodeName:}" failed. No retries permitted until 2026-09-11 17:22:34.365599751 +0000 UTC m=+129.320289635 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs") pod "network-metrics-daemon-gvrhz" (UID: "d60920d5-6202-4ebf-99cd-f5bddf867f35") : secret "metrics-daemon-secret" not found
Sep 11 17:21:30.367829 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.367812    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c18b7034-c197-4dd5-aa98-85db5ff80828-original-pull-secret\") pod \"global-pull-secret-syncer-xxpwt\" (UID: \"c18b7034-c197-4dd5-aa98-85db5ff80828\") " pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:21:30.456224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.456187    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:21:30.458798 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.458776    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbdgd\" (UniqueName: \"kubernetes.io/projected/bc0414c4-36bd-4a47-a49d-c7d455ad9d60-kube-api-access-fbdgd\") pod \"network-check-target-kqwjl\" (UID: \"bc0414c4-36bd-4a47-a49d-c7d455ad9d60\") " pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:21:30.613258 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.613178    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-47wvr\""
Sep 11 17:21:30.620511 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.620480    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:21:30.620692 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.620675    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xxpwt"
Sep 11 17:21:30.758510 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.758470    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:21:30.758679 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:30.758652    2584 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 11 17:21:30.758679 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:30.758675    2584 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6bdcb8ffc7-7slbb: secret "image-registry-tls" not found
Sep 11 17:21:30.758795 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:30.758745    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls podName:280095e9-ef82-46f3-b84e-40488da613bb nodeName:}" failed. No retries permitted until 2026-09-11 17:22:02.758723042 +0000 UTC m=+97.713412928 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls") pod "image-registry-6bdcb8ffc7-7slbb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb") : secret "image-registry-tls" not found
Sep 11 17:21:30.859724 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.859682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:21:30.859910 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:30.859859    2584 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 11 17:21:30.859975 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:30.859939    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls podName:b072962d-d307-4d17-8b94-89ff1b2f0ec7 nodeName:}" failed. No retries permitted until 2026-09-11 17:22:02.859919164 +0000 UTC m=+97.814609050 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls") pod "dns-default-xdswl" (UID: "b072962d-d307-4d17-8b94-89ff1b2f0ec7") : secret "dns-default-metrics-tls" not found
Sep 11 17:21:30.901017 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.900981    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xxpwt"]
Sep 11 17:21:30.904106 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:30.904081    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-kqwjl"]
Sep 11 17:21:31.564933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.564894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:31.565324 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:31.565014    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:21:31.565324 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:31.565073    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls podName:3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:35.56505768 +0000 UTC m=+70.519747566 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t6qvv" (UID: "3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb") : secret "samples-operator-tls" not found
Sep 11 17:21:31.586467 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:21:31.586438    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc18b7034_c197_4dd5_aa98_85db5ff80828.slice/crio-54fda07f0a5cbdf966f8a4b5258d6ed29823e9afa9be6b6abb38fc7f04723c45 WatchSource:0}: Error finding container 54fda07f0a5cbdf966f8a4b5258d6ed29823e9afa9be6b6abb38fc7f04723c45: Status 404 returned error can't find the container with id 54fda07f0a5cbdf966f8a4b5258d6ed29823e9afa9be6b6abb38fc7f04723c45
Sep 11 17:21:31.586713 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:21:31.586697    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0414c4_36bd_4a47_a49d_c7d455ad9d60.slice/crio-b62481dea4da98f253e80c567acbe310941f293c687e9c8de036136d472082b2 WatchSource:0}: Error finding container b62481dea4da98f253e80c567acbe310941f293c687e9c8de036136d472082b2: Status 404 returned error can't find the container with id b62481dea4da98f253e80c567acbe310941f293c687e9c8de036136d472082b2
Sep 11 17:21:31.731138 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.731101    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-gj5n4"]
Sep 11 17:21:31.736144 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.736119    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.738833 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.738809    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 11 17:21:31.738958 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.738870    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 11 17:21:31.738958 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.738889    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 11 17:21:31.739128 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.739111    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 11 17:21:31.742500 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.742479    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-blz79\""
Sep 11 17:21:31.746853 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.746831    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gj5n4"]
Sep 11 17:21:31.766433 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.766386    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.766559 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.766445    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqp76\" (UniqueName: \"kubernetes.io/projected/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-api-access-zqp76\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.766559 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.766544    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.766649 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.766586    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-crio-socket\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.766649 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.766613    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-data-volume\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.867651 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.867568    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-crio-socket\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.867651 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.867599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-data-volume\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.867651 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.867635    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.867917 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.867667    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqp76\" (UniqueName: \"kubernetes.io/projected/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-api-access-zqp76\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.867917 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.867695    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-crio-socket\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.867917 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.867721    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.867917 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:31.867790    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:21:31.867917 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:31.867804    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:31.867917 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:31.867861    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:32.367846404 +0000 UTC m=+67.322536287 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:31.867917 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:31.867880    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:32.36787324 +0000 UTC m=+67.322563120 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : configmap "kube-rbac-proxy" not found
Sep 11 17:21:31.868159 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.867972    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-data-volume\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:31.876010 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:31.875985    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqp76\" (UniqueName: \"kubernetes.io/projected/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-api-access-zqp76\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:32.093220 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.093180    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw" event={"ID":"81d77485-5283-45d2-8693-149c0c875c32","Type":"ContainerStarted","Data":"26032bdcdbda55c75ff8e95fc6a46dae8ecbdff38efead1c1dd4ab168bed4f00"}
Sep 11 17:21:32.094751 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.094726    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kqwjl" event={"ID":"bc0414c4-36bd-4a47-a49d-c7d455ad9d60","Type":"ContainerStarted","Data":"d85e88d63e31a3fd6145eae0e319534b13d70f9ec054d229f8951fd8780bc639"}
Sep 11 17:21:32.094860 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.094766    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-kqwjl" event={"ID":"bc0414c4-36bd-4a47-a49d-c7d455ad9d60","Type":"ContainerStarted","Data":"b62481dea4da98f253e80c567acbe310941f293c687e9c8de036136d472082b2"}
Sep 11 17:21:32.094860 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.094789    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:21:32.095909 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.095890    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxpwt" event={"ID":"c18b7034-c197-4dd5-aa98-85db5ff80828","Type":"ContainerStarted","Data":"54fda07f0a5cbdf966f8a4b5258d6ed29823e9afa9be6b6abb38fc7f04723c45"}
Sep 11 17:21:32.112386 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.112340    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-6f8b768455-lc6tw" podStartSLOduration=1.938835246 podStartE2EDuration="5.112325224s" totalImagesPullingTime="3.173489978s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:21:32.111565334 +0000 UTC m=+67.066255237" watchObservedRunningTime="2026-09-11 17:21:32.112325224 +0000 UTC m=+67.067015125"
Sep 11 17:21:32.127761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.127663    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-kqwjl" podStartSLOduration=65.731246423 podStartE2EDuration="1m6.127647556s" totalImagesPullingTime="396.401133ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:21:32.127194068 +0000 UTC m=+67.081883970" watchObservedRunningTime="2026-09-11 17:21:32.127647556 +0000 UTC m=+67.082337459"
Sep 11 17:21:32.372107 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.372071    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:32.372305 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:32.372182    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:32.372305 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:32.372207    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:21:32.372305 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:32.372287    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:33.372270272 +0000 UTC m=+68.326960176 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : configmap "kube-rbac-proxy" not found
Sep 11 17:21:32.372488 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:32.372315    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:32.372488 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:32.372367    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:33.372351454 +0000 UTC m=+68.327041339 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:33.046678 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.046642    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk"]
Sep 11 17:21:33.069891 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.069863    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk"]
Sep 11 17:21:33.070039 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.069993    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk"
Sep 11 17:21:33.072667 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.072645    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 11 17:21:33.073541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.073475    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-hptcd\""
Sep 11 17:21:33.073541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.073483    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 11 17:21:33.180529 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.180221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nw62h\" (UniqueName: \"kubernetes.io/projected/d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7-kube-api-access-nw62h\") pod \"migrator-8b4d697c5-mq9pk\" (UID: \"d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk"
Sep 11 17:21:33.281392 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.281358    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nw62h\" (UniqueName: \"kubernetes.io/projected/d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7-kube-api-access-nw62h\") pod \"migrator-8b4d697c5-mq9pk\" (UID: \"d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk"
Sep 11 17:21:33.291435 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.291389    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nw62h\" (UniqueName: \"kubernetes.io/projected/d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7-kube-api-access-nw62h\") pod \"migrator-8b4d697c5-mq9pk\" (UID: \"d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7\") " pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk"
Sep 11 17:21:33.380497 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.380464    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk"
Sep 11 17:21:33.382847 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.382815    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:33.382974 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.382928    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:33.382974 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:33.382955    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:21:33.383087 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:33.383027    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:35.383006763 +0000 UTC m=+70.337696655 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : configmap "kube-rbac-proxy" not found
Sep 11 17:21:33.383087 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:33.383063    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:33.383184 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:33.383116    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:35.38310018 +0000 UTC m=+70.337790061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:33.678886 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.678803    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk"]
Sep 11 17:21:33.682726 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:21:33.682698    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6a34c77_9b0a_4bee_a23a_2ba89dcf52c7.slice/crio-225c7ad48782a4bb415be98e11296d4b491cd9f77349bb58384f931cbfd0a716 WatchSource:0}: Error finding container 225c7ad48782a4bb415be98e11296d4b491cd9f77349bb58384f931cbfd0a716: Status 404 returned error can't find the container with id 225c7ad48782a4bb415be98e11296d4b491cd9f77349bb58384f931cbfd0a716
Sep 11 17:21:33.897254 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:33.897214    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rhwpb_d8160bb7-c5a4-450d-bc41-a9e43eab4147/dns-node-resolver/0.log"
Sep 11 17:21:34.103866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:34.103767    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk" event={"ID":"d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7","Type":"ContainerStarted","Data":"225c7ad48782a4bb415be98e11296d4b491cd9f77349bb58384f931cbfd0a716"}
Sep 11 17:21:34.488641 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:34.488612    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8dgdw_ffdf1588-47ee-4828-a7e0-c3c45afe2e01/node-ca/0.log"
Sep 11 17:21:35.289089 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:35.289059    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wtwfn_49c3980f-2355-4a62-8c25-07d8f7cd520b/serve-healthcheck-canary/0.log"
Sep 11 17:21:35.399271 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:35.399229    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:35.399501 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:35.399329    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:35.399501 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:35.399437    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:35.399501 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:35.399455    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:21:35.399664 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:35.399508    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:39.399493822 +0000 UTC m=+74.354183701 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:35.399664 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:35.399526    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:39.399519467 +0000 UTC m=+74.354209352 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : configmap "kube-rbac-proxy" not found
Sep 11 17:21:35.601779 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:35.601690    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:35.602033 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:35.601876    2584 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Sep 11 17:21:35.602033 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:35.601960    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls podName:3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb nodeName:}" failed. No retries permitted until 2026-09-11 17:21:43.601937083 +0000 UTC m=+78.556626977 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls") pod "cluster-samples-operator-86499c89c4-t6qvv" (UID: "3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb") : secret "samples-operator-tls" not found
Sep 11 17:21:37.117377 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:37.117331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xxpwt" event={"ID":"c18b7034-c197-4dd5-aa98-85db5ff80828","Type":"ContainerStarted","Data":"98afbc4b33ef0db53040d78b0b2298ed24ede2cf561885d4858b7aacf4ce1a5b"}
Sep 11 17:21:37.119093 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:37.119068    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk" event={"ID":"d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7","Type":"ContainerStarted","Data":"042c9970907fb88dbd9f0622a6c12f3ad752f12a35fc2ca027dd5baf993b36b8"}
Sep 11 17:21:37.119224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:37.119117    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk" event={"ID":"d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7","Type":"ContainerStarted","Data":"41400424aa33fd312d3c3ac4d467b3decf2b35d9b079cf87e846fc55a4d8312c"}
Sep 11 17:21:37.134361 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:37.134315    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xxpwt" podStartSLOduration=66.269025114 podStartE2EDuration="1m11.134303994s" totalImagesPullingTime="4.86527888s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:21:37.133961392 +0000 UTC m=+72.088651293" watchObservedRunningTime="2026-09-11 17:21:37.134303994 +0000 UTC m=+72.088993893"
Sep 11 17:21:37.149531 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:37.149471    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-8b4d697c5-mq9pk" podStartSLOduration=1.393951419 podStartE2EDuration="4.149458633s" totalImagesPullingTime="2.755507214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:21:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:21:37.149083872 +0000 UTC m=+72.103773775" watchObservedRunningTime="2026-09-11 17:21:37.149458633 +0000 UTC m=+72.104148535"
Sep 11 17:21:39.431854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:39.431820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:39.432231 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:39.431895    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:39.432231 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:39.431945    2584 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 11 17:21:39.432231 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:39.431986    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:39.432231 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:39.432015    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:47.431999067 +0000 UTC m=+82.386688971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : configmap "kube-rbac-proxy" not found
Sep 11 17:21:39.432231 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:39.432031    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:21:47.432024476 +0000 UTC m=+82.386714355 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:43.666264 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:43.666225    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:43.668580 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:43.668562    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb-samples-operator-tls\") pod \"cluster-samples-operator-86499c89c4-t6qvv\" (UID: \"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:43.691471 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:43.691451    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"
Sep 11 17:21:43.959740 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:43.959659    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv"]
Sep 11 17:21:44.142896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:44.142862    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv" event={"ID":"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb","Type":"ContainerStarted","Data":"77d39e2f1ac7d5355ee715b9505e0016c4c03bdc4fd682cbf6bf88d5d77def8f"}
Sep 11 17:21:46.155810 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:46.155731    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv" event={"ID":"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb","Type":"ContainerStarted","Data":"bc5f5a70a85f8e950d42581a1a8beac8f91c7a5840595dc0c31f07a8683b48e3"}
Sep 11 17:21:46.155810 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:46.155799    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv" event={"ID":"3634ad2c-c8b8-4d4d-8d37-b4ccc5e99efb","Type":"ContainerStarted","Data":"296ca2d7e1c95f7b95e8e2dedcf223c459bf0f5b4ca19fa8867722e25e68f79d"}
Sep 11 17:21:46.174246 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:46.174201    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-86499c89c4-t6qvv" podStartSLOduration=17.279231236 podStartE2EDuration="19.17418782s" totalImagesPullingTime="1.894956584s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:21:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:21:46.173789954 +0000 UTC m=+81.128479857" watchObservedRunningTime="2026-09-11 17:21:46.17418782 +0000 UTC m=+81.128877761"
Sep 11 17:21:47.494845 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:47.494804    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:47.494845 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:47.494854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:47.495378 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:47.495004    2584 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:47.495378 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:21:47.495088    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls podName:c0a62a7e-25f6-4fdc-8c65-a5720cad3745 nodeName:}" failed. No retries permitted until 2026-09-11 17:22:03.495068066 +0000 UTC m=+98.449757965 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls") pod "insights-runtime-extractor-gj5n4" (UID: "c0a62a7e-25f6-4fdc-8c65-a5720cad3745") : secret "insights-runtime-extractor-tls" not found
Sep 11 17:21:47.495378 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:47.495333    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:21:58.370355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.370322    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"]
Sep 11 17:21:58.374358 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.374342    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.379102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.379078    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 11 17:21:58.379606 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.379575    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 11 17:21:58.379718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.379615    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 11 17:21:58.379718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.379701    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 11 17:21:58.380069 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.380057    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 11 17:21:58.380515 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.380498    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 11 17:21:58.380515 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.380515    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 11 17:21:58.397938 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.397912    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"]
Sep 11 17:21:58.480487 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.480443    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb07850-a914-4668-b878-02f0a3a39a6b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.480487 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.480496    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.480704 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.480576    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-ca\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.480704 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.480624    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-hub\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.480704 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.480670    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.480803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.480753    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-45w5b\" (UniqueName: \"kubernetes.io/projected/4cb07850-a914-4668-b878-02f0a3a39a6b-kube-api-access-45w5b\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.581379 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.581337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-45w5b\" (UniqueName: \"kubernetes.io/projected/4cb07850-a914-4668-b878-02f0a3a39a6b-kube-api-access-45w5b\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.581379 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.581380    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb07850-a914-4668-b878-02f0a3a39a6b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.581650 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.581410    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.581650 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.581570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-ca\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.581650 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.581645    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-hub\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.581814 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.581683    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.582186 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.582155    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/4cb07850-a914-4668-b878-02f0a3a39a6b-additional-service-ca\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.584091 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.584067    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.584176 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.584070    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-hub\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.584361 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.584343    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-ca\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.584419 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.584393    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/4cb07850-a914-4668-b878-02f0a3a39a6b-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.599417 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.599372    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-45w5b\" (UniqueName: \"kubernetes.io/projected/4cb07850-a914-4668-b878-02f0a3a39a6b-kube-api-access-45w5b\") pod \"cluster-proxy-proxy-agent-67bff9b879-g4wmr\" (UID: \"4cb07850-a914-4668-b878-02f0a3a39a6b\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.705688 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.705655    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"
Sep 11 17:21:58.976165 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:58.976080    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr"]
Sep 11 17:21:58.978839 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:21:58.978810    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4cb07850_a914_4668_b878_02f0a3a39a6b.slice/crio-d4c464145c0bc6e7188e14cbd4e56a2d6ba2ac0ce78330e260bdbfe09fd53122 WatchSource:0}: Error finding container d4c464145c0bc6e7188e14cbd4e56a2d6ba2ac0ce78330e260bdbfe09fd53122: Status 404 returned error can't find the container with id d4c464145c0bc6e7188e14cbd4e56a2d6ba2ac0ce78330e260bdbfe09fd53122
Sep 11 17:21:59.197924 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:21:59.197886    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr" event={"ID":"4cb07850-a914-4668-b878-02f0a3a39a6b","Type":"ContainerStarted","Data":"d4c464145c0bc6e7188e14cbd4e56a2d6ba2ac0ce78330e260bdbfe09fd53122"}
Sep 11 17:22:02.816225 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:02.816121    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:22:02.818683 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:02.818659    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"image-registry-6bdcb8ffc7-7slbb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") " pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:22:02.849710 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:02.849678    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-nbpzt\""
Sep 11 17:22:02.857900 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:02.857877    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:22:02.916911 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:02.916876    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:22:02.920077 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:02.920051    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b072962d-d307-4d17-8b94-89ff1b2f0ec7-metrics-tls\") pod \"dns-default-xdswl\" (UID: \"b072962d-d307-4d17-8b94-89ff1b2f0ec7\") " pod="openshift-dns/dns-default-xdswl"
Sep 11 17:22:03.101283 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.101197    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-kqwjl"
Sep 11 17:22:03.130226 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.130192    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"]
Sep 11 17:22:03.135117 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:22:03.135093    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod280095e9_ef82_46f3_b84e_40488da613bb.slice/crio-7631484c56f4fdd0c00409ef9db838492dc2459672a675fd6e014c7873cc9cbb WatchSource:0}: Error finding container 7631484c56f4fdd0c00409ef9db838492dc2459672a675fd6e014c7873cc9cbb: Status 404 returned error can't find the container with id 7631484c56f4fdd0c00409ef9db838492dc2459672a675fd6e014c7873cc9cbb
Sep 11 17:22:03.169221 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.169201    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-n6xk4\""
Sep 11 17:22:03.177423 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.177388    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdswl"
Sep 11 17:22:03.216641 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.216600    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr" event={"ID":"4cb07850-a914-4668-b878-02f0a3a39a6b","Type":"ContainerStarted","Data":"1331906920a36c2622651677a4e985334cdfb67ad82ea413cb37e436d1f90bf8"}
Sep 11 17:22:03.216805 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.216649    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr" event={"ID":"4cb07850-a914-4668-b878-02f0a3a39a6b","Type":"ContainerStarted","Data":"749bd27684ba6fe92136603b1c9ebd67c543424facff7b12b8f5ad744eced6ba"}
Sep 11 17:22:03.216805 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.216666    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr" event={"ID":"4cb07850-a914-4668-b878-02f0a3a39a6b","Type":"ContainerStarted","Data":"2514d39166a6d130559282ceb09cb08040b1476eb4b7497c05dbea83a33f99d3"}
Sep 11 17:22:03.218494 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.218459    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb" event={"ID":"280095e9-ef82-46f3-b84e-40488da613bb","Type":"ContainerStarted","Data":"81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8"}
Sep 11 17:22:03.218602 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.218516    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb" event={"ID":"280095e9-ef82-46f3-b84e-40488da613bb","Type":"ContainerStarted","Data":"7631484c56f4fdd0c00409ef9db838492dc2459672a675fd6e014c7873cc9cbb"}
Sep 11 17:22:03.218602 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.218543    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:22:03.257662 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.257498    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-67bff9b879-g4wmr" podStartSLOduration=1.725216846 podStartE2EDuration="5.257476818s" totalImagesPullingTime="3.532259972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:21:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:22:03.235041986 +0000 UTC m=+98.189731890" watchObservedRunningTime="2026-09-11 17:22:03.257476818 +0000 UTC m=+98.212166720"
Sep 11 17:22:03.258189 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.258143    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb" podStartSLOduration=76.258116557 podStartE2EDuration="1m16.258116557s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:20:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:22:03.25695078 +0000 UTC m=+98.211640673" watchObservedRunningTime="2026-09-11 17:22:03.258116557 +0000 UTC m=+98.212806457"
Sep 11 17:22:03.447726 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.447693    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xdswl"]
Sep 11 17:22:03.450782 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:22:03.450759    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb072962d_d307_4d17_8b94_89ff1b2f0ec7.slice/crio-fb0513d8d2bd62928d42d645a0ce48fdd78a5193fb6928a5d02280a09144fb57 WatchSource:0}: Error finding container fb0513d8d2bd62928d42d645a0ce48fdd78a5193fb6928a5d02280a09144fb57: Status 404 returned error can't find the container with id fb0513d8d2bd62928d42d645a0ce48fdd78a5193fb6928a5d02280a09144fb57
Sep 11 17:22:03.522193 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.522155    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:22:03.524392 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.524373    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c0a62a7e-25f6-4fdc-8c65-a5720cad3745-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-gj5n4\" (UID: \"c0a62a7e-25f6-4fdc-8c65-a5720cad3745\") " pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:22:03.545422 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.545385    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-gj5n4"
Sep 11 17:22:03.838867 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:03.838838    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-gj5n4"]
Sep 11 17:22:03.842127 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:22:03.842096    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0a62a7e_25f6_4fdc_8c65_a5720cad3745.slice/crio-8d20235086e927035e2220bf5f5fdd42d8d7da2aa93be1aedb8929b94070797b WatchSource:0}: Error finding container 8d20235086e927035e2220bf5f5fdd42d8d7da2aa93be1aedb8929b94070797b: Status 404 returned error can't find the container with id 8d20235086e927035e2220bf5f5fdd42d8d7da2aa93be1aedb8929b94070797b
Sep 11 17:22:04.226219 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:04.226183    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gj5n4" event={"ID":"c0a62a7e-25f6-4fdc-8c65-a5720cad3745","Type":"ContainerStarted","Data":"6ed1ea16ab9b054b5779fcb7752c6c960a855c67737b16a882f8a134fce5e071"}
Sep 11 17:22:04.226417 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:04.226253    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gj5n4" event={"ID":"c0a62a7e-25f6-4fdc-8c65-a5720cad3745","Type":"ContainerStarted","Data":"8d20235086e927035e2220bf5f5fdd42d8d7da2aa93be1aedb8929b94070797b"}
Sep 11 17:22:04.227425 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:04.227382    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdswl" event={"ID":"b072962d-d307-4d17-8b94-89ff1b2f0ec7","Type":"ContainerStarted","Data":"fb0513d8d2bd62928d42d645a0ce48fdd78a5193fb6928a5d02280a09144fb57"}
Sep 11 17:22:06.235243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:06.235199    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gj5n4" event={"ID":"c0a62a7e-25f6-4fdc-8c65-a5720cad3745","Type":"ContainerStarted","Data":"40481eb9bdded869aaca1531e6ff70bf8dfe7f428d2ea4bd4bbfe774906bf34a"}
Sep 11 17:22:06.237110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:06.237082    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdswl" event={"ID":"b072962d-d307-4d17-8b94-89ff1b2f0ec7","Type":"ContainerStarted","Data":"d1beb09a7326ee4f4553e130645e59e119413486bb98ba1f66b2e4dbc3ea509a"}
Sep 11 17:22:06.237211 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:06.237131    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdswl" event={"ID":"b072962d-d307-4d17-8b94-89ff1b2f0ec7","Type":"ContainerStarted","Data":"1deb0be6dc3e5bf3b503a4002efd3b391d033910862ff3c9962c878e00495092"}
Sep 11 17:22:06.237211 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:06.237194    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xdswl"
Sep 11 17:22:06.254086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:06.254037    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xdswl" podStartSLOduration=66.502240297 podStartE2EDuration="1m8.254021411s" totalImagesPullingTime="1.751781114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:20:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:22:06.253115808 +0000 UTC m=+101.207805710" watchObservedRunningTime="2026-09-11 17:22:06.254021411 +0000 UTC m=+101.208711313"
Sep 11 17:22:07.242466 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:07.242426    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-gj5n4" event={"ID":"c0a62a7e-25f6-4fdc-8c65-a5720cad3745","Type":"ContainerStarted","Data":"f397cfe4a83035be00012a95bc59e38610a73716c188b62b63cfb83b38293252"}
Sep 11 17:22:07.262796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:07.262747    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-gj5n4" podStartSLOduration=33.595580724 podStartE2EDuration="36.262730697s" totalImagesPullingTime="2.667149973s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:21:31 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:22:07.261546565 +0000 UTC m=+102.216236466" watchObservedRunningTime="2026-09-11 17:22:07.262730697 +0000 UTC m=+102.217420599"
Sep 11 17:22:11.301211 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.301173    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-45d6p"]
Sep 11 17:22:11.305089 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.305068    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.307414 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.307378    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 11 17:22:11.307882 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.307867    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 11 17:22:11.308503 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.308484    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 11 17:22:11.308586 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.308540    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 11 17:22:11.308586 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.308546    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-tszjt\""
Sep 11 17:22:11.309090 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.309071    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 11 17:22:11.309164 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.309095    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 11 17:22:11.382067 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382029    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.382067 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382069    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-sys\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.382329 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382097    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-metrics-client-ca\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.382329 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382124    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.382329 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382150    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-textfile\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.382329 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-wtmp\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.382329 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382277    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b2bz\" (UniqueName: \"kubernetes.io/projected/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-kube-api-access-9b2bz\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.382329 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382312    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-root\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.382560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.382338    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-tls\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.482843 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.482794    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-wtmp\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.482843 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.482848    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b2bz\" (UniqueName: \"kubernetes.io/projected/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-kube-api-access-9b2bz\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.482891    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-root\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.482916    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-tls\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.482941    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.482970    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-sys\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483007    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-wtmp\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483011    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-root\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483017    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-sys\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483086 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:22:11.483056    2584 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Sep 11 17:22:11.483479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483089    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-metrics-client-ca\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483479 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:22:11.483139    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-tls podName:f0ff9e64-134b-4a0b-8781-d2f25769c1dd nodeName:}" failed. No retries permitted until 2026-09-11 17:22:11.983116774 +0000 UTC m=+106.937806667 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-tls") pod "node-exporter-45d6p" (UID: "f0ff9e64-134b-4a0b-8781-d2f25769c1dd") : secret "node-exporter-tls" not found
Sep 11 17:22:11.483479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483158    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483191    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-textfile\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483680 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483592    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-accelerators-collector-config\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483680 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483626    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-textfile\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.483680 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.483671    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-metrics-client-ca\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.485370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.485352    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.497263 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.497238    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b2bz\" (UniqueName: \"kubernetes.io/projected/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-kube-api-access-9b2bz\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.988321 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.988281    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-tls\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:11.990566 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:11.990546    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f0ff9e64-134b-4a0b-8781-d2f25769c1dd-node-exporter-tls\") pod \"node-exporter-45d6p\" (UID: \"f0ff9e64-134b-4a0b-8781-d2f25769c1dd\") " pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:12.214453 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:12.214390    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-45d6p"
Sep 11 17:22:12.225494 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:22:12.225462    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf0ff9e64_134b_4a0b_8781_d2f25769c1dd.slice/crio-c05897ddbd8c536237246c5c05f64cccd9897f29c672ecfe76ddd27d0b9f6cc4 WatchSource:0}: Error finding container c05897ddbd8c536237246c5c05f64cccd9897f29c672ecfe76ddd27d0b9f6cc4: Status 404 returned error can't find the container with id c05897ddbd8c536237246c5c05f64cccd9897f29c672ecfe76ddd27d0b9f6cc4
Sep 11 17:22:12.260096 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:12.260020    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45d6p" event={"ID":"f0ff9e64-134b-4a0b-8781-d2f25769c1dd","Type":"ContainerStarted","Data":"c05897ddbd8c536237246c5c05f64cccd9897f29c672ecfe76ddd27d0b9f6cc4"}
Sep 11 17:22:14.270172 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:14.270133    2584 generic.go:356] "Generic (PLEG): container finished" podID="f0ff9e64-134b-4a0b-8781-d2f25769c1dd" containerID="c6141cd62c8fc1fb7ff1907cbcc8e6e06e9d9ca73c92bbb3aa95d3f50ad63f07" exitCode=0
Sep 11 17:22:14.270588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:14.270226    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45d6p" event={"ID":"f0ff9e64-134b-4a0b-8781-d2f25769c1dd","Type":"ContainerDied","Data":"c6141cd62c8fc1fb7ff1907cbcc8e6e06e9d9ca73c92bbb3aa95d3f50ad63f07"}
Sep 11 17:22:15.275178 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:15.275136    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45d6p" event={"ID":"f0ff9e64-134b-4a0b-8781-d2f25769c1dd","Type":"ContainerStarted","Data":"7b2bb825816adb43e44cd0ea0413033bc76db2e834ad1e093c87a9d1a6573b73"}
Sep 11 17:22:15.275680 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:15.275195    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-45d6p" event={"ID":"f0ff9e64-134b-4a0b-8781-d2f25769c1dd","Type":"ContainerStarted","Data":"72d50e54e216d063609922843362622c658ed8766d5068c6ad499855b9042c52"}
Sep 11 17:22:15.320972 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:15.320919    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-45d6p" podStartSLOduration=3.105116113 podStartE2EDuration="4.320903498s" totalImagesPullingTime="1.1542429s" totalInitContainerRuntime="61.544485ms" isStatefulPod=true podCreationTimestamp="2026-09-11 17:22:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:22:15.320526491 +0000 UTC m=+110.275216394" watchObservedRunningTime="2026-09-11 17:22:15.320903498 +0000 UTC m=+110.275593400"
Sep 11 17:22:16.244801 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:16.244768    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xdswl"
Sep 11 17:22:20.680623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:20.680591    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"]
Sep 11 17:22:20.684849 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:20.684820    2584 patch_prober.go:28] interesting pod/image-registry-6bdcb8ffc7-7slbb container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 11 17:22:20.684963 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:20.684864    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb" podUID="280095e9-ef82-46f3-b84e-40488da613bb" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:22:25.958873 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.958839    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5bdd776687-dvc5j"]
Sep 11 17:22:25.965083 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.965059    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:25.969948 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.969926    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 17:22:25.970270 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.970248    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 17:22:25.971117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.971093    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 17:22:25.971117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.971120    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 17:22:25.971286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.971131    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9tzbh\""
Sep 11 17:22:25.971286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.971104    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 17:22:25.971365 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.971326    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 17:22:25.972785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.972621    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 17:22:25.974986 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.974965    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bdd776687-dvc5j"]
Sep 11 17:22:25.975514 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:25.975496    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 17:22:26.093886 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.093834    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-console-config\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.093886 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.093887    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2jf9\" (UniqueName: \"kubernetes.io/projected/177f92b3-a610-432a-9be6-31ec63fbf727-kube-api-access-k2jf9\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.094111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.093959    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-service-ca\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.094111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.094003    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-oauth-serving-cert\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.094111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.094025    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-serving-cert\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.094111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.094040    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-oauth-config\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.094111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.094082    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-trusted-ca-bundle\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.195085 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.195052    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-serving-cert\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.195085 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.195085    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-oauth-config\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.195301 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.195198    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-trusted-ca-bundle\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.195301 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.195230    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-console-config\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.195301 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.195248    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2jf9\" (UniqueName: \"kubernetes.io/projected/177f92b3-a610-432a-9be6-31ec63fbf727-kube-api-access-k2jf9\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.195301 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.195276    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-service-ca\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.195301 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.195298    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-oauth-serving-cert\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.196018 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.195992    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-oauth-serving-cert\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.196124 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.196096    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-console-config\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.196166 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.196130    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-service-ca\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.196166 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.196154    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-trusted-ca-bundle\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.197723 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.197697    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-oauth-config\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.197822 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.197702    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-serving-cert\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.203764 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.203745    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2jf9\" (UniqueName: \"kubernetes.io/projected/177f92b3-a610-432a-9be6-31ec63fbf727-kube-api-access-k2jf9\") pod \"console-5bdd776687-dvc5j\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") " pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.274683 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.274593    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:26.551091 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:26.551016    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5bdd776687-dvc5j"]
Sep 11 17:22:26.554506 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:22:26.554480    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177f92b3_a610_432a_9be6_31ec63fbf727.slice/crio-336b8dbe24ce4e88281d07b129c7b750acfa80a3a7b4fd8f9f50e4fc8617149c WatchSource:0}: Error finding container 336b8dbe24ce4e88281d07b129c7b750acfa80a3a7b4fd8f9f50e4fc8617149c: Status 404 returned error can't find the container with id 336b8dbe24ce4e88281d07b129c7b750acfa80a3a7b4fd8f9f50e4fc8617149c
Sep 11 17:22:27.316222 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:27.316187    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdd776687-dvc5j" event={"ID":"177f92b3-a610-432a-9be6-31ec63fbf727","Type":"ContainerStarted","Data":"336b8dbe24ce4e88281d07b129c7b750acfa80a3a7b4fd8f9f50e4fc8617149c"}
Sep 11 17:22:30.325975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:30.325939    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdd776687-dvc5j" event={"ID":"177f92b3-a610-432a-9be6-31ec63fbf727","Type":"ContainerStarted","Data":"895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be"}
Sep 11 17:22:30.347272 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:30.347215    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5bdd776687-dvc5j" podStartSLOduration=2.606651935 podStartE2EDuration="5.347197873s" totalImagesPullingTime="2.740545938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:22:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:22:30.346253056 +0000 UTC m=+125.300942957" watchObservedRunningTime="2026-09-11 17:22:30.347197873 +0000 UTC m=+125.301887775"
Sep 11 17:22:30.684967 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:30.684941    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:22:34.454912 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:34.454873    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:22:34.457112 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:34.457081    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d60920d5-6202-4ebf-99cd-f5bddf867f35-metrics-certs\") pod \"network-metrics-daemon-gvrhz\" (UID: \"d60920d5-6202-4ebf-99cd-f5bddf867f35\") " pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:22:34.518803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:34.518775    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-f9zbq\""
Sep 11 17:22:34.526344 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:34.526323    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gvrhz"
Sep 11 17:22:34.808263 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:34.808184    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gvrhz"]
Sep 11 17:22:34.811063 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:22:34.811037    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd60920d5_6202_4ebf_99cd_f5bddf867f35.slice/crio-920997096c533901f0bd7e2d1ede4da244525c137c23b106a79b3822108dab27 WatchSource:0}: Error finding container 920997096c533901f0bd7e2d1ede4da244525c137c23b106a79b3822108dab27: Status 404 returned error can't find the container with id 920997096c533901f0bd7e2d1ede4da244525c137c23b106a79b3822108dab27
Sep 11 17:22:35.346540 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:35.346502    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gvrhz" event={"ID":"d60920d5-6202-4ebf-99cd-f5bddf867f35","Type":"ContainerStarted","Data":"920997096c533901f0bd7e2d1ede4da244525c137c23b106a79b3822108dab27"}
Sep 11 17:22:36.275109 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:36.275090    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:36.275370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:36.275131    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:36.280985 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:36.280963    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:36.355368 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:36.355337    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:22:37.356464 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:37.356433    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gvrhz" event={"ID":"d60920d5-6202-4ebf-99cd-f5bddf867f35","Type":"ContainerStarted","Data":"c76a4508554e23b7860f995d74027bd3587a80b524711e7aa9d86232cdbdea70"}
Sep 11 17:22:37.356826 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:37.356486    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gvrhz" event={"ID":"d60920d5-6202-4ebf-99cd-f5bddf867f35","Type":"ContainerStarted","Data":"791bf16357836f6d1d7c5faed82975b0cda13cb34acd6231426e72e83e059124"}
Sep 11 17:22:37.382642 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:37.382599    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gvrhz" podStartSLOduration=129.927838159 podStartE2EDuration="2m11.382583194s" totalImagesPullingTime="1.454745035s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:20:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:22:37.381966354 +0000 UTC m=+132.336656257" watchObservedRunningTime="2026-09-11 17:22:37.382583194 +0000 UTC m=+132.337273121"
Sep 11 17:22:45.699243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:45.699190    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb" podUID="280095e9-ef82-46f3-b84e-40488da613bb" containerName="registry" containerID="cri-o://81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8" gracePeriod=30
Sep 11 17:22:45.937354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:45.937329    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:22:46.043384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043306    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-registry-certificates\") pod \"280095e9-ef82-46f3-b84e-40488da613bb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") "
Sep 11 17:22:46.043384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043343    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-trusted-ca\") pod \"280095e9-ef82-46f3-b84e-40488da613bb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") "
Sep 11 17:22:46.043384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043372    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") pod \"280095e9-ef82-46f3-b84e-40488da613bb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") "
Sep 11 17:22:46.043665 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043427    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-image-registry-private-configuration\") pod \"280095e9-ef82-46f3-b84e-40488da613bb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") "
Sep 11 17:22:46.043665 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043480    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-bound-sa-token\") pod \"280095e9-ef82-46f3-b84e-40488da613bb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") "
Sep 11 17:22:46.043665 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043504    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hspd5\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-kube-api-access-hspd5\") pod \"280095e9-ef82-46f3-b84e-40488da613bb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") "
Sep 11 17:22:46.043665 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043554    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/280095e9-ef82-46f3-b84e-40488da613bb-ca-trust-extracted\") pod \"280095e9-ef82-46f3-b84e-40488da613bb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") "
Sep 11 17:22:46.043665 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043593    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-installation-pull-secrets\") pod \"280095e9-ef82-46f3-b84e-40488da613bb\" (UID: \"280095e9-ef82-46f3-b84e-40488da613bb\") "
Sep 11 17:22:46.043899 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.043797    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "280095e9-ef82-46f3-b84e-40488da613bb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:22:46.044320 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.044290    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "280095e9-ef82-46f3-b84e-40488da613bb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:22:46.045896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.045831    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "280095e9-ef82-46f3-b84e-40488da613bb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:22:46.046022 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.045964    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "280095e9-ef82-46f3-b84e-40488da613bb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:22:46.046176 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.046137    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "280095e9-ef82-46f3-b84e-40488da613bb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:22:46.046282 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.046239    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "280095e9-ef82-46f3-b84e-40488da613bb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:22:46.046389 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.046366    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-kube-api-access-hspd5" (OuterVolumeSpecName: "kube-api-access-hspd5") pod "280095e9-ef82-46f3-b84e-40488da613bb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb"). InnerVolumeSpecName "kube-api-access-hspd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:22:46.052495 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.052472    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/280095e9-ef82-46f3-b84e-40488da613bb-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "280095e9-ef82-46f3-b84e-40488da613bb" (UID: "280095e9-ef82-46f3-b84e-40488da613bb"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:22:46.144480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.144448    2584 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/280095e9-ef82-46f3-b84e-40488da613bb-ca-trust-extracted\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:22:46.144480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.144476    2584 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-installation-pull-secrets\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:22:46.144480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.144485    2584 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-registry-certificates\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:22:46.144696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.144497    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/280095e9-ef82-46f3-b84e-40488da613bb-trusted-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:22:46.144696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.144506    2584 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-registry-tls\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:22:46.144696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.144515    2584 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/280095e9-ef82-46f3-b84e-40488da613bb-image-registry-private-configuration\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:22:46.144696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.144524    2584 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-bound-sa-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:22:46.144696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.144532    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hspd5\" (UniqueName: \"kubernetes.io/projected/280095e9-ef82-46f3-b84e-40488da613bb-kube-api-access-hspd5\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:22:46.389308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.389276    2584 generic.go:356] "Generic (PLEG): container finished" podID="280095e9-ef82-46f3-b84e-40488da613bb" containerID="81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8" exitCode=0
Sep 11 17:22:46.389502 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.389321    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"
Sep 11 17:22:46.389502 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.389361    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb" event={"ID":"280095e9-ef82-46f3-b84e-40488da613bb","Type":"ContainerDied","Data":"81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8"}
Sep 11 17:22:46.389502 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.389431    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6bdcb8ffc7-7slbb" event={"ID":"280095e9-ef82-46f3-b84e-40488da613bb","Type":"ContainerDied","Data":"7631484c56f4fdd0c00409ef9db838492dc2459672a675fd6e014c7873cc9cbb"}
Sep 11 17:22:46.389502 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.389461    2584 scope.go:117] "RemoveContainer" containerID="81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8"
Sep 11 17:22:46.397915 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.397893    2584 scope.go:117] "RemoveContainer" containerID="81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8"
Sep 11 17:22:46.398200 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:22:46.398178    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8\": container with ID starting with 81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8 not found: ID does not exist" containerID="81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8"
Sep 11 17:22:46.398269 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.398207    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8"} err="failed to get container status \"81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8\": rpc error: code = NotFound desc = could not find container \"81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8\": container with ID starting with 81417818b7309e7cdbf54c3aa8142e6681c9603ae8233b2d069a9357ffb5dcd8 not found: ID does not exist"
Sep 11 17:22:46.412677 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.412654    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"]
Sep 11 17:22:46.414690 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:46.414670    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6bdcb8ffc7-7slbb"]
Sep 11 17:22:47.704208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:22:47.704164    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="280095e9-ef82-46f3-b84e-40488da613bb" path="/var/lib/kubelet/pods/280095e9-ef82-46f3-b84e-40488da613bb/volumes"
Sep 11 17:23:54.244355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:23:54.244322    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bdd776687-dvc5j"]
Sep 11 17:24:19.262799 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.262732    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5bdd776687-dvc5j" podUID="177f92b3-a610-432a-9be6-31ec63fbf727" containerName="console" containerID="cri-o://895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be" gracePeriod=15
Sep 11 17:24:19.500091 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.500066    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:24:19.596310 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596218    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-serving-cert\") pod \"177f92b3-a610-432a-9be6-31ec63fbf727\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") "
Sep 11 17:24:19.596310 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596279    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-console-config\") pod \"177f92b3-a610-432a-9be6-31ec63fbf727\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") "
Sep 11 17:24:19.596560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596320    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k2jf9\" (UniqueName: \"kubernetes.io/projected/177f92b3-a610-432a-9be6-31ec63fbf727-kube-api-access-k2jf9\") pod \"177f92b3-a610-432a-9be6-31ec63fbf727\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") "
Sep 11 17:24:19.596560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596353    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-service-ca\") pod \"177f92b3-a610-432a-9be6-31ec63fbf727\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") "
Sep 11 17:24:19.596560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596378    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-oauth-config\") pod \"177f92b3-a610-432a-9be6-31ec63fbf727\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") "
Sep 11 17:24:19.596560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596438    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-trusted-ca-bundle\") pod \"177f92b3-a610-432a-9be6-31ec63fbf727\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") "
Sep 11 17:24:19.596560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596480    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-oauth-serving-cert\") pod \"177f92b3-a610-432a-9be6-31ec63fbf727\" (UID: \"177f92b3-a610-432a-9be6-31ec63fbf727\") "
Sep 11 17:24:19.596936 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596878    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-console-config" (OuterVolumeSpecName: "console-config") pod "177f92b3-a610-432a-9be6-31ec63fbf727" (UID: "177f92b3-a610-432a-9be6-31ec63fbf727"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:24:19.596936 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596881    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-service-ca" (OuterVolumeSpecName: "service-ca") pod "177f92b3-a610-432a-9be6-31ec63fbf727" (UID: "177f92b3-a610-432a-9be6-31ec63fbf727"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:24:19.597127 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.596943    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "177f92b3-a610-432a-9be6-31ec63fbf727" (UID: "177f92b3-a610-432a-9be6-31ec63fbf727"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:24:19.597425 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.597376    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "177f92b3-a610-432a-9be6-31ec63fbf727" (UID: "177f92b3-a610-432a-9be6-31ec63fbf727"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:24:19.598628 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.598602    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "177f92b3-a610-432a-9be6-31ec63fbf727" (UID: "177f92b3-a610-432a-9be6-31ec63fbf727"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:24:19.598714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.598646    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "177f92b3-a610-432a-9be6-31ec63fbf727" (UID: "177f92b3-a610-432a-9be6-31ec63fbf727"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:24:19.598714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.598654    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/177f92b3-a610-432a-9be6-31ec63fbf727-kube-api-access-k2jf9" (OuterVolumeSpecName: "kube-api-access-k2jf9") pod "177f92b3-a610-432a-9be6-31ec63fbf727" (UID: "177f92b3-a610-432a-9be6-31ec63fbf727"). InnerVolumeSpecName "kube-api-access-k2jf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:24:19.697238 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.697208    2584 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-oauth-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:19.697238 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.697234    2584 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-serving-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:19.697478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.697246    2584 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-console-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:19.697478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.697259    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k2jf9\" (UniqueName: \"kubernetes.io/projected/177f92b3-a610-432a-9be6-31ec63fbf727-kube-api-access-k2jf9\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:19.697478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.697271    2584 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:19.697478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.697282    2584 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/177f92b3-a610-432a-9be6-31ec63fbf727-console-oauth-config\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:19.697478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.697292    2584 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/177f92b3-a610-432a-9be6-31ec63fbf727-trusted-ca-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:19.700345 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.700319    2584 generic.go:356] "Generic (PLEG): container finished" podID="177f92b3-a610-432a-9be6-31ec63fbf727" containerID="895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be" exitCode=0
Sep 11 17:24:19.700477 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.700387    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5bdd776687-dvc5j"
Sep 11 17:24:19.703182 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.703156    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdd776687-dvc5j" event={"ID":"177f92b3-a610-432a-9be6-31ec63fbf727","Type":"ContainerDied","Data":"895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be"}
Sep 11 17:24:19.703278 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.703194    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5bdd776687-dvc5j" event={"ID":"177f92b3-a610-432a-9be6-31ec63fbf727","Type":"ContainerDied","Data":"336b8dbe24ce4e88281d07b129c7b750acfa80a3a7b4fd8f9f50e4fc8617149c"}
Sep 11 17:24:19.703278 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.703215    2584 scope.go:117] "RemoveContainer" containerID="895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be"
Sep 11 17:24:19.712106 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.712087    2584 scope.go:117] "RemoveContainer" containerID="895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be"
Sep 11 17:24:19.712372 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:24:19.712355    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be\": container with ID starting with 895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be not found: ID does not exist" containerID="895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be"
Sep 11 17:24:19.712460 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.712377    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be"} err="failed to get container status \"895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be\": rpc error: code = NotFound desc = could not find container \"895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be\": container with ID starting with 895bb715151c17c843465c5e8b6e8429fd742ebb9203a7957ad8d2de2dd5e9be not found: ID does not exist"
Sep 11 17:24:19.736434 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.736391    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5bdd776687-dvc5j"]
Sep 11 17:24:19.743681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:19.743658    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5bdd776687-dvc5j"]
Sep 11 17:24:21.703524 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:21.703491    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="177f92b3-a610-432a-9be6-31ec63fbf727" path="/var/lib/kubelet/pods/177f92b3-a610-432a-9be6-31ec63fbf727/volumes"
Sep 11 17:24:24.761970 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.761942    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"]
Sep 11 17:24:24.762372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.762178    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="177f92b3-a610-432a-9be6-31ec63fbf727" containerName="console"
Sep 11 17:24:24.762372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.762188    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="177f92b3-a610-432a-9be6-31ec63fbf727" containerName="console"
Sep 11 17:24:24.762372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.762197    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="280095e9-ef82-46f3-b84e-40488da613bb" containerName="registry"
Sep 11 17:24:24.762372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.762202    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="280095e9-ef82-46f3-b84e-40488da613bb" containerName="registry"
Sep 11 17:24:24.762372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.762244    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="177f92b3-a610-432a-9be6-31ec63fbf727" containerName="console"
Sep 11 17:24:24.762372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.762252    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="280095e9-ef82-46f3-b84e-40488da613bb" containerName="registry"
Sep 11 17:24:24.767529 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.767499    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:24.775469 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.775447    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 17:24:24.776215 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.776199    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 17:24:24.776278 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.776200    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7xk7d\""
Sep 11 17:24:24.787362 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.787338    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"]
Sep 11 17:24:24.933461 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.933389    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbl5r\" (UniqueName: \"kubernetes.io/projected/d74c66b9-3987-42ce-8d56-efd7c38f2818-kube-api-access-qbl5r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:24.933653 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.933509    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:24.933653 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:24.933532    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:25.034442 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.034326    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qbl5r\" (UniqueName: \"kubernetes.io/projected/d74c66b9-3987-42ce-8d56-efd7c38f2818-kube-api-access-qbl5r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:25.034442 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.034429    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:25.034633 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.034460    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:25.034854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.034834    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:25.034896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.034860    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:25.044202 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.044173    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbl5r\" (UniqueName: \"kubernetes.io/projected/d74c66b9-3987-42ce-8d56-efd7c38f2818-kube-api-access-qbl5r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:25.076145 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.076113    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:25.367887 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.367860    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"]
Sep 11 17:24:25.370356 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:24:25.370322    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd74c66b9_3987_42ce_8d56_efd7c38f2818.slice/crio-3b0d485532fd40daaf7a891204861e9f17947f7a6ecfc88254e46b86de4f3dce WatchSource:0}: Error finding container 3b0d485532fd40daaf7a891204861e9f17947f7a6ecfc88254e46b86de4f3dce: Status 404 returned error can't find the container with id 3b0d485532fd40daaf7a891204861e9f17947f7a6ecfc88254e46b86de4f3dce
Sep 11 17:24:25.720180 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:25.720143    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz" event={"ID":"d74c66b9-3987-42ce-8d56-efd7c38f2818","Type":"ContainerStarted","Data":"3b0d485532fd40daaf7a891204861e9f17947f7a6ecfc88254e46b86de4f3dce"}
Sep 11 17:24:32.745614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:32.745572    2584 generic.go:356] "Generic (PLEG): container finished" podID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerID="b0a67def755a39e401af448456e3a767ba1eeaca1dd4ac8b1faad5346bf56d7e" exitCode=0
Sep 11 17:24:32.746043 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:32.745638    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz" event={"ID":"d74c66b9-3987-42ce-8d56-efd7c38f2818","Type":"ContainerDied","Data":"b0a67def755a39e401af448456e3a767ba1eeaca1dd4ac8b1faad5346bf56d7e"}
Sep 11 17:24:35.758840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:35.758807    2584 generic.go:356] "Generic (PLEG): container finished" podID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerID="73ca05f0bc31d546502975bcd173f13fadd47f21ccc349ae8f5a5675c9f12b8a" exitCode=0
Sep 11 17:24:35.759294 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:35.758901    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz" event={"ID":"d74c66b9-3987-42ce-8d56-efd7c38f2818","Type":"ContainerDied","Data":"73ca05f0bc31d546502975bcd173f13fadd47f21ccc349ae8f5a5675c9f12b8a"}
Sep 11 17:24:42.787076 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:42.787041    2584 generic.go:356] "Generic (PLEG): container finished" podID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerID="a9ef8bfc8ea3f10db66e22144ef54e6db9215f347a4a588b2ec3de670c90b875" exitCode=0
Sep 11 17:24:42.787455 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:42.787110    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz" event={"ID":"d74c66b9-3987-42ce-8d56-efd7c38f2818","Type":"ContainerDied","Data":"a9ef8bfc8ea3f10db66e22144ef54e6db9215f347a4a588b2ec3de670c90b875"}
Sep 11 17:24:43.905711 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:43.905684    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:43.977244 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:43.977212    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qbl5r\" (UniqueName: \"kubernetes.io/projected/d74c66b9-3987-42ce-8d56-efd7c38f2818-kube-api-access-qbl5r\") pod \"d74c66b9-3987-42ce-8d56-efd7c38f2818\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") "
Sep 11 17:24:43.977244 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:43.977242    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-util\") pod \"d74c66b9-3987-42ce-8d56-efd7c38f2818\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") "
Sep 11 17:24:43.977493 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:43.977281    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-bundle\") pod \"d74c66b9-3987-42ce-8d56-efd7c38f2818\" (UID: \"d74c66b9-3987-42ce-8d56-efd7c38f2818\") "
Sep 11 17:24:43.978006 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:43.977978    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-bundle" (OuterVolumeSpecName: "bundle") pod "d74c66b9-3987-42ce-8d56-efd7c38f2818" (UID: "d74c66b9-3987-42ce-8d56-efd7c38f2818"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:24:43.979386 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:43.979364    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d74c66b9-3987-42ce-8d56-efd7c38f2818-kube-api-access-qbl5r" (OuterVolumeSpecName: "kube-api-access-qbl5r") pod "d74c66b9-3987-42ce-8d56-efd7c38f2818" (UID: "d74c66b9-3987-42ce-8d56-efd7c38f2818"). InnerVolumeSpecName "kube-api-access-qbl5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:24:43.982021 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:43.982000    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-util" (OuterVolumeSpecName: "util") pod "d74c66b9-3987-42ce-8d56-efd7c38f2818" (UID: "d74c66b9-3987-42ce-8d56-efd7c38f2818"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:24:44.078018 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:44.077949    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qbl5r\" (UniqueName: \"kubernetes.io/projected/d74c66b9-3987-42ce-8d56-efd7c38f2818-kube-api-access-qbl5r\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:44.078018 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:44.077975    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:44.078018 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:44.077984    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d74c66b9-3987-42ce-8d56-efd7c38f2818-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:24:44.795443 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:44.795395    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz" event={"ID":"d74c66b9-3987-42ce-8d56-efd7c38f2818","Type":"ContainerDied","Data":"3b0d485532fd40daaf7a891204861e9f17947f7a6ecfc88254e46b86de4f3dce"}
Sep 11 17:24:44.795443 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:44.795445    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540zngtz"
Sep 11 17:24:44.795636 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:44.795454    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b0d485532fd40daaf7a891204861e9f17947f7a6ecfc88254e46b86de4f3dce"
Sep 11 17:24:48.683078 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.682993    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"]
Sep 11 17:24:48.683449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.683229    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerName="extract"
Sep 11 17:24:48.683449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.683239    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerName="extract"
Sep 11 17:24:48.683449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.683251    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerName="util"
Sep 11 17:24:48.683449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.683256    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerName="util"
Sep 11 17:24:48.683449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.683261    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerName="pull"
Sep 11 17:24:48.683449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.683267    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerName="pull"
Sep 11 17:24:48.683449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.683311    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d74c66b9-3987-42ce-8d56-efd7c38f2818" containerName="extract"
Sep 11 17:24:48.696292 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.696262    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"
Sep 11 17:24:48.700023 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.699996    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 11 17:24:48.700163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.700076    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 11 17:24:48.700696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.700678    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bt7b7\""
Sep 11 17:24:48.711381 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.711358    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-glx6h\" (UniqueName: \"kubernetes.io/projected/d479af75-6eba-4293-ac48-67222af4bc60-kube-api-access-glx6h\") pod \"cert-manager-operator-controller-manager-55c444bf86-5xt69\" (UID: \"d479af75-6eba-4293-ac48-67222af4bc60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"
Sep 11 17:24:48.711504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.711416    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d479af75-6eba-4293-ac48-67222af4bc60-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5xt69\" (UID: \"d479af75-6eba-4293-ac48-67222af4bc60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"
Sep 11 17:24:48.723061 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.723035    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"]
Sep 11 17:24:48.812745 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.812710    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-glx6h\" (UniqueName: \"kubernetes.io/projected/d479af75-6eba-4293-ac48-67222af4bc60-kube-api-access-glx6h\") pod \"cert-manager-operator-controller-manager-55c444bf86-5xt69\" (UID: \"d479af75-6eba-4293-ac48-67222af4bc60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"
Sep 11 17:24:48.812925 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.812761    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d479af75-6eba-4293-ac48-67222af4bc60-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5xt69\" (UID: \"d479af75-6eba-4293-ac48-67222af4bc60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"
Sep 11 17:24:48.813116 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.813097    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d479af75-6eba-4293-ac48-67222af4bc60-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-5xt69\" (UID: \"d479af75-6eba-4293-ac48-67222af4bc60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"
Sep 11 17:24:48.828814 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:48.828781    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-glx6h\" (UniqueName: \"kubernetes.io/projected/d479af75-6eba-4293-ac48-67222af4bc60-kube-api-access-glx6h\") pod \"cert-manager-operator-controller-manager-55c444bf86-5xt69\" (UID: \"d479af75-6eba-4293-ac48-67222af4bc60\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"
Sep 11 17:24:49.005206 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:49.005121    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"
Sep 11 17:24:49.312665 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:49.312591    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69"]
Sep 11 17:24:49.317067 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:24:49.317037    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd479af75_6eba_4293_ac48_67222af4bc60.slice/crio-a4268130c9fe5f6d22d18567b4ae0cc73ec3234f112f91f2bfabb1a1a2f6e1ef WatchSource:0}: Error finding container a4268130c9fe5f6d22d18567b4ae0cc73ec3234f112f91f2bfabb1a1a2f6e1ef: Status 404 returned error can't find the container with id a4268130c9fe5f6d22d18567b4ae0cc73ec3234f112f91f2bfabb1a1a2f6e1ef
Sep 11 17:24:49.812487 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:49.812450    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69" event={"ID":"d479af75-6eba-4293-ac48-67222af4bc60","Type":"ContainerStarted","Data":"a4268130c9fe5f6d22d18567b4ae0cc73ec3234f112f91f2bfabb1a1a2f6e1ef"}
Sep 11 17:24:51.821903 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:51.821865    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69" event={"ID":"d479af75-6eba-4293-ac48-67222af4bc60","Type":"ContainerStarted","Data":"70139ff5b1009291632005cca1eb68d916aec87802ae122ca2abdd3482a4d8eb"}
Sep 11 17:24:52.887697 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.887635    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-5xt69" podStartSLOduration=3.230190994 podStartE2EDuration="4.887614025s" totalImagesPullingTime="1.657423031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:24:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:24:51.961125907 +0000 UTC m=+266.915815823" watchObservedRunningTime="2026-09-11 17:24:52.887614025 +0000 UTC m=+267.842303988"
Sep 11 17:24:52.888350 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.888335    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"]
Sep 11 17:24:52.891620 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.891604    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:52.904529 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.904510    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 17:24:52.910090 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.910068    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 17:24:52.910211 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.910193    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7xk7d\""
Sep 11 17:24:52.924341 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.924313    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"]
Sep 11 17:24:52.948716 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.948676    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:52.948900 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.948721    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxpcq\" (UniqueName: \"kubernetes.io/projected/9981f933-3176-4b16-a3a1-69d5e7bce446-kube-api-access-bxpcq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:52.948900 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:52.948819    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:53.050168 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.050129    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxpcq\" (UniqueName: \"kubernetes.io/projected/9981f933-3176-4b16-a3a1-69d5e7bce446-kube-api-access-bxpcq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:53.050366 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.050179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:53.050366 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.050238    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:53.050583 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.050557    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:53.050656 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.050643    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:53.085414 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.085368    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxpcq\" (UniqueName: \"kubernetes.io/projected/9981f933-3176-4b16-a3a1-69d5e7bce446-kube-api-access-bxpcq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:53.200623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.200541    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:24:53.238945 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.238904    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rjljs"]
Sep 11 17:24:53.242163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.242147    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:53.255895 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.255871    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-22q6r\""
Sep 11 17:24:53.260302 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.260148    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 11 17:24:53.262559 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.262536    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 11 17:24:53.279912 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.279844    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rjljs"]
Sep 11 17:24:53.351865 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.351831    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22fbb431-05bd-4954-b0e8-892522bfd3e2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rjljs\" (UID: \"22fbb431-05bd-4954-b0e8-892522bfd3e2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:53.352019 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.351885    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jxkx\" (UniqueName: \"kubernetes.io/projected/22fbb431-05bd-4954-b0e8-892522bfd3e2-kube-api-access-5jxkx\") pod \"cert-manager-webhook-6486ffd997-rjljs\" (UID: \"22fbb431-05bd-4954-b0e8-892522bfd3e2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:53.453029 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.452951    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jxkx\" (UniqueName: \"kubernetes.io/projected/22fbb431-05bd-4954-b0e8-892522bfd3e2-kube-api-access-5jxkx\") pod \"cert-manager-webhook-6486ffd997-rjljs\" (UID: \"22fbb431-05bd-4954-b0e8-892522bfd3e2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:53.453029 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.452995    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22fbb431-05bd-4954-b0e8-892522bfd3e2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rjljs\" (UID: \"22fbb431-05bd-4954-b0e8-892522bfd3e2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:53.465966 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.465942    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/22fbb431-05bd-4954-b0e8-892522bfd3e2-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-rjljs\" (UID: \"22fbb431-05bd-4954-b0e8-892522bfd3e2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:53.473657 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.473630    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jxkx\" (UniqueName: \"kubernetes.io/projected/22fbb431-05bd-4954-b0e8-892522bfd3e2-kube-api-access-5jxkx\") pod \"cert-manager-webhook-6486ffd997-rjljs\" (UID: \"22fbb431-05bd-4954-b0e8-892522bfd3e2\") " pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:53.487056 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.487033    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"]
Sep 11 17:24:53.489297 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:24:53.489271    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9981f933_3176_4b16_a3a1_69d5e7bce446.slice/crio-9f41e46d23b3f42e8fea9652895281d4c509b5079971e154126109485470eb4a WatchSource:0}: Error finding container 9f41e46d23b3f42e8fea9652895281d4c509b5079971e154126109485470eb4a: Status 404 returned error can't find the container with id 9f41e46d23b3f42e8fea9652895281d4c509b5079971e154126109485470eb4a
Sep 11 17:24:53.553983 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.553953    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:53.831599 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.831509    2584 generic.go:356] "Generic (PLEG): container finished" podID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerID="049f0d789110f638cf485dfa77a4143327f7574171610c6bb5cb4984632786fa" exitCode=0
Sep 11 17:24:53.831761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.831595    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc" event={"ID":"9981f933-3176-4b16-a3a1-69d5e7bce446","Type":"ContainerDied","Data":"049f0d789110f638cf485dfa77a4143327f7574171610c6bb5cb4984632786fa"}
Sep 11 17:24:53.831761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.831646    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc" event={"ID":"9981f933-3176-4b16-a3a1-69d5e7bce446","Type":"ContainerStarted","Data":"9f41e46d23b3f42e8fea9652895281d4c509b5079971e154126109485470eb4a"}
Sep 11 17:24:53.851688 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:53.851617    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-rjljs"]
Sep 11 17:24:53.854081 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:24:53.854062    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod22fbb431_05bd_4954_b0e8_892522bfd3e2.slice/crio-455dd4422c29e0c805a71d57dbf3e7c49076f3c2c2c9bcf6c33c90d130cadbd5 WatchSource:0}: Error finding container 455dd4422c29e0c805a71d57dbf3e7c49076f3c2c2c9bcf6c33c90d130cadbd5: Status 404 returned error can't find the container with id 455dd4422c29e0c805a71d57dbf3e7c49076f3c2c2c9bcf6c33c90d130cadbd5
Sep 11 17:24:54.840484 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:54.840381    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs" event={"ID":"22fbb431-05bd-4954-b0e8-892522bfd3e2","Type":"ContainerStarted","Data":"455dd4422c29e0c805a71d57dbf3e7c49076f3c2c2c9bcf6c33c90d130cadbd5"}
Sep 11 17:24:57.855661 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:57.855626    2584 generic.go:356] "Generic (PLEG): container finished" podID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerID="d6eb4a61b545f30a44b6ccd1871249dc4687d13eb1f1c0a17f11e96895b5c67c" exitCode=0
Sep 11 17:24:57.856138 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:57.855714    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc" event={"ID":"9981f933-3176-4b16-a3a1-69d5e7bce446","Type":"ContainerDied","Data":"d6eb4a61b545f30a44b6ccd1871249dc4687d13eb1f1c0a17f11e96895b5c67c"}
Sep 11 17:24:57.857419 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:57.857379    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs" event={"ID":"22fbb431-05bd-4954-b0e8-892522bfd3e2","Type":"ContainerStarted","Data":"93cbbad3f39ea474ba3fa23bf39b258df6f61ff771c9784ffe4c9adf6906869a"}
Sep 11 17:24:57.857515 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:57.857466    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:24:58.862593 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:58.862554    2584 generic.go:356] "Generic (PLEG): container finished" podID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerID="3fdfa4a41a418a16c08ef78465931967f9259928099ab7b4c6c29fdec3caefa2" exitCode=0
Sep 11 17:24:58.862961 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:58.862630    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc" event={"ID":"9981f933-3176-4b16-a3a1-69d5e7bce446","Type":"ContainerDied","Data":"3fdfa4a41a418a16c08ef78465931967f9259928099ab7b4c6c29fdec3caefa2"}
Sep 11 17:24:58.892715 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:58.892659    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs" podStartSLOduration=2.865610035 podStartE2EDuration="5.892642016s" totalImagesPullingTime="3.027031981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:24:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:24:57.90744674 +0000 UTC m=+272.862136638" watchObservedRunningTime="2026-09-11 17:24:58.892642016 +0000 UTC m=+273.847331918"
Sep 11 17:24:59.987297 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:24:59.987271    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:25:00.104269 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.104230    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxpcq\" (UniqueName: \"kubernetes.io/projected/9981f933-3176-4b16-a3a1-69d5e7bce446-kube-api-access-bxpcq\") pod \"9981f933-3176-4b16-a3a1-69d5e7bce446\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") "
Sep 11 17:25:00.104269 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.104276    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-bundle\") pod \"9981f933-3176-4b16-a3a1-69d5e7bce446\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") "
Sep 11 17:25:00.104509 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.104309    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-util\") pod \"9981f933-3176-4b16-a3a1-69d5e7bce446\" (UID: \"9981f933-3176-4b16-a3a1-69d5e7bce446\") "
Sep 11 17:25:00.104781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.104754    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-bundle" (OuterVolumeSpecName: "bundle") pod "9981f933-3176-4b16-a3a1-69d5e7bce446" (UID: "9981f933-3176-4b16-a3a1-69d5e7bce446"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:25:00.106362 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.106334    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9981f933-3176-4b16-a3a1-69d5e7bce446-kube-api-access-bxpcq" (OuterVolumeSpecName: "kube-api-access-bxpcq") pod "9981f933-3176-4b16-a3a1-69d5e7bce446" (UID: "9981f933-3176-4b16-a3a1-69d5e7bce446"). InnerVolumeSpecName "kube-api-access-bxpcq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:25:00.108840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.108816    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-util" (OuterVolumeSpecName: "util") pod "9981f933-3176-4b16-a3a1-69d5e7bce446" (UID: "9981f933-3176-4b16-a3a1-69d5e7bce446"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:25:00.205489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.205446    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:00.205489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.205482    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9981f933-3176-4b16-a3a1-69d5e7bce446-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:00.205489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.205491    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxpcq\" (UniqueName: \"kubernetes.io/projected/9981f933-3176-4b16-a3a1-69d5e7bce446-kube-api-access-bxpcq\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:00.873422 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.873370    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc"
Sep 11 17:25:00.873422 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.873374    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fwgbsc" event={"ID":"9981f933-3176-4b16-a3a1-69d5e7bce446","Type":"ContainerDied","Data":"9f41e46d23b3f42e8fea9652895281d4c509b5079971e154126109485470eb4a"}
Sep 11 17:25:00.873637 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:00.873476    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9f41e46d23b3f42e8fea9652895281d4c509b5079971e154126109485470eb4a"
Sep 11 17:25:03.087541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.087506    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jspzc"]
Sep 11 17:25:03.087993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.087862    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerName="util"
Sep 11 17:25:03.087993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.087878    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerName="util"
Sep 11 17:25:03.087993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.087897    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerName="pull"
Sep 11 17:25:03.087993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.087905    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerName="pull"
Sep 11 17:25:03.087993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.087923    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerName="extract"
Sep 11 17:25:03.087993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.087931    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerName="extract"
Sep 11 17:25:03.087993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.087994    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="9981f933-3176-4b16-a3a1-69d5e7bce446" containerName="extract"
Sep 11 17:25:03.091954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.091933    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jspzc"
Sep 11 17:25:03.094468 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.094445    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-59dkt\""
Sep 11 17:25:03.102783 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.102764    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jspzc"]
Sep 11 17:25:03.226637 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.226599    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ng8nv\" (UniqueName: \"kubernetes.io/projected/26c64e4a-df88-4556-be65-b052b7b6187a-kube-api-access-ng8nv\") pod \"cert-manager-55b4d954d5-jspzc\" (UID: \"26c64e4a-df88-4556-be65-b052b7b6187a\") " pod="cert-manager/cert-manager-55b4d954d5-jspzc"
Sep 11 17:25:03.226637 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.226643    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c64e4a-df88-4556-be65-b052b7b6187a-bound-sa-token\") pod \"cert-manager-55b4d954d5-jspzc\" (UID: \"26c64e4a-df88-4556-be65-b052b7b6187a\") " pod="cert-manager/cert-manager-55b4d954d5-jspzc"
Sep 11 17:25:03.327570 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.327533    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ng8nv\" (UniqueName: \"kubernetes.io/projected/26c64e4a-df88-4556-be65-b052b7b6187a-kube-api-access-ng8nv\") pod \"cert-manager-55b4d954d5-jspzc\" (UID: \"26c64e4a-df88-4556-be65-b052b7b6187a\") " pod="cert-manager/cert-manager-55b4d954d5-jspzc"
Sep 11 17:25:03.327570 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.327577    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c64e4a-df88-4556-be65-b052b7b6187a-bound-sa-token\") pod \"cert-manager-55b4d954d5-jspzc\" (UID: \"26c64e4a-df88-4556-be65-b052b7b6187a\") " pod="cert-manager/cert-manager-55b4d954d5-jspzc"
Sep 11 17:25:03.336427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.336385    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ng8nv\" (UniqueName: \"kubernetes.io/projected/26c64e4a-df88-4556-be65-b052b7b6187a-kube-api-access-ng8nv\") pod \"cert-manager-55b4d954d5-jspzc\" (UID: \"26c64e4a-df88-4556-be65-b052b7b6187a\") " pod="cert-manager/cert-manager-55b4d954d5-jspzc"
Sep 11 17:25:03.336427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.336390    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/26c64e4a-df88-4556-be65-b052b7b6187a-bound-sa-token\") pod \"cert-manager-55b4d954d5-jspzc\" (UID: \"26c64e4a-df88-4556-be65-b052b7b6187a\") " pod="cert-manager/cert-manager-55b4d954d5-jspzc"
Sep 11 17:25:03.400411 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.400367    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-jspzc"
Sep 11 17:25:03.671109 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.670964    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-jspzc"]
Sep 11 17:25:03.673616 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:25:03.673590    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26c64e4a_df88_4556_be65_b052b7b6187a.slice/crio-7bcbb509be562502b5ae5a7eae3c7307a002034a520f0e190952e87da9c82f59 WatchSource:0}: Error finding container 7bcbb509be562502b5ae5a7eae3c7307a002034a520f0e190952e87da9c82f59: Status 404 returned error can't find the container with id 7bcbb509be562502b5ae5a7eae3c7307a002034a520f0e190952e87da9c82f59
Sep 11 17:25:03.864914 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.864884    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-rjljs"
Sep 11 17:25:03.887720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.887693    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jspzc" event={"ID":"26c64e4a-df88-4556-be65-b052b7b6187a","Type":"ContainerStarted","Data":"5ddee22c757477ba6150984161904c3fb3bc33a88e522d1d055d67ff642d8957"}
Sep 11 17:25:03.887852 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.887732    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-jspzc" event={"ID":"26c64e4a-df88-4556-be65-b052b7b6187a","Type":"ContainerStarted","Data":"7bcbb509be562502b5ae5a7eae3c7307a002034a520f0e190952e87da9c82f59"}
Sep 11 17:25:03.911365 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:03.911317    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-jspzc" podStartSLOduration=0.911302473 podStartE2EDuration="911.302473ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:25:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:25:03.9094599 +0000 UTC m=+278.864156488" watchObservedRunningTime="2026-09-11 17:25:03.911302473 +0000 UTC m=+278.865992374"
Sep 11 17:25:15.270178 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.270140    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"]
Sep 11 17:25:15.274878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.274859    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.277321 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.277295    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7xk7d\""
Sep 11 17:25:15.277451 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.277327    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 17:25:15.278248 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.278230    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 17:25:15.283980 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.283957    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"]
Sep 11 17:25:15.411170 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.411134    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qlzwd\" (UniqueName: \"kubernetes.io/projected/1263d228-1d9d-46ca-a18e-edbc9a6b6884-kube-api-access-qlzwd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.411373 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.411188    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.411373 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.411259    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.511646 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.511603    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.511803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.511658    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.511803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.511709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qlzwd\" (UniqueName: \"kubernetes.io/projected/1263d228-1d9d-46ca-a18e-edbc9a6b6884-kube-api-access-qlzwd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.512005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.511984    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.512045 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.512009    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.522369 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.522321    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qlzwd\" (UniqueName: \"kubernetes.io/projected/1263d228-1d9d-46ca-a18e-edbc9a6b6884-kube-api-access-qlzwd\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.584768 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.584730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:15.856687 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.856606    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"]
Sep 11 17:25:15.935066 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.935028    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v" event={"ID":"1263d228-1d9d-46ca-a18e-edbc9a6b6884","Type":"ContainerStarted","Data":"3844e89a0ef558c5aa8bc862d6603ac0b7372828561735e1b5c379932aa9258d"}
Sep 11 17:25:15.935216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:15.935086    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v" event={"ID":"1263d228-1d9d-46ca-a18e-edbc9a6b6884","Type":"ContainerStarted","Data":"9e09f6849dc7b4ffcdce8d070a2fa2a3da8d334ed5230bcd94bd7e85bab3ac19"}
Sep 11 17:25:16.940224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:16.940185    2584 generic.go:356] "Generic (PLEG): container finished" podID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerID="3844e89a0ef558c5aa8bc862d6603ac0b7372828561735e1b5c379932aa9258d" exitCode=0
Sep 11 17:25:16.940627 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:16.940259    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v" event={"ID":"1263d228-1d9d-46ca-a18e-edbc9a6b6884","Type":"ContainerDied","Data":"3844e89a0ef558c5aa8bc862d6603ac0b7372828561735e1b5c379932aa9258d"}
Sep 11 17:25:17.946126 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:17.946090    2584 generic.go:356] "Generic (PLEG): container finished" podID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerID="8ed6e21fb2cfd7f0c46887b360c6a15f07b738c9b554d2e423da52f68240dfcf" exitCode=0
Sep 11 17:25:17.946530 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:17.946150    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v" event={"ID":"1263d228-1d9d-46ca-a18e-edbc9a6b6884","Type":"ContainerDied","Data":"8ed6e21fb2cfd7f0c46887b360c6a15f07b738c9b554d2e423da52f68240dfcf"}
Sep 11 17:25:18.955930 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:18.955900    2584 generic.go:356] "Generic (PLEG): container finished" podID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerID="c67a9ce40fe1c27a9ee402ee031ad5ae3af55798274ca6f65aa8068d0877fa26" exitCode=0
Sep 11 17:25:18.956307 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:18.955993    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v" event={"ID":"1263d228-1d9d-46ca-a18e-edbc9a6b6884","Type":"ContainerDied","Data":"c67a9ce40fe1c27a9ee402ee031ad5ae3af55798274ca6f65aa8068d0877fa26"}
Sep 11 17:25:20.077631 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.077599    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:20.145028 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.144995    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-util\") pod \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") "
Sep 11 17:25:20.145213 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.145058    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-bundle\") pod \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") "
Sep 11 17:25:20.145213 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.145088    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qlzwd\" (UniqueName: \"kubernetes.io/projected/1263d228-1d9d-46ca-a18e-edbc9a6b6884-kube-api-access-qlzwd\") pod \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\" (UID: \"1263d228-1d9d-46ca-a18e-edbc9a6b6884\") "
Sep 11 17:25:20.145793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.145762    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-bundle" (OuterVolumeSpecName: "bundle") pod "1263d228-1d9d-46ca-a18e-edbc9a6b6884" (UID: "1263d228-1d9d-46ca-a18e-edbc9a6b6884"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:25:20.147271 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.147242    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1263d228-1d9d-46ca-a18e-edbc9a6b6884-kube-api-access-qlzwd" (OuterVolumeSpecName: "kube-api-access-qlzwd") pod "1263d228-1d9d-46ca-a18e-edbc9a6b6884" (UID: "1263d228-1d9d-46ca-a18e-edbc9a6b6884"). InnerVolumeSpecName "kube-api-access-qlzwd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:25:20.150915 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.150872    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-util" (OuterVolumeSpecName: "util") pod "1263d228-1d9d-46ca-a18e-edbc9a6b6884" (UID: "1263d228-1d9d-46ca-a18e-edbc9a6b6884"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:25:20.246200 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.246102    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:20.246200 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.246146    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1263d228-1d9d-46ca-a18e-edbc9a6b6884-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:20.246200 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.246156    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qlzwd\" (UniqueName: \"kubernetes.io/projected/1263d228-1d9d-46ca-a18e-edbc9a6b6884-kube-api-access-qlzwd\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:20.965649 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.965613    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v" event={"ID":"1263d228-1d9d-46ca-a18e-edbc9a6b6884","Type":"ContainerDied","Data":"9e09f6849dc7b4ffcdce8d070a2fa2a3da8d334ed5230bcd94bd7e85bab3ac19"}
Sep 11 17:25:20.965649 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.965648    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af7dh5v"
Sep 11 17:25:20.965857 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:20.965659    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e09f6849dc7b4ffcdce8d070a2fa2a3da8d334ed5230bcd94bd7e85bab3ac19"
Sep 11 17:25:25.476580 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:25.476552    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:25:25.478363 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:25.478332    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:25:25.481309 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:25.481290    2584 kubelet.go:1648] "Image garbage collection succeeded"
Sep 11 17:25:26.805309 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.805277    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"]
Sep 11 17:25:26.807681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.805535    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerName="util"
Sep 11 17:25:26.807681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.805549    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerName="util"
Sep 11 17:25:26.807681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.805562    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerName="extract"
Sep 11 17:25:26.807681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.805567    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerName="extract"
Sep 11 17:25:26.807681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.805577    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerName="pull"
Sep 11 17:25:26.807681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.805583    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerName="pull"
Sep 11 17:25:26.807681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.805626    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1263d228-1d9d-46ca-a18e-edbc9a6b6884" containerName="extract"
Sep 11 17:25:26.808519 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.808503    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:26.811166 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.811145    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 17:25:26.811166 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.811163    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 17:25:26.811330 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.811183    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7xk7d\""
Sep 11 17:25:26.819785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.819764    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"]
Sep 11 17:25:26.891006 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.890977    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkzcb\" (UniqueName: \"kubernetes.io/projected/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-kube-api-access-kkzcb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:26.891161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.891016    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:26.891161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.891048    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:26.991603 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.991570    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkzcb\" (UniqueName: \"kubernetes.io/projected/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-kube-api-access-kkzcb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:26.991776 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.991615    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:26.991776 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.991658    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:26.992065 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.992046    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:26.992114 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:26.992062    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:27.000812 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:27.000785    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkzcb\" (UniqueName: \"kubernetes.io/projected/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-kube-api-access-kkzcb\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:27.117455 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:27.117348    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:27.390135 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:27.390097    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"]
Sep 11 17:25:27.392583 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:25:27.392557    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83eab27e_c6f2_4b70_8fe1_ec5e95b78cb2.slice/crio-2d196ec4939304055e07052e11874f5a7bc70bf09941293f41eb262117cdb1c5 WatchSource:0}: Error finding container 2d196ec4939304055e07052e11874f5a7bc70bf09941293f41eb262117cdb1c5: Status 404 returned error can't find the container with id 2d196ec4939304055e07052e11874f5a7bc70bf09941293f41eb262117cdb1c5
Sep 11 17:25:27.996816 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:27.996779    2584 generic.go:356] "Generic (PLEG): container finished" podID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerID="81e39854283ca1a0171eee83508cc1bad3d87aa0c8d0dfbcde5537f6629f1d28" exitCode=0
Sep 11 17:25:27.997226 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:27.996851    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg" event={"ID":"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2","Type":"ContainerDied","Data":"81e39854283ca1a0171eee83508cc1bad3d87aa0c8d0dfbcde5537f6629f1d28"}
Sep 11 17:25:27.997226 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:27.996923    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg" event={"ID":"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2","Type":"ContainerStarted","Data":"2d196ec4939304055e07052e11874f5a7bc70bf09941293f41eb262117cdb1c5"}
Sep 11 17:25:27.997533 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:27.997519    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:25:28.473340 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.473306    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"]
Sep 11 17:25:28.478343 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.478318    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.481218 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.481188    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 11 17:25:28.481580 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.481550    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 11 17:25:28.481687 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.481554    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 11 17:25:28.481687 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.481627    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-hw64m\""
Sep 11 17:25:28.481791 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.481690    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 11 17:25:28.500882 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.500806    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"]
Sep 11 17:25:28.604465 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.604430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/462df59f-dcd2-4740-aab4-e16db497bdeb-manifests\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.604628 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.604472    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/462df59f-dcd2-4740-aab4-e16db497bdeb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.604628 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.604523    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/462df59f-dcd2-4740-aab4-e16db497bdeb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.604628 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.604572    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/462df59f-dcd2-4740-aab4-e16db497bdeb-tmp\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.604628 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.604612    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7wx9\" (UniqueName: \"kubernetes.io/projected/462df59f-dcd2-4740-aab4-e16db497bdeb-kube-api-access-s7wx9\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.705810 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.705779    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/462df59f-dcd2-4740-aab4-e16db497bdeb-manifests\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.705924 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.705827    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/462df59f-dcd2-4740-aab4-e16db497bdeb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.705924 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.705854    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/462df59f-dcd2-4740-aab4-e16db497bdeb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.705924 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.705894    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/462df59f-dcd2-4740-aab4-e16db497bdeb-tmp\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.706082 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.705926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7wx9\" (UniqueName: \"kubernetes.io/projected/462df59f-dcd2-4740-aab4-e16db497bdeb-kube-api-access-s7wx9\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.706310 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.706242    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/462df59f-dcd2-4740-aab4-e16db497bdeb-manifests\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.708250 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.708230    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/462df59f-dcd2-4740-aab4-e16db497bdeb-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.708508 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.708489    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/462df59f-dcd2-4740-aab4-e16db497bdeb-tmp\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.708663 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.708648    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/462df59f-dcd2-4740-aab4-e16db497bdeb-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.716884 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.716861    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7wx9\" (UniqueName: \"kubernetes.io/projected/462df59f-dcd2-4740-aab4-e16db497bdeb-kube-api-access-s7wx9\") pod \"opendatahub-operator-controller-manager-7f9c58fc78-vf255\" (UID: \"462df59f-dcd2-4740-aab4-e16db497bdeb\") " pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:28.788915 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:28.788837    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:29.003599 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:29.003568    2584 generic.go:356] "Generic (PLEG): container finished" podID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerID="fa30dfd5ee03de0bbc786ef7b28dd23345f234fb4c567d207168f536af8b0e97" exitCode=0
Sep 11 17:25:29.003967 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:29.003654    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg" event={"ID":"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2","Type":"ContainerDied","Data":"fa30dfd5ee03de0bbc786ef7b28dd23345f234fb4c567d207168f536af8b0e97"}
Sep 11 17:25:29.097938 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:29.097911    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"]
Sep 11 17:25:29.099828 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:25:29.099796    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod462df59f_dcd2_4740_aab4_e16db497bdeb.slice/crio-75d7e34a79d8464ef8873fea891d3eea8efd30df576758547435b17f829706e7 WatchSource:0}: Error finding container 75d7e34a79d8464ef8873fea891d3eea8efd30df576758547435b17f829706e7: Status 404 returned error can't find the container with id 75d7e34a79d8464ef8873fea891d3eea8efd30df576758547435b17f829706e7
Sep 11 17:25:30.011575 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:30.011532    2584 generic.go:356] "Generic (PLEG): container finished" podID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerID="6da7629dd69c913fbb0823847b0f66f09fb448066cd76fd07370fbe46717fb75" exitCode=0
Sep 11 17:25:30.012032 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:30.011648    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg" event={"ID":"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2","Type":"ContainerDied","Data":"6da7629dd69c913fbb0823847b0f66f09fb448066cd76fd07370fbe46717fb75"}
Sep 11 17:25:30.013287 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:30.013196    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255" event={"ID":"462df59f-dcd2-4740-aab4-e16db497bdeb","Type":"ContainerStarted","Data":"75d7e34a79d8464ef8873fea891d3eea8efd30df576758547435b17f829706e7"}
Sep 11 17:25:32.064081 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.064056    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:32.132394 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.132374    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-util\") pod \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") "
Sep 11 17:25:32.132508 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.132460    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkzcb\" (UniqueName: \"kubernetes.io/projected/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-kube-api-access-kkzcb\") pod \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") "
Sep 11 17:25:32.132577 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.132517    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-bundle\") pod \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\" (UID: \"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2\") "
Sep 11 17:25:32.133395 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.133364    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-bundle" (OuterVolumeSpecName: "bundle") pod "83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" (UID: "83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:25:32.134752 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.134727    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-kube-api-access-kkzcb" (OuterVolumeSpecName: "kube-api-access-kkzcb") pod "83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" (UID: "83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2"). InnerVolumeSpecName "kube-api-access-kkzcb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:25:32.138702 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.138677    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-util" (OuterVolumeSpecName: "util") pod "83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" (UID: "83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:25:32.233445 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.233396    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:32.233445 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.233438    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:32.233610 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:32.233478    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkzcb\" (UniqueName: \"kubernetes.io/projected/83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2-kube-api-access-kkzcb\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:25:33.027966 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:33.027933    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg"
Sep 11 17:25:33.028121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:33.027941    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b04pblg" event={"ID":"83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2","Type":"ContainerDied","Data":"2d196ec4939304055e07052e11874f5a7bc70bf09941293f41eb262117cdb1c5"}
Sep 11 17:25:33.028121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:33.028049    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2d196ec4939304055e07052e11874f5a7bc70bf09941293f41eb262117cdb1c5"
Sep 11 17:25:33.029595 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:33.029565    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255" event={"ID":"462df59f-dcd2-4740-aab4-e16db497bdeb","Type":"ContainerStarted","Data":"9432fea14158051f2303e6d9898f7a352dd6f259df9cfaa7695714b164e67baa"}
Sep 11 17:25:34.035009 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:34.034970    2584 generic.go:356] "Generic (PLEG): container finished" podID="462df59f-dcd2-4740-aab4-e16db497bdeb" containerID="9432fea14158051f2303e6d9898f7a352dd6f259df9cfaa7695714b164e67baa" exitCode=0
Sep 11 17:25:34.035472 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:34.035044    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255" event={"ID":"462df59f-dcd2-4740-aab4-e16db497bdeb","Type":"ContainerDied","Data":"9432fea14158051f2303e6d9898f7a352dd6f259df9cfaa7695714b164e67baa"}
Sep 11 17:25:35.041076 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:35.041038    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255" event={"ID":"462df59f-dcd2-4740-aab4-e16db497bdeb","Type":"ContainerStarted","Data":"c4a88a3a08047f00c4cd9fd87e86c6edf281309a9a61330a562589b565c3114c"}
Sep 11 17:25:35.041561 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:35.041129    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:35.066996 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:35.066948    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255" podStartSLOduration=2.647791086 podStartE2EDuration="7.066934071s" totalImagesPullingTime="3.400947299s" totalInitContainerRuntime="1.018195686s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:25:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:25:35.065353097 +0000 UTC m=+310.020042999" watchObservedRunningTime="2026-09-11 17:25:35.066934071 +0000 UTC m=+310.021623973"
Sep 11 17:25:46.047513 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:46.047478    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f9c58fc78-vf255"
Sep 11 17:25:58.723207 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.723178    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"]
Sep 11 17:25:58.723684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.723432    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerName="util"
Sep 11 17:25:58.723684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.723444    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerName="util"
Sep 11 17:25:58.723684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.723451    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerName="pull"
Sep 11 17:25:58.723684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.723457    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerName="pull"
Sep 11 17:25:58.723684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.723465    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerName="extract"
Sep 11 17:25:58.723684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.723471    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerName="extract"
Sep 11 17:25:58.723684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.723526    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="83eab27e-c6f2-4b70-8fe1-ec5e95b78cb2" containerName="extract"
Sep 11 17:25:58.725910 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.725894    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:58.729315 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.729293    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 11 17:25:58.730251 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.730217    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 11 17:25:58.730354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.730235    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 11 17:25:58.730707 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.730691    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 11 17:25:58.730783 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.730694    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jdklt\""
Sep 11 17:25:58.748716 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.748692    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"]
Sep 11 17:25:58.835136 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.835109    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tls-certs\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:58.835289 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.835141    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jt97\" (UniqueName: \"kubernetes.io/projected/ca9f7417-fbc4-4fc3-97b1-f8159203e894-kube-api-access-8jt97\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:58.835289 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.835171    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tmp\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:58.935946 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.935906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jt97\" (UniqueName: \"kubernetes.io/projected/ca9f7417-fbc4-4fc3-97b1-f8159203e894-kube-api-access-8jt97\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:58.936133 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.935963    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tmp\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:58.936133 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.936023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tls-certs\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:58.936252 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:25:58.936137    2584 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found
Sep 11 17:25:58.936252 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:25:58.936220    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tls-certs podName:ca9f7417-fbc4-4fc3-97b1-f8159203e894 nodeName:}" failed. No retries permitted until 2026-09-11 17:25:59.436198532 +0000 UTC m=+334.390888430 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tls-certs") pod "kube-auth-proxy-5897fcd6c7-pglzr" (UID: "ca9f7417-fbc4-4fc3-97b1-f8159203e894") : secret "kube-auth-proxy-tls" not found
Sep 11 17:25:58.938243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.938222    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tmp\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:58.956776 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:58.956743    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jt97\" (UniqueName: \"kubernetes.io/projected/ca9f7417-fbc4-4fc3-97b1-f8159203e894-kube-api-access-8jt97\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:59.438801 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.438762    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tls-certs\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:59.441423 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.441389    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca9f7417-fbc4-4fc3-97b1-f8159203e894-tls-certs\") pod \"kube-auth-proxy-5897fcd6c7-pglzr\" (UID: \"ca9f7417-fbc4-4fc3-97b1-f8159203e894\") " pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:59.634814 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.634779    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"
Sep 11 17:25:59.777453 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.777420    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vq8bj"]
Sep 11 17:25:59.780668 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.780651    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:25:59.783646 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.783626    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Sep 11 17:25:59.783748 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.783647    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-dnzk7\""
Sep 11 17:25:59.793057 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.793040    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vq8bj"]
Sep 11 17:25:59.913149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.913120    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr"]
Sep 11 17:25:59.915453 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:25:59.915426    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9f7417_fbc4_4fc3_97b1_f8159203e894.slice/crio-bd5966dbc7d2495d0bc22b5fafe6483debe5d4de6e1d19123ed87200d526da92 WatchSource:0}: Error finding container bd5966dbc7d2495d0bc22b5fafe6483debe5d4de6e1d19123ed87200d526da92: Status 404 returned error can't find the container with id bd5966dbc7d2495d0bc22b5fafe6483debe5d4de6e1d19123ed87200d526da92
Sep 11 17:25:59.941737 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.941671    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9ecad63-6265-446d-9a3f-713400475fc2-tls-certs\") pod \"model-serving-api-54d89bd5fc-vq8bj\" (UID: \"a9ecad63-6265-446d-9a3f-713400475fc2\") " pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:25:59.941737 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:25:59.941718    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qms7n\" (UniqueName: \"kubernetes.io/projected/a9ecad63-6265-446d-9a3f-713400475fc2-kube-api-access-qms7n\") pod \"model-serving-api-54d89bd5fc-vq8bj\" (UID: \"a9ecad63-6265-446d-9a3f-713400475fc2\") " pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:26:00.043061 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.043023    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9ecad63-6265-446d-9a3f-713400475fc2-tls-certs\") pod \"model-serving-api-54d89bd5fc-vq8bj\" (UID: \"a9ecad63-6265-446d-9a3f-713400475fc2\") " pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:26:00.043231 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.043079    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qms7n\" (UniqueName: \"kubernetes.io/projected/a9ecad63-6265-446d-9a3f-713400475fc2-kube-api-access-qms7n\") pod \"model-serving-api-54d89bd5fc-vq8bj\" (UID: \"a9ecad63-6265-446d-9a3f-713400475fc2\") " pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:26:00.045547 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.045524    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a9ecad63-6265-446d-9a3f-713400475fc2-tls-certs\") pod \"model-serving-api-54d89bd5fc-vq8bj\" (UID: \"a9ecad63-6265-446d-9a3f-713400475fc2\") " pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:26:00.057579 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.057553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qms7n\" (UniqueName: \"kubernetes.io/projected/a9ecad63-6265-446d-9a3f-713400475fc2-kube-api-access-qms7n\") pod \"model-serving-api-54d89bd5fc-vq8bj\" (UID: \"a9ecad63-6265-446d-9a3f-713400475fc2\") " pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:26:00.090059 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.090027    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:26:00.155102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.155054    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr" event={"ID":"ca9f7417-fbc4-4fc3-97b1-f8159203e894","Type":"ContainerStarted","Data":"bd5966dbc7d2495d0bc22b5fafe6483debe5d4de6e1d19123ed87200d526da92"}
Sep 11 17:26:00.256358 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.256287    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"]
Sep 11 17:26:00.259521 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.259505    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.263736 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.263708    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 11 17:26:00.263844 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.263717    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 11 17:26:00.263844 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.263784    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-5b6fj\""
Sep 11 17:26:00.263844 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.263816    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 11 17:26:00.264044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.264027    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 17:26:00.278586 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.278565    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"]
Sep 11 17:26:00.365518 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.365494    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-vq8bj"]
Sep 11 17:26:00.367568 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:26:00.367543    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9ecad63_6265_446d_9a3f_713400475fc2.slice/crio-dbbdbd0af0bcc89a75f71350c1f97c592063bc1ece66d47a06e7d71c8752e113 WatchSource:0}: Error finding container dbbdbd0af0bcc89a75f71350c1f97c592063bc1ece66d47a06e7d71c8752e113: Status 404 returned error can't find the container with id dbbdbd0af0bcc89a75f71350c1f97c592063bc1ece66d47a06e7d71c8752e113
Sep 11 17:26:00.446581 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.446549    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.446694 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.446588    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.446694 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.446611    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f8b21e-15e0-43f6-93c1-338580b0318f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.446694 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.446663    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fpbz6\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-kube-api-access-fpbz6\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.446694 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.446692    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.446847 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.446710    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.446847 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.446744    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.547463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.547363    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.547463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.547414    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f8b21e-15e0-43f6-93c1-338580b0318f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.547463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.547441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fpbz6\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-kube-api-access-fpbz6\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.547463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.547466    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.547835 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.547482    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.547835 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.547525    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.547835 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.547597    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.548131 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.548108    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.549902 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.549870    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.550004 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.549928    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f8b21e-15e0-43f6-93c1-338580b0318f-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.550004 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.549953    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.550081 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.550055    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.556766 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.556747    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.557168 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.557152    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fpbz6\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-kube-api-access-fpbz6\") pod \"istiod-openshift-gateway-7b7995d5cd-bvvh4\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.569005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.568987    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:00.856439 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:00.856240    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"]
Sep 11 17:26:00.859190 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:26:00.859157    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f8b21e_15e0_43f6_93c1_338580b0318f.slice/crio-1893947d200a95cde6861baae502ba2f34d0cfe564f04a4d65b8d284b66d47ae WatchSource:0}: Error finding container 1893947d200a95cde6861baae502ba2f34d0cfe564f04a4d65b8d284b66d47ae: Status 404 returned error can't find the container with id 1893947d200a95cde6861baae502ba2f34d0cfe564f04a4d65b8d284b66d47ae
Sep 11 17:26:01.162896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:01.162809    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4" event={"ID":"22f8b21e-15e0-43f6-93c1-338580b0318f","Type":"ContainerStarted","Data":"1893947d200a95cde6861baae502ba2f34d0cfe564f04a4d65b8d284b66d47ae"}
Sep 11 17:26:01.164727 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:01.164613    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj" event={"ID":"a9ecad63-6265-446d-9a3f-713400475fc2","Type":"ContainerStarted","Data":"dbbdbd0af0bcc89a75f71350c1f97c592063bc1ece66d47a06e7d71c8752e113"}
Sep 11 17:26:04.183104 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:04.183065    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr" event={"ID":"ca9f7417-fbc4-4fc3-97b1-f8159203e894","Type":"ContainerStarted","Data":"f67ea7f0771cd1b30f34a0ed9f60bd715edc8bef963bb73846f18dc8b5e62539"}
Sep 11 17:26:04.185056 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:04.185027    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj" event={"ID":"a9ecad63-6265-446d-9a3f-713400475fc2","Type":"ContainerStarted","Data":"793a2df22787ba7c57c010cc4a5e01419ea240bd485d28d6c19e54d1319d7a5f"}
Sep 11 17:26:04.185151 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:04.185088    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:26:04.206368 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:04.206314    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5897fcd6c7-pglzr" podStartSLOduration=2.756051162 podStartE2EDuration="6.206296954s" totalImagesPullingTime="3.450245792s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:25:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:26:04.204263181 +0000 UTC m=+339.158953084" watchObservedRunningTime="2026-09-11 17:26:04.206296954 +0000 UTC m=+339.160986856"
Sep 11 17:26:04.231657 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:04.231595    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj" podStartSLOduration=2.23216029 podStartE2EDuration="5.231573785s" totalImagesPullingTime="2.999413495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:25:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:26:04.228636081 +0000 UTC m=+339.183325997" watchObservedRunningTime="2026-09-11 17:26:04.231573785 +0000 UTC m=+339.186263689"
Sep 11 17:26:04.806913 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:04.806874    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:26:04.806999 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:04.806945    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:26:05.191988 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:05.191949    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4" event={"ID":"22f8b21e-15e0-43f6-93c1-338580b0318f","Type":"ContainerStarted","Data":"5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6"}
Sep 11 17:26:05.192488 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:05.192303    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:05.193741 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:05.193712    2584 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-bvvh4 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 17:26:05.193906 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:05.193762    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4" podUID="22f8b21e-15e0-43f6-93c1-338580b0318f" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:26:05.223904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:05.223837    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4" podStartSLOduration=1.279591509 podStartE2EDuration="5.223815745s" totalImagesPullingTime="3.944224236s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:26:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:26:05.220729172 +0000 UTC m=+340.175419075" watchObservedRunningTime="2026-09-11 17:26:05.223815745 +0000 UTC m=+340.178505647"
Sep 11 17:26:06.196599 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:06.196571    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:10.663560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.663519    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"]
Sep 11 17:26:10.671631 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.671590    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:10.672808 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.672775    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"]
Sep 11 17:26:10.676912 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.676882    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\""
Sep 11 17:26:10.677036 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.676934    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rxs8q\""
Sep 11 17:26:10.677174 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.677158    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:10.680825 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.680802    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 11 17:26:10.681298 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.681281    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-9hlk5\""
Sep 11 17:26:10.682913 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.682892    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"]
Sep 11 17:26:10.686764 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.686745    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"]
Sep 11 17:26:10.728802 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.728765    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmxqb\" (UniqueName: \"kubernetes.io/projected/00a3cf78-ed52-453e-a0a4-b6f41862e4af-kube-api-access-kmxqb\") pod \"kserve-controller-manager-d6f4b65b8-zw4gp\" (UID: \"00a3cf78-ed52-453e-a0a4-b6f41862e4af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:10.728974 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.728822    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00a3cf78-ed52-453e-a0a4-b6f41862e4af-cert\") pod \"kserve-controller-manager-d6f4b65b8-zw4gp\" (UID: \"00a3cf78-ed52-453e-a0a4-b6f41862e4af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:10.728974 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.728868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3154c84-43fc-4b4c-b143-addf184d064e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n7vtq\" (UID: \"c3154c84-43fc-4b4c-b143-addf184d064e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:10.728974 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.728910    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gtj75\" (UniqueName: \"kubernetes.io/projected/c3154c84-43fc-4b4c-b143-addf184d064e-kube-api-access-gtj75\") pod \"llmisvc-controller-manager-777c6bd7d5-n7vtq\" (UID: \"c3154c84-43fc-4b4c-b143-addf184d064e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:10.830204 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.830165    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmxqb\" (UniqueName: \"kubernetes.io/projected/00a3cf78-ed52-453e-a0a4-b6f41862e4af-kube-api-access-kmxqb\") pod \"kserve-controller-manager-d6f4b65b8-zw4gp\" (UID: \"00a3cf78-ed52-453e-a0a4-b6f41862e4af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:10.830367 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.830216    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00a3cf78-ed52-453e-a0a4-b6f41862e4af-cert\") pod \"kserve-controller-manager-d6f4b65b8-zw4gp\" (UID: \"00a3cf78-ed52-453e-a0a4-b6f41862e4af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:10.830367 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.830242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3154c84-43fc-4b4c-b143-addf184d064e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n7vtq\" (UID: \"c3154c84-43fc-4b4c-b143-addf184d064e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:10.830367 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.830266    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gtj75\" (UniqueName: \"kubernetes.io/projected/c3154c84-43fc-4b4c-b143-addf184d064e-kube-api-access-gtj75\") pod \"llmisvc-controller-manager-777c6bd7d5-n7vtq\" (UID: \"c3154c84-43fc-4b4c-b143-addf184d064e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:10.830487 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:26:10.830385    2584 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found
Sep 11 17:26:10.830487 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:26:10.830482    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3154c84-43fc-4b4c-b143-addf184d064e-cert podName:c3154c84-43fc-4b4c-b143-addf184d064e nodeName:}" failed. No retries permitted until 2026-09-11 17:26:11.330466641 +0000 UTC m=+346.285156524 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/c3154c84-43fc-4b4c-b143-addf184d064e-cert") pod "llmisvc-controller-manager-777c6bd7d5-n7vtq" (UID: "c3154c84-43fc-4b4c-b143-addf184d064e") : secret "llmisvc-webhook-server-cert" not found
Sep 11 17:26:10.830555 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:26:10.830385    2584 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found
Sep 11 17:26:10.830587 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:26:10.830567    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00a3cf78-ed52-453e-a0a4-b6f41862e4af-cert podName:00a3cf78-ed52-453e-a0a4-b6f41862e4af nodeName:}" failed. No retries permitted until 2026-09-11 17:26:11.330552373 +0000 UTC m=+346.285242257 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/00a3cf78-ed52-453e-a0a4-b6f41862e4af-cert") pod "kserve-controller-manager-d6f4b65b8-zw4gp" (UID: "00a3cf78-ed52-453e-a0a4-b6f41862e4af") : secret "kserve-webhook-server-cert" not found
Sep 11 17:26:10.843495 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.843464    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gtj75\" (UniqueName: \"kubernetes.io/projected/c3154c84-43fc-4b4c-b143-addf184d064e-kube-api-access-gtj75\") pod \"llmisvc-controller-manager-777c6bd7d5-n7vtq\" (UID: \"c3154c84-43fc-4b4c-b143-addf184d064e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:10.850257 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:10.850229    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmxqb\" (UniqueName: \"kubernetes.io/projected/00a3cf78-ed52-453e-a0a4-b6f41862e4af-kube-api-access-kmxqb\") pod \"kserve-controller-manager-d6f4b65b8-zw4gp\" (UID: \"00a3cf78-ed52-453e-a0a4-b6f41862e4af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:11.334992 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:11.334961    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3154c84-43fc-4b4c-b143-addf184d064e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n7vtq\" (UID: \"c3154c84-43fc-4b4c-b143-addf184d064e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:11.335178 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:11.335031    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00a3cf78-ed52-453e-a0a4-b6f41862e4af-cert\") pod \"kserve-controller-manager-d6f4b65b8-zw4gp\" (UID: \"00a3cf78-ed52-453e-a0a4-b6f41862e4af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:11.337384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:11.337356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/00a3cf78-ed52-453e-a0a4-b6f41862e4af-cert\") pod \"kserve-controller-manager-d6f4b65b8-zw4gp\" (UID: \"00a3cf78-ed52-453e-a0a4-b6f41862e4af\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:11.337515 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:11.337453    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c3154c84-43fc-4b4c-b143-addf184d064e-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-n7vtq\" (UID: \"c3154c84-43fc-4b4c-b143-addf184d064e\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:11.589076 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:11.588988    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:11.595153 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:11.595131    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:11.869874 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:11.869849    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"]
Sep 11 17:26:11.871910 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:26:11.871885    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00a3cf78_ed52_453e_a0a4_b6f41862e4af.slice/crio-f35be8f08ca00b9920509fd30c2467812cbc5fa0b5133b230178c01696553fa7 WatchSource:0}: Error finding container f35be8f08ca00b9920509fd30c2467812cbc5fa0b5133b230178c01696553fa7: Status 404 returned error can't find the container with id f35be8f08ca00b9920509fd30c2467812cbc5fa0b5133b230178c01696553fa7
Sep 11 17:26:11.877341 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:11.877314    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"]
Sep 11 17:26:11.878730 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:26:11.878707    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc3154c84_43fc_4b4c_b143_addf184d064e.slice/crio-2662899946e746ced7ee8919327a2fff34ecab51ea72a5045a8adfff7d8b2e33 WatchSource:0}: Error finding container 2662899946e746ced7ee8919327a2fff34ecab51ea72a5045a8adfff7d8b2e33: Status 404 returned error can't find the container with id 2662899946e746ced7ee8919327a2fff34ecab51ea72a5045a8adfff7d8b2e33
Sep 11 17:26:12.223630 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:12.223597    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq" event={"ID":"c3154c84-43fc-4b4c-b143-addf184d064e","Type":"ContainerStarted","Data":"2662899946e746ced7ee8919327a2fff34ecab51ea72a5045a8adfff7d8b2e33"}
Sep 11 17:26:12.224841 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:12.224808    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp" event={"ID":"00a3cf78-ed52-453e-a0a4-b6f41862e4af","Type":"ContainerStarted","Data":"f35be8f08ca00b9920509fd30c2467812cbc5fa0b5133b230178c01696553fa7"}
Sep 11 17:26:13.361706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:13.361669    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"]
Sep 11 17:26:13.362163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:13.361896    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4" podUID="22f8b21e-15e0-43f6-93c1-338580b0318f" containerName="discovery" containerID="cri-o://5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6" gracePeriod=30
Sep 11 17:26:14.075070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.075043    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:14.160266 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.160238    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f8b21e-15e0-43f6-93c1-338580b0318f-local-certs\") pod \"22f8b21e-15e0-43f6-93c1-338580b0318f\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") "
Sep 11 17:26:14.160435 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.160329    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fpbz6\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-kube-api-access-fpbz6\") pod \"22f8b21e-15e0-43f6-93c1-338580b0318f\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") "
Sep 11 17:26:14.160435 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.160374    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-ca-configmap\") pod \"22f8b21e-15e0-43f6-93c1-338580b0318f\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") "
Sep 11 17:26:14.160551 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.160432    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-cacerts\") pod \"22f8b21e-15e0-43f6-93c1-338580b0318f\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") "
Sep 11 17:26:14.160551 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.160454    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-kubeconfig\") pod \"22f8b21e-15e0-43f6-93c1-338580b0318f\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") "
Sep 11 17:26:14.160551 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.160477    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-dns-cert\") pod \"22f8b21e-15e0-43f6-93c1-338580b0318f\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") "
Sep 11 17:26:14.161102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.160930    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "22f8b21e-15e0-43f6-93c1-338580b0318f" (UID: "22f8b21e-15e0-43f6-93c1-338580b0318f"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:26:14.161102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.160994    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-token\") pod \"22f8b21e-15e0-43f6-93c1-338580b0318f\" (UID: \"22f8b21e-15e0-43f6-93c1-338580b0318f\") "
Sep 11 17:26:14.161270 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.161219    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-ca-configmap\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:26:14.163246 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.163199    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-cacerts" (OuterVolumeSpecName: "cacerts") pod "22f8b21e-15e0-43f6-93c1-338580b0318f" (UID: "22f8b21e-15e0-43f6-93c1-338580b0318f"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:26:14.163433 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.163391    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22f8b21e-15e0-43f6-93c1-338580b0318f-local-certs" (OuterVolumeSpecName: "local-certs") pod "22f8b21e-15e0-43f6-93c1-338580b0318f" (UID: "22f8b21e-15e0-43f6-93c1-338580b0318f"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:26:14.163953 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.163921    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "22f8b21e-15e0-43f6-93c1-338580b0318f" (UID: "22f8b21e-15e0-43f6-93c1-338580b0318f"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:26:14.164048 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.163987    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "22f8b21e-15e0-43f6-93c1-338580b0318f" (UID: "22f8b21e-15e0-43f6-93c1-338580b0318f"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:26:14.164325 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.164268    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-token" (OuterVolumeSpecName: "istio-token") pod "22f8b21e-15e0-43f6-93c1-338580b0318f" (UID: "22f8b21e-15e0-43f6-93c1-338580b0318f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:26:14.164325 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.164291    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-kube-api-access-fpbz6" (OuterVolumeSpecName: "kube-api-access-fpbz6") pod "22f8b21e-15e0-43f6-93c1-338580b0318f" (UID: "22f8b21e-15e0-43f6-93c1-338580b0318f"). InnerVolumeSpecName "kube-api-access-fpbz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:26:14.240274 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.240235    2584 generic.go:356] "Generic (PLEG): container finished" podID="22f8b21e-15e0-43f6-93c1-338580b0318f" containerID="5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6" exitCode=0
Sep 11 17:26:14.240460 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.240281    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"
Sep 11 17:26:14.240460 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.240315    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4" event={"ID":"22f8b21e-15e0-43f6-93c1-338580b0318f","Type":"ContainerDied","Data":"5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6"}
Sep 11 17:26:14.240460 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.240378    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4" event={"ID":"22f8b21e-15e0-43f6-93c1-338580b0318f","Type":"ContainerDied","Data":"1893947d200a95cde6861baae502ba2f34d0cfe564f04a4d65b8d284b66d47ae"}
Sep 11 17:26:14.240460 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.240428    2584 scope.go:117] "RemoveContainer" containerID="5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6"
Sep 11 17:26:14.242445 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.242392    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp" event={"ID":"00a3cf78-ed52-453e-a0a4-b6f41862e4af","Type":"ContainerStarted","Data":"63749128b81bc3050ed44def3159ac34756f91d42df21b477a34f9a35f9f3c70"}
Sep 11 17:26:14.242576 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.242480    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:14.262243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.262215    2584 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-cacerts\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:26:14.262243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.262245    2584 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-kubeconfig\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:26:14.262463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.262258    2584 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-csr-dns-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:26:14.262463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.262271    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:26:14.262463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.262284    2584 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/22f8b21e-15e0-43f6-93c1-338580b0318f-local-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:26:14.262463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.262296    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fpbz6\" (UniqueName: \"kubernetes.io/projected/22f8b21e-15e0-43f6-93c1-338580b0318f-kube-api-access-fpbz6\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:26:14.267183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.267133    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp" podStartSLOduration=2.032349118 podStartE2EDuration="4.267114796s" totalImagesPullingTime="2.234765678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:26:14.265589351 +0000 UTC m=+349.220279252" watchObservedRunningTime="2026-09-11 17:26:14.267114796 +0000 UTC m=+349.221804696"
Sep 11 17:26:14.286043 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.286007    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"]
Sep 11 17:26:14.295338 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.295305    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-bvvh4"]
Sep 11 17:26:14.758568 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.758346    2584 scope.go:117] "RemoveContainer" containerID="5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6"
Sep 11 17:26:14.758839 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:26:14.758715    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6\": container with ID starting with 5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6 not found: ID does not exist" containerID="5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6"
Sep 11 17:26:14.758839 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:14.758740    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6"} err="failed to get container status \"5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6\": rpc error: code = NotFound desc = could not find container \"5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6\": container with ID starting with 5419fec3c21d74d544e1098c18180984db95645d0a3ea5b6bcf1be27492ba2e6 not found: ID does not exist"
Sep 11 17:26:15.196732 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:15.196702    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-vq8bj"
Sep 11 17:26:15.249749 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:15.249709    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq" event={"ID":"c3154c84-43fc-4b4c-b143-addf184d064e","Type":"ContainerStarted","Data":"ee0efb0b445dafcc4887dd1e6c1b3df1f67afe09fcdd0cccd87a0a812eb09214"}
Sep 11 17:26:15.250021 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:15.249999    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:26:15.271718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:15.271664    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq" podStartSLOduration=2.344179209 podStartE2EDuration="5.271646126s" totalImagesPullingTime="2.927466917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:26:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:26:15.269055548 +0000 UTC m=+350.223745450" watchObservedRunningTime="2026-09-11 17:26:15.271646126 +0000 UTC m=+350.226336028"
Sep 11 17:26:15.705385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:15.705351    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f8b21e-15e0-43f6-93c1-338580b0318f" path="/var/lib/kubelet/pods/22f8b21e-15e0-43f6-93c1-338580b0318f/volumes"
Sep 11 17:26:45.255143 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:45.255111    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-zw4gp"
Sep 11 17:26:46.257431 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:26:46.257381    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-n7vtq"
Sep 11 17:27:04.700040 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.700001    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"]
Sep 11 17:27:04.700479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.700300    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f8b21e-15e0-43f6-93c1-338580b0318f" containerName="discovery"
Sep 11 17:27:04.700479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.700310    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f8b21e-15e0-43f6-93c1-338580b0318f" containerName="discovery"
Sep 11 17:27:04.700479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.700365    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f8b21e-15e0-43f6-93c1-338580b0318f" containerName="discovery"
Sep 11 17:27:04.703408 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.703382    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.706232 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.706209    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 11 17:27:04.706370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.706242    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-7xk7d\""
Sep 11 17:27:04.707288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.707270    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 11 17:27:04.714086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.714065    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"]
Sep 11 17:27:04.753532 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.753499    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxrt8\" (UniqueName: \"kubernetes.io/projected/e24ce678-8ff9-4b16-8052-c0c8ece489b6-kube-api-access-vxrt8\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.753692 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.753554    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.753692 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.753600    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.787896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.787863    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"]
Sep 11 17:27:04.791155 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.791139    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.800471 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.800447    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"]
Sep 11 17:27:04.854742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.854706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxrt8\" (UniqueName: \"kubernetes.io/projected/e24ce678-8ff9-4b16-8052-c0c8ece489b6-kube-api-access-vxrt8\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.854742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.854741    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.855014 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.854766    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.855014 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.854871    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.855014 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.854918    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.855014 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.854950    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxv6v\" (UniqueName: \"kubernetes.io/projected/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-kube-api-access-qxv6v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.855217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.855199    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-bundle\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.855253 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.855228    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-util\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.863507 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.863475    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxrt8\" (UniqueName: \"kubernetes.io/projected/e24ce678-8ff9-4b16-8052-c0c8ece489b6-kube-api-access-vxrt8\") pod \"da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") " pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:04.889321 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.889285    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"]
Sep 11 17:27:04.892758 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.892740    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:04.902021 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.901996    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"]
Sep 11 17:27:04.956152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.956057    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s56mz\" (UniqueName: \"kubernetes.io/projected/be6915cf-ac11-4773-9575-1d4ba596a291-kube-api-access-s56mz\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:04.956152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.956112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxv6v\" (UniqueName: \"kubernetes.io/projected/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-kube-api-access-qxv6v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.956342 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.956181    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:04.956342 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.956234    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.956342 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.956276    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:04.956342 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.956312    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.956666 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.956649    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-bundle\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.956710 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.956664    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-util\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.964585 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.964553    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxv6v\" (UniqueName: \"kubernetes.io/projected/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-kube-api-access-qxv6v\") pod \"6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") " pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:04.989769 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.989736    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"]
Sep 11 17:27:04.993193 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:04.993176    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.003571 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.003545    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"]
Sep 11 17:27:05.012711 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.012686    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:05.057005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.056970    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.057198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.057025    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.057198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.057097    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:05.057198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.057137    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:05.057198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.057179    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s56mz\" (UniqueName: \"kubernetes.io/projected/be6915cf-ac11-4773-9575-1d4ba596a291-kube-api-access-s56mz\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:05.057198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.057200    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7wkt\" (UniqueName: \"kubernetes.io/projected/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-kube-api-access-z7wkt\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.057615 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.057482    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-util\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:05.057615 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.057498    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-bundle\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:05.067111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.067073    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s56mz\" (UniqueName: \"kubernetes.io/projected/be6915cf-ac11-4773-9575-1d4ba596a291-kube-api-access-s56mz\") pod \"ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") " pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:05.100752 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.100716    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:05.158898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.158254    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.158898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.158347    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7wkt\" (UniqueName: \"kubernetes.io/projected/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-kube-api-access-z7wkt\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.158898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.158430    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.158898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.158853    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-bundle\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.159195 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.159104    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-util\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.168176 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.168148    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7wkt\" (UniqueName: \"kubernetes.io/projected/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-kube-api-access-z7wkt\") pod \"e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") " pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.202878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.202849    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:05.288326 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.288299    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"]
Sep 11 17:27:05.290448 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:05.290423    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24ce678_8ff9_4b16_8052_c0c8ece489b6.slice/crio-c7d26288ae316cc08d0424e62d40df16c0d1e45096a2a22804e96016cd6ec25f WatchSource:0}: Error finding container c7d26288ae316cc08d0424e62d40df16c0d1e45096a2a22804e96016cd6ec25f: Status 404 returned error can't find the container with id c7d26288ae316cc08d0424e62d40df16c0d1e45096a2a22804e96016cd6ec25f
Sep 11 17:27:05.302881 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.302859    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:05.387620 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.387588    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"]
Sep 11 17:27:05.460852 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.460773    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c" event={"ID":"7a2dc6f2-3984-4b11-ada9-be58e2b89d63","Type":"ContainerStarted","Data":"35fe964162c584972f89aeb4c9bade273db4e1ac19149d85dce1f9c5f04c81bb"}
Sep 11 17:27:05.462350 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.462325    2584 generic.go:356] "Generic (PLEG): container finished" podID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerID="469ba7ae61a881a5cfcc09c4b7fbc584b3e527cb578084e78781d337586ec9a4" exitCode=0
Sep 11 17:27:05.462464 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.462391    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9" event={"ID":"e24ce678-8ff9-4b16-8052-c0c8ece489b6","Type":"ContainerDied","Data":"469ba7ae61a881a5cfcc09c4b7fbc584b3e527cb578084e78781d337586ec9a4"}
Sep 11 17:27:05.462509 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.462469    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9" event={"ID":"e24ce678-8ff9-4b16-8052-c0c8ece489b6","Type":"ContainerStarted","Data":"c7d26288ae316cc08d0424e62d40df16c0d1e45096a2a22804e96016cd6ec25f"}
Sep 11 17:27:05.478394 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.478369    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"]
Sep 11 17:27:05.480610 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:05.480578    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe6915cf_ac11_4773_9575_1d4ba596a291.slice/crio-e3318ac007a1199bb70a7a9ad593ba153e3e44dcfed319b55c987726d534c955 WatchSource:0}: Error finding container e3318ac007a1199bb70a7a9ad593ba153e3e44dcfed319b55c987726d534c955: Status 404 returned error can't find the container with id e3318ac007a1199bb70a7a9ad593ba153e3e44dcfed319b55c987726d534c955
Sep 11 17:27:05.580450 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:05.580427    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"]
Sep 11 17:27:05.644211 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:05.644177    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd49b8f_c6d4_4f03_852f_d56199bad2e8.slice/crio-6e2d5b4d9f2b4157e16c1c5c1e5162f43d8f0e27c939edc37db817267722c32d WatchSource:0}: Error finding container 6e2d5b4d9f2b4157e16c1c5c1e5162f43d8f0e27c939edc37db817267722c32d: Status 404 returned error can't find the container with id 6e2d5b4d9f2b4157e16c1c5c1e5162f43d8f0e27c939edc37db817267722c32d
Sep 11 17:27:06.408907 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:06.408871    2584 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24ce678_8ff9_4b16_8052_c0c8ece489b6.slice/crio-conmon-d2677fc0fadca13d320b247ceef19e923445396b2ab4ceb1208da2760ec7c58a.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 17:27:06.409215 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:06.408946    2584 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode24ce678_8ff9_4b16_8052_c0c8ece489b6.slice/crio-conmon-d2677fc0fadca13d320b247ceef19e923445396b2ab4ceb1208da2760ec7c58a.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 17:27:06.468863 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.468827    2584 generic.go:356] "Generic (PLEG): container finished" podID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerID="88280121bdae18b21ed43d4b2e4794d19dce8446057a05a9f378e1ec8025ecbb" exitCode=0
Sep 11 17:27:06.469043 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.468908    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c" event={"ID":"7a2dc6f2-3984-4b11-ada9-be58e2b89d63","Type":"ContainerDied","Data":"88280121bdae18b21ed43d4b2e4794d19dce8446057a05a9f378e1ec8025ecbb"}
Sep 11 17:27:06.470926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.470904    2584 generic.go:356] "Generic (PLEG): container finished" podID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerID="d2677fc0fadca13d320b247ceef19e923445396b2ab4ceb1208da2760ec7c58a" exitCode=0
Sep 11 17:27:06.471016 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.470989    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9" event={"ID":"e24ce678-8ff9-4b16-8052-c0c8ece489b6","Type":"ContainerDied","Data":"d2677fc0fadca13d320b247ceef19e923445396b2ab4ceb1208da2760ec7c58a"}
Sep 11 17:27:06.472592 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.472555    2584 generic.go:356] "Generic (PLEG): container finished" podID="be6915cf-ac11-4773-9575-1d4ba596a291" containerID="016bdc0485b3874576fba1fcc24291e68b7ede6cbf1063047b4c3ff0e9f3419e" exitCode=0
Sep 11 17:27:06.472714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.472606    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd" event={"ID":"be6915cf-ac11-4773-9575-1d4ba596a291","Type":"ContainerDied","Data":"016bdc0485b3874576fba1fcc24291e68b7ede6cbf1063047b4c3ff0e9f3419e"}
Sep 11 17:27:06.472714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.472650    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd" event={"ID":"be6915cf-ac11-4773-9575-1d4ba596a291","Type":"ContainerStarted","Data":"e3318ac007a1199bb70a7a9ad593ba153e3e44dcfed319b55c987726d534c955"}
Sep 11 17:27:06.474305 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.474282    2584 generic.go:356] "Generic (PLEG): container finished" podID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerID="1eeab99302485b4b1c84ac070f9dec2feeb260c1047c3ea1bacb6f7bbdc25edc" exitCode=0
Sep 11 17:27:06.474385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.474327    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s" event={"ID":"3bd49b8f-c6d4-4f03-852f-d56199bad2e8","Type":"ContainerDied","Data":"1eeab99302485b4b1c84ac070f9dec2feeb260c1047c3ea1bacb6f7bbdc25edc"}
Sep 11 17:27:06.474385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:06.474352    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s" event={"ID":"3bd49b8f-c6d4-4f03-852f-d56199bad2e8","Type":"ContainerStarted","Data":"6e2d5b4d9f2b4157e16c1c5c1e5162f43d8f0e27c939edc37db817267722c32d"}
Sep 11 17:27:07.480382 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:07.480336    2584 generic.go:356] "Generic (PLEG): container finished" podID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerID="cfe935fe02f45c279ab3e3adc8aaa17ff3cc1c3ba3e578592e2ab4cb409d96a5" exitCode=0
Sep 11 17:27:07.480838 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:07.480372    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s" event={"ID":"3bd49b8f-c6d4-4f03-852f-d56199bad2e8","Type":"ContainerDied","Data":"cfe935fe02f45c279ab3e3adc8aaa17ff3cc1c3ba3e578592e2ab4cb409d96a5"}
Sep 11 17:27:07.482856 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:07.482835    2584 generic.go:356] "Generic (PLEG): container finished" podID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerID="cdd166aa7a6134a039e874d2d2c917849984d750a16ebc5314aa60410803d5cd" exitCode=0
Sep 11 17:27:07.483032 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:07.482910    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c" event={"ID":"7a2dc6f2-3984-4b11-ada9-be58e2b89d63","Type":"ContainerDied","Data":"cdd166aa7a6134a039e874d2d2c917849984d750a16ebc5314aa60410803d5cd"}
Sep 11 17:27:07.485323 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:07.485301    2584 generic.go:356] "Generic (PLEG): container finished" podID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerID="ca5d643f5f5c64f902abe85330b290123935dfa6756624065527ec66134be662" exitCode=0
Sep 11 17:27:07.485428 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:07.485381    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9" event={"ID":"e24ce678-8ff9-4b16-8052-c0c8ece489b6","Type":"ContainerDied","Data":"ca5d643f5f5c64f902abe85330b290123935dfa6756624065527ec66134be662"}
Sep 11 17:27:08.492392 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.492358    2584 generic.go:356] "Generic (PLEG): container finished" podID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerID="a2807e22ac4af5f5eedae36267d3298d058f402bf7f66dcfabcfc670f0e9ec77" exitCode=0
Sep 11 17:27:08.492809 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.492437    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c" event={"ID":"7a2dc6f2-3984-4b11-ada9-be58e2b89d63","Type":"ContainerDied","Data":"a2807e22ac4af5f5eedae36267d3298d058f402bf7f66dcfabcfc670f0e9ec77"}
Sep 11 17:27:08.494207 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.494183    2584 generic.go:356] "Generic (PLEG): container finished" podID="be6915cf-ac11-4773-9575-1d4ba596a291" containerID="7d9641157c6c6ff7ed9e82f605fab93b4c39b204477cf74521c1c19d80c75037" exitCode=0
Sep 11 17:27:08.494319 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.494265    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd" event={"ID":"be6915cf-ac11-4773-9575-1d4ba596a291","Type":"ContainerDied","Data":"7d9641157c6c6ff7ed9e82f605fab93b4c39b204477cf74521c1c19d80c75037"}
Sep 11 17:27:08.496471 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.496451    2584 generic.go:356] "Generic (PLEG): container finished" podID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerID="8a1837c1bb8436c79a5dce33cc464c1e9bce9ad9ea3487a890143d30fe36cf36" exitCode=0
Sep 11 17:27:08.496559 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.496517    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s" event={"ID":"3bd49b8f-c6d4-4f03-852f-d56199bad2e8","Type":"ContainerDied","Data":"8a1837c1bb8436c79a5dce33cc464c1e9bce9ad9ea3487a890143d30fe36cf36"}
Sep 11 17:27:08.618962 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.618914    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:08.683521 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.683483    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-util\") pod \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") "
Sep 11 17:27:08.683688 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.683547    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-bundle\") pod \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") "
Sep 11 17:27:08.683688 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.683607    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxrt8\" (UniqueName: \"kubernetes.io/projected/e24ce678-8ff9-4b16-8052-c0c8ece489b6-kube-api-access-vxrt8\") pod \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\" (UID: \"e24ce678-8ff9-4b16-8052-c0c8ece489b6\") "
Sep 11 17:27:08.684049 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.684024    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-bundle" (OuterVolumeSpecName: "bundle") pod "e24ce678-8ff9-4b16-8052-c0c8ece489b6" (UID: "e24ce678-8ff9-4b16-8052-c0c8ece489b6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:08.685595 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.685572    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e24ce678-8ff9-4b16-8052-c0c8ece489b6-kube-api-access-vxrt8" (OuterVolumeSpecName: "kube-api-access-vxrt8") pod "e24ce678-8ff9-4b16-8052-c0c8ece489b6" (UID: "e24ce678-8ff9-4b16-8052-c0c8ece489b6"). InnerVolumeSpecName "kube-api-access-vxrt8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:27:08.689093 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.689074    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-util" (OuterVolumeSpecName: "util") pod "e24ce678-8ff9-4b16-8052-c0c8ece489b6" (UID: "e24ce678-8ff9-4b16-8052-c0c8ece489b6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:08.784213 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.784124    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:08.784213 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.784152    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e24ce678-8ff9-4b16-8052-c0c8ece489b6-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:08.784213 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:08.784161    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxrt8\" (UniqueName: \"kubernetes.io/projected/e24ce678-8ff9-4b16-8052-c0c8ece489b6-kube-api-access-vxrt8\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:09.503276 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.503236    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9" event={"ID":"e24ce678-8ff9-4b16-8052-c0c8ece489b6","Type":"ContainerDied","Data":"c7d26288ae316cc08d0424e62d40df16c0d1e45096a2a22804e96016cd6ec25f"}
Sep 11 17:27:09.503736 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.503289    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7d26288ae316cc08d0424e62d40df16c0d1e45096a2a22804e96016cd6ec25f"
Sep 11 17:27:09.503736 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.503247    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/da112bd609bff87f7bacd2ba941225d7cff15c41059c552dee22e264d7gchb9"
Sep 11 17:27:09.505335 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.505304    2584 generic.go:356] "Generic (PLEG): container finished" podID="be6915cf-ac11-4773-9575-1d4ba596a291" containerID="fe1b4f6d6ae1fb7aff293f6566c78a47e7c943802e41561a40cae92c2693c39f" exitCode=0
Sep 11 17:27:09.505474 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.505381    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd" event={"ID":"be6915cf-ac11-4773-9575-1d4ba596a291","Type":"ContainerDied","Data":"fe1b4f6d6ae1fb7aff293f6566c78a47e7c943802e41561a40cae92c2693c39f"}
Sep 11 17:27:09.642357 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.642334    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:09.667296 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.667270    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:09.691495 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.691471    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-util\") pod \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") "
Sep 11 17:27:09.691616 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.691512    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-bundle\") pod \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") "
Sep 11 17:27:09.691616 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.691543    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qxv6v\" (UniqueName: \"kubernetes.io/projected/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-kube-api-access-qxv6v\") pod \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") "
Sep 11 17:27:09.691616 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.691576    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7wkt\" (UniqueName: \"kubernetes.io/projected/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-kube-api-access-z7wkt\") pod \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") "
Sep 11 17:27:09.691616 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.691614    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-util\") pod \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\" (UID: \"7a2dc6f2-3984-4b11-ada9-be58e2b89d63\") "
Sep 11 17:27:09.691775 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.691652    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-bundle\") pod \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\" (UID: \"3bd49b8f-c6d4-4f03-852f-d56199bad2e8\") "
Sep 11 17:27:09.692294 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.692252    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-bundle" (OuterVolumeSpecName: "bundle") pod "3bd49b8f-c6d4-4f03-852f-d56199bad2e8" (UID: "3bd49b8f-c6d4-4f03-852f-d56199bad2e8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:09.692395 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.692323    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-bundle" (OuterVolumeSpecName: "bundle") pod "7a2dc6f2-3984-4b11-ada9-be58e2b89d63" (UID: "7a2dc6f2-3984-4b11-ada9-be58e2b89d63"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:09.693728 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.693708    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-kube-api-access-z7wkt" (OuterVolumeSpecName: "kube-api-access-z7wkt") pod "3bd49b8f-c6d4-4f03-852f-d56199bad2e8" (UID: "3bd49b8f-c6d4-4f03-852f-d56199bad2e8"). InnerVolumeSpecName "kube-api-access-z7wkt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:27:09.694228 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.694208    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-kube-api-access-qxv6v" (OuterVolumeSpecName: "kube-api-access-qxv6v") pod "7a2dc6f2-3984-4b11-ada9-be58e2b89d63" (UID: "7a2dc6f2-3984-4b11-ada9-be58e2b89d63"). InnerVolumeSpecName "kube-api-access-qxv6v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:27:09.697721 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.697680    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-util" (OuterVolumeSpecName: "util") pod "3bd49b8f-c6d4-4f03-852f-d56199bad2e8" (UID: "3bd49b8f-c6d4-4f03-852f-d56199bad2e8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:09.700555 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.700527    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-util" (OuterVolumeSpecName: "util") pod "7a2dc6f2-3984-4b11-ada9-be58e2b89d63" (UID: "7a2dc6f2-3984-4b11-ada9-be58e2b89d63"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:09.793006 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.792972    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:09.793006 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.793004    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qxv6v\" (UniqueName: \"kubernetes.io/projected/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-kube-api-access-qxv6v\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:09.793183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.793018    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7wkt\" (UniqueName: \"kubernetes.io/projected/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-kube-api-access-z7wkt\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:09.793183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.793033    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7a2dc6f2-3984-4b11-ada9-be58e2b89d63-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:09.793183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.793046    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:09.793183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:09.793058    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3bd49b8f-c6d4-4f03-852f-d56199bad2e8-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:10.512097 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.512064    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c"
Sep 11 17:27:10.512097 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.512085    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/6541d93aaee335d6227a8778ab4e840bbe7f5273fe8e69d6bf3410847anlw2c" event={"ID":"7a2dc6f2-3984-4b11-ada9-be58e2b89d63","Type":"ContainerDied","Data":"35fe964162c584972f89aeb4c9bade273db4e1ac19149d85dce1f9c5f04c81bb"}
Sep 11 17:27:10.512607 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.512139    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="35fe964162c584972f89aeb4c9bade273db4e1ac19149d85dce1f9c5f04c81bb"
Sep 11 17:27:10.514135 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.514115    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s"
Sep 11 17:27:10.514279 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.514154    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/e3d011e69d9573cabb8c359e5ac709eb5ac2407647b5169ad26d957e4czl54s" event={"ID":"3bd49b8f-c6d4-4f03-852f-d56199bad2e8","Type":"ContainerDied","Data":"6e2d5b4d9f2b4157e16c1c5c1e5162f43d8f0e27c939edc37db817267722c32d"}
Sep 11 17:27:10.514279 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.514203    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6e2d5b4d9f2b4157e16c1c5c1e5162f43d8f0e27c939edc37db817267722c32d"
Sep 11 17:27:10.637872 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.637850    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:10.700892 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.700862    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-bundle\") pod \"be6915cf-ac11-4773-9575-1d4ba596a291\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") "
Sep 11 17:27:10.701068 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.700914    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s56mz\" (UniqueName: \"kubernetes.io/projected/be6915cf-ac11-4773-9575-1d4ba596a291-kube-api-access-s56mz\") pod \"be6915cf-ac11-4773-9575-1d4ba596a291\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") "
Sep 11 17:27:10.701068 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.700935    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-util\") pod \"be6915cf-ac11-4773-9575-1d4ba596a291\" (UID: \"be6915cf-ac11-4773-9575-1d4ba596a291\") "
Sep 11 17:27:10.701436 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.701377    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-bundle" (OuterVolumeSpecName: "bundle") pod "be6915cf-ac11-4773-9575-1d4ba596a291" (UID: "be6915cf-ac11-4773-9575-1d4ba596a291"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:10.702961 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.702935    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be6915cf-ac11-4773-9575-1d4ba596a291-kube-api-access-s56mz" (OuterVolumeSpecName: "kube-api-access-s56mz") pod "be6915cf-ac11-4773-9575-1d4ba596a291" (UID: "be6915cf-ac11-4773-9575-1d4ba596a291"). InnerVolumeSpecName "kube-api-access-s56mz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:27:10.706216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.706196    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-util" (OuterVolumeSpecName: "util") pod "be6915cf-ac11-4773-9575-1d4ba596a291" (UID: "be6915cf-ac11-4773-9575-1d4ba596a291"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:10.801706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.801668    2584 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-bundle\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:10.801706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.801699    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s56mz\" (UniqueName: \"kubernetes.io/projected/be6915cf-ac11-4773-9575-1d4ba596a291-kube-api-access-s56mz\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:10.801706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:10.801713    2584 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/be6915cf-ac11-4773-9575-1d4ba596a291-util\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:11.388195 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388157    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-767b65ffb5-2qzr9"]
Sep 11 17:27:11.388467 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388451    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerName="pull"
Sep 11 17:27:11.388467 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388465    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerName="pull"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388474    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerName="pull"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388481    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerName="pull"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388490    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be6915cf-ac11-4773-9575-1d4ba596a291" containerName="extract"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388496    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6915cf-ac11-4773-9575-1d4ba596a291" containerName="extract"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388504    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerName="util"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388509    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerName="util"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388517    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerName="extract"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388522    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerName="extract"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388529    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerName="util"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388534    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerName="util"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388539    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be6915cf-ac11-4773-9575-1d4ba596a291" containerName="util"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388544    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6915cf-ac11-4773-9575-1d4ba596a291" containerName="util"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388550    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be6915cf-ac11-4773-9575-1d4ba596a291" containerName="pull"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388555    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="be6915cf-ac11-4773-9575-1d4ba596a291" containerName="pull"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388561    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerName="extract"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388575    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerName="extract"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388585    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerName="pull"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388589    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerName="pull"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388597    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerName="util"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388602    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerName="util"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388607    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerName="extract"
Sep 11 17:27:11.388617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388615    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerName="extract"
Sep 11 17:27:11.389327 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388658    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="e24ce678-8ff9-4b16-8052-c0c8ece489b6" containerName="extract"
Sep 11 17:27:11.389327 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388667    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a2dc6f2-3984-4b11-ada9-be58e2b89d63" containerName="extract"
Sep 11 17:27:11.389327 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388673    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bd49b8f-c6d4-4f03-852f-d56199bad2e8" containerName="extract"
Sep 11 17:27:11.389327 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.388679    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="be6915cf-ac11-4773-9575-1d4ba596a291" containerName="extract"
Sep 11 17:27:11.391639 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.391624    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.395699 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.395671    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 11 17:27:11.396324 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.396310    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-9tzbh\""
Sep 11 17:27:11.396691 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.396673    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 11 17:27:11.396812 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.396702    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 11 17:27:11.396812 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.396702    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 11 17:27:11.396812 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.396751    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 11 17:27:11.396812 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.396783    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 11 17:27:11.397027 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.396954    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 11 17:27:11.405203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.405177    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 11 17:27:11.406288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.406267    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-trusted-ca-bundle\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.406366 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.406303    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-serving-cert\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.406366 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.406324    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-oauth-config\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.406465 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.406372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z94ld\" (UniqueName: \"kubernetes.io/projected/775f1921-cf63-4690-9dc7-bfa1cd31d21d-kube-api-access-z94ld\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.406465 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.406440    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-service-ca\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.406465 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.406460    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-config\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.406575 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.406478    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-oauth-serving-cert\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.407095 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.407077    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767b65ffb5-2qzr9"]
Sep 11 17:27:11.506964 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.506926    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-service-ca\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.506964 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.506962    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-config\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.506981    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-oauth-serving-cert\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.507014    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-trusted-ca-bundle\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.507048    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-serving-cert\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.507062    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-oauth-config\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.507079    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z94ld\" (UniqueName: \"kubernetes.io/projected/775f1921-cf63-4690-9dc7-bfa1cd31d21d-kube-api-access-z94ld\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.507770    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-config\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507903 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.507807    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-service-ca\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507903 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.507875    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-oauth-serving-cert\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.507983 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.507968    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/775f1921-cf63-4690-9dc7-bfa1cd31d21d-trusted-ca-bundle\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.509512 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.509490    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-serving-cert\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.509606 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.509528    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/775f1921-cf63-4690-9dc7-bfa1cd31d21d-console-oauth-config\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.516899 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.516878    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z94ld\" (UniqueName: \"kubernetes.io/projected/775f1921-cf63-4690-9dc7-bfa1cd31d21d-kube-api-access-z94ld\") pod \"console-767b65ffb5-2qzr9\" (UID: \"775f1921-cf63-4690-9dc7-bfa1cd31d21d\") " pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.520711 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.520683    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd" event={"ID":"be6915cf-ac11-4773-9575-1d4ba596a291","Type":"ContainerDied","Data":"e3318ac007a1199bb70a7a9ad593ba153e3e44dcfed319b55c987726d534c955"}
Sep 11 17:27:11.520785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.520740    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3318ac007a1199bb70a7a9ad593ba153e3e44dcfed319b55c987726d534c955"
Sep 11 17:27:11.520785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.520697    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/ea579a99e39e9baa67b0fe2e51b0fa4ef69da3ae0011f15b849816c0c65kxhd"
Sep 11 17:27:11.702005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.701890    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:11.976440 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:11.976411    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-767b65ffb5-2qzr9"]
Sep 11 17:27:11.977817 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:11.977791    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod775f1921_cf63_4690_9dc7_bfa1cd31d21d.slice/crio-239e1c2281e1d333f9068fc54521348e588c735ca8911b6215b30131f611639b WatchSource:0}: Error finding container 239e1c2281e1d333f9068fc54521348e588c735ca8911b6215b30131f611639b: Status 404 returned error can't find the container with id 239e1c2281e1d333f9068fc54521348e588c735ca8911b6215b30131f611639b
Sep 11 17:27:12.526822 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:12.526790    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767b65ffb5-2qzr9" event={"ID":"775f1921-cf63-4690-9dc7-bfa1cd31d21d","Type":"ContainerStarted","Data":"ce8b77b01cab820a37d9577d563888ef90cfc8f668fc2e00cd6b83570259eabc"}
Sep 11 17:27:12.527167 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:12.526837    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-767b65ffb5-2qzr9" event={"ID":"775f1921-cf63-4690-9dc7-bfa1cd31d21d","Type":"ContainerStarted","Data":"239e1c2281e1d333f9068fc54521348e588c735ca8911b6215b30131f611639b"}
Sep 11 17:27:17.109159 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.109101    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-767b65ffb5-2qzr9" podStartSLOduration=6.109082788 podStartE2EDuration="6.109082788s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:12.554370484 +0000 UTC m=+407.509060386" watchObservedRunningTime="2026-09-11 17:27:17.109082788 +0000 UTC m=+412.063772689"
Sep 11 17:27:17.110546 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.110527    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"]
Sep 11 17:27:17.113731 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.113716    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"
Sep 11 17:27:17.118539 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.118518    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 11 17:27:17.118666 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.118518    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 11 17:27:17.118666 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.118526    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 11 17:27:17.119356 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.119339    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-hhrbv\""
Sep 11 17:27:17.133756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.133727    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"]
Sep 11 17:27:17.148200 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.148178    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh8h6\" (UniqueName: \"kubernetes.io/projected/234f1e0f-eddc-4554-96d5-89d24ba134f4-kube-api-access-gh8h6\") pod \"dns-operator-controller-manager-7b84cd7c9c-rn6n6\" (UID: \"234f1e0f-eddc-4554-96d5-89d24ba134f4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"
Sep 11 17:27:17.249237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.249193    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh8h6\" (UniqueName: \"kubernetes.io/projected/234f1e0f-eddc-4554-96d5-89d24ba134f4-kube-api-access-gh8h6\") pod \"dns-operator-controller-manager-7b84cd7c9c-rn6n6\" (UID: \"234f1e0f-eddc-4554-96d5-89d24ba134f4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"
Sep 11 17:27:17.258616 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.258590    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh8h6\" (UniqueName: \"kubernetes.io/projected/234f1e0f-eddc-4554-96d5-89d24ba134f4-kube-api-access-gh8h6\") pod \"dns-operator-controller-manager-7b84cd7c9c-rn6n6\" (UID: \"234f1e0f-eddc-4554-96d5-89d24ba134f4\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"
Sep 11 17:27:17.424070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.424037    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"
Sep 11 17:27:17.696512 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:17.696488    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"]
Sep 11 17:27:17.698558 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:17.698528    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod234f1e0f_eddc_4554_96d5_89d24ba134f4.slice/crio-378e72bdd0e950ec167500e99cb3e0f3958276f9ad7bc8eecff9b7a384fa714c WatchSource:0}: Error finding container 378e72bdd0e950ec167500e99cb3e0f3958276f9ad7bc8eecff9b7a384fa714c: Status 404 returned error can't find the container with id 378e72bdd0e950ec167500e99cb3e0f3958276f9ad7bc8eecff9b7a384fa714c
Sep 11 17:27:18.556459 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:18.556422    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6" event={"ID":"234f1e0f-eddc-4554-96d5-89d24ba134f4","Type":"ContainerStarted","Data":"378e72bdd0e950ec167500e99cb3e0f3958276f9ad7bc8eecff9b7a384fa714c"}
Sep 11 17:27:19.345319 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:19.345285    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"]
Sep 11 17:27:19.351479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:19.351443    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:19.354557 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:19.354531    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-h648w\""
Sep 11 17:27:19.367818 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:19.367791    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gmmf\" (UniqueName: \"kubernetes.io/projected/ba04a25b-a8ca-473c-beb5-24d14dff3ee7-kube-api-access-2gmmf\") pod \"limitador-operator-controller-manager-74495c69f8-hmf57\" (UID: \"ba04a25b-a8ca-473c-beb5-24d14dff3ee7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:19.387923 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:19.387889    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"]
Sep 11 17:27:19.468764 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:19.468728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gmmf\" (UniqueName: \"kubernetes.io/projected/ba04a25b-a8ca-473c-beb5-24d14dff3ee7-kube-api-access-2gmmf\") pod \"limitador-operator-controller-manager-74495c69f8-hmf57\" (UID: \"ba04a25b-a8ca-473c-beb5-24d14dff3ee7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:19.484151 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:19.484116    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gmmf\" (UniqueName: \"kubernetes.io/projected/ba04a25b-a8ca-473c-beb5-24d14dff3ee7-kube-api-access-2gmmf\") pod \"limitador-operator-controller-manager-74495c69f8-hmf57\" (UID: \"ba04a25b-a8ca-473c-beb5-24d14dff3ee7\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:19.662856 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:19.662817    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:20.523236 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:20.523209    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"]
Sep 11 17:27:20.525137 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:20.525111    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba04a25b_a8ca_473c_beb5_24d14dff3ee7.slice/crio-8413e5b8ffc6bfbe468e51fb611418ada97a521dc7e19b686f79817ec985ef47 WatchSource:0}: Error finding container 8413e5b8ffc6bfbe468e51fb611418ada97a521dc7e19b686f79817ec985ef47: Status 404 returned error can't find the container with id 8413e5b8ffc6bfbe468e51fb611418ada97a521dc7e19b686f79817ec985ef47
Sep 11 17:27:20.569413 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:20.569362    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6" event={"ID":"234f1e0f-eddc-4554-96d5-89d24ba134f4","Type":"ContainerStarted","Data":"12be28f06bb6e31b8381b2157cc99ce049596567cd294c8045f75c350fd61e52"}
Sep 11 17:27:20.569592 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:20.569460    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"
Sep 11 17:27:20.570949 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:20.570925    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57" event={"ID":"ba04a25b-a8ca-473c-beb5-24d14dff3ee7","Type":"ContainerStarted","Data":"8413e5b8ffc6bfbe468e51fb611418ada97a521dc7e19b686f79817ec985ef47"}
Sep 11 17:27:20.604917 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:20.604860    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6" podStartSLOduration=0.977444054 podStartE2EDuration="3.604843035s" totalImagesPullingTime="2.627398981s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:20.6044376 +0000 UTC m=+415.559127502" watchObservedRunningTime="2026-09-11 17:27:20.604843035 +0000 UTC m=+415.559532936"
Sep 11 17:27:21.706131 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:21.706101    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:21.706602 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:21.706154    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:21.707985 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:21.707962    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:22.582331 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:22.582291    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57" event={"ID":"ba04a25b-a8ca-473c-beb5-24d14dff3ee7","Type":"ContainerStarted","Data":"723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab"}
Sep 11 17:27:22.586396 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:22.586325    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-767b65ffb5-2qzr9"
Sep 11 17:27:22.604473 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:22.604415    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57" podStartSLOduration=1.795654538 podStartE2EDuration="3.604382888s" totalImagesPullingTime="1.80872835s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:22.601899867 +0000 UTC m=+417.556589768" watchObservedRunningTime="2026-09-11 17:27:22.604382888 +0000 UTC m=+417.559072790"
Sep 11 17:27:23.587362 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.587323    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:23.708092 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.708064    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"]
Sep 11 17:27:23.711264 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.711249    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:23.713621 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.713599    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xg8wc\""
Sep 11 17:27:23.725336 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.725306    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"]
Sep 11 17:27:23.803905 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.803869    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm8gv\" (UniqueName: \"kubernetes.io/projected/77bd77e8-0cba-4313-bf0d-09e683845469-kube-api-access-zm8gv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" (UID: \"77bd77e8-0cba-4313-bf0d-09e683845469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:23.804071 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.803913    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77bd77e8-0cba-4313-bf0d-09e683845469-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" (UID: \"77bd77e8-0cba-4313-bf0d-09e683845469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:23.904708 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.904675    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm8gv\" (UniqueName: \"kubernetes.io/projected/77bd77e8-0cba-4313-bf0d-09e683845469-kube-api-access-zm8gv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" (UID: \"77bd77e8-0cba-4313-bf0d-09e683845469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:23.904854 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.904724    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77bd77e8-0cba-4313-bf0d-09e683845469-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" (UID: \"77bd77e8-0cba-4313-bf0d-09e683845469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:23.905121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.905102    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77bd77e8-0cba-4313-bf0d-09e683845469-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" (UID: \"77bd77e8-0cba-4313-bf0d-09e683845469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:23.916999 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:23.916974    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm8gv\" (UniqueName: \"kubernetes.io/projected/77bd77e8-0cba-4313-bf0d-09e683845469-kube-api-access-zm8gv\") pod \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" (UID: \"77bd77e8-0cba-4313-bf0d-09e683845469\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:24.021338 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:24.021298    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:24.298440 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:24.298413    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"]
Sep 11 17:27:24.300432 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:24.300381    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77bd77e8_0cba_4313_bf0d_09e683845469.slice/crio-1dbfb543a0147cb9f7ff10891a9cfebdc4bcb9790fe07b82f9357a26b6882f86 WatchSource:0}: Error finding container 1dbfb543a0147cb9f7ff10891a9cfebdc4bcb9790fe07b82f9357a26b6882f86: Status 404 returned error can't find the container with id 1dbfb543a0147cb9f7ff10891a9cfebdc4bcb9790fe07b82f9357a26b6882f86
Sep 11 17:27:24.593672 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:24.593583    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h" event={"ID":"77bd77e8-0cba-4313-bf0d-09e683845469","Type":"ContainerStarted","Data":"1dbfb543a0147cb9f7ff10891a9cfebdc4bcb9790fe07b82f9357a26b6882f86"}
Sep 11 17:27:26.094973 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.094936    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-p2dq4"]
Sep 11 17:27:26.098466 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.098445    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4"
Sep 11 17:27:26.102995 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.102968    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-rxtbn\""
Sep 11 17:27:26.120037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.120007    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-p2dq4"]
Sep 11 17:27:26.120370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.120342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdjhk\" (UniqueName: \"kubernetes.io/projected/086d2faa-7067-4e22-9e53-b2031a12df2d-kube-api-access-rdjhk\") pod \"authorino-operator-76b478bd78-p2dq4\" (UID: \"086d2faa-7067-4e22-9e53-b2031a12df2d\") " pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4"
Sep 11 17:27:26.221862 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.221826    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdjhk\" (UniqueName: \"kubernetes.io/projected/086d2faa-7067-4e22-9e53-b2031a12df2d-kube-api-access-rdjhk\") pod \"authorino-operator-76b478bd78-p2dq4\" (UID: \"086d2faa-7067-4e22-9e53-b2031a12df2d\") " pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4"
Sep 11 17:27:26.236363 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.236331    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdjhk\" (UniqueName: \"kubernetes.io/projected/086d2faa-7067-4e22-9e53-b2031a12df2d-kube-api-access-rdjhk\") pod \"authorino-operator-76b478bd78-p2dq4\" (UID: \"086d2faa-7067-4e22-9e53-b2031a12df2d\") " pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4"
Sep 11 17:27:26.409969 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.409906    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4"
Sep 11 17:27:26.694539 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:26.694508    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-p2dq4"]
Sep 11 17:27:26.696781 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:26.696749    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086d2faa_7067_4e22_9e53_b2031a12df2d.slice/crio-d0ae24d5d21c10e6ea5194d1d53848386206a6dbf3894490899e9e39485bc873 WatchSource:0}: Error finding container d0ae24d5d21c10e6ea5194d1d53848386206a6dbf3894490899e9e39485bc873: Status 404 returned error can't find the container with id d0ae24d5d21c10e6ea5194d1d53848386206a6dbf3894490899e9e39485bc873
Sep 11 17:27:27.611713 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:27.611671    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4" event={"ID":"086d2faa-7067-4e22-9e53-b2031a12df2d","Type":"ContainerStarted","Data":"d0ae24d5d21c10e6ea5194d1d53848386206a6dbf3894490899e9e39485bc873"}
Sep 11 17:27:28.621132 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:28.620879    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h" event={"ID":"77bd77e8-0cba-4313-bf0d-09e683845469","Type":"ContainerStarted","Data":"984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0"}
Sep 11 17:27:28.621132 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:28.621007    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:28.644081 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:28.644022    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h" podStartSLOduration=1.506440598 podStartE2EDuration="5.644003162s" totalImagesPullingTime="4.137562564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:28.641021766 +0000 UTC m=+423.595711672" watchObservedRunningTime="2026-09-11 17:27:28.644003162 +0000 UTC m=+423.598693064"
Sep 11 17:27:29.630206 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:29.630169    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4" event={"ID":"086d2faa-7067-4e22-9e53-b2031a12df2d","Type":"ContainerStarted","Data":"b775185505ffafb6ad5f7a6e4305e2d8437b919c52547a71bd4a2ee59f05b315"}
Sep 11 17:27:29.649758 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:29.649699    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4" podStartSLOduration=1.187751975 podStartE2EDuration="3.649681364s" totalImagesPullingTime="2.461929389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:29.648433292 +0000 UTC m=+424.603123196" watchObservedRunningTime="2026-09-11 17:27:29.649681364 +0000 UTC m=+424.604371265"
Sep 11 17:27:30.635655 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:30.635623    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4"
Sep 11 17:27:31.119725 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.119645    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"]
Sep 11 17:27:31.123032 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.123011    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.125605 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.125579    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 11 17:27:31.125714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.125607    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-nnjqp\""
Sep 11 17:27:31.125714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.125607    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 11 17:27:31.130638 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.130616    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"]
Sep 11 17:27:31.167864 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.167818    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c2813db-27e4-46df-960b-99f9799e58ad-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.168026 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.167885    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqgd2\" (UniqueName: \"kubernetes.io/projected/5c2813db-27e4-46df-960b-99f9799e58ad-kube-api-access-jqgd2\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.168026 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.167922    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c2813db-27e4-46df-960b-99f9799e58ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.269252 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.269216    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c2813db-27e4-46df-960b-99f9799e58ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.269483 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.269301    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c2813db-27e4-46df-960b-99f9799e58ad-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.269483 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.269346    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqgd2\" (UniqueName: \"kubernetes.io/projected/5c2813db-27e4-46df-960b-99f9799e58ad-kube-api-access-jqgd2\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.269483 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:31.269357    2584 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found
Sep 11 17:27:31.269483 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:31.269447    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c2813db-27e4-46df-960b-99f9799e58ad-plugin-serving-cert podName:5c2813db-27e4-46df-960b-99f9799e58ad nodeName:}" failed. No retries permitted until 2026-09-11 17:27:31.769431299 +0000 UTC m=+426.724121196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/5c2813db-27e4-46df-960b-99f9799e58ad-plugin-serving-cert") pod "kuadrant-console-plugin-fbdd4f445-6t8md" (UID: "5c2813db-27e4-46df-960b-99f9799e58ad") : secret "plugin-serving-cert" not found
Sep 11 17:27:31.269954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.269936    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/5c2813db-27e4-46df-960b-99f9799e58ad-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.284103 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.284071    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqgd2\" (UniqueName: \"kubernetes.io/projected/5c2813db-27e4-46df-960b-99f9799e58ad-kube-api-access-jqgd2\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.578433 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.578373    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-rn6n6"
Sep 11 17:27:31.774593 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.774560    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c2813db-27e4-46df-960b-99f9799e58ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:31.776928 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:31.776909    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/5c2813db-27e4-46df-960b-99f9799e58ad-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-6t8md\" (UID: \"5c2813db-27e4-46df-960b-99f9799e58ad\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:32.032458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:32.032424    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"
Sep 11 17:27:32.313614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:32.313585    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md"]
Sep 11 17:27:32.315555 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:32.315529    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c2813db_27e4_46df_960b_99f9799e58ad.slice/crio-8dbdd409b14d9d1abe2a79ece74c212cb0be1aee3aec0b937e975cc02f499148 WatchSource:0}: Error finding container 8dbdd409b14d9d1abe2a79ece74c212cb0be1aee3aec0b937e975cc02f499148: Status 404 returned error can't find the container with id 8dbdd409b14d9d1abe2a79ece74c212cb0be1aee3aec0b937e975cc02f499148
Sep 11 17:27:32.647177 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:32.647139    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md" event={"ID":"5c2813db-27e4-46df-960b-99f9799e58ad","Type":"ContainerStarted","Data":"8dbdd409b14d9d1abe2a79ece74c212cb0be1aee3aec0b937e975cc02f499148"}
Sep 11 17:27:34.596891 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:34.596859    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:37.678929 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:37.678894    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md" event={"ID":"5c2813db-27e4-46df-960b-99f9799e58ad","Type":"ContainerStarted","Data":"67e6436e3896c41efda0ba07020fc3f9d4747a32f51d7345aa6c9ab7a8004ffa"}
Sep 11 17:27:37.696477 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:37.696433    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-6t8md" podStartSLOduration=2.024906083 podStartE2EDuration="6.696418808s" totalImagesPullingTime="4.671512725s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:37.694430299 +0000 UTC m=+432.649120201" watchObservedRunningTime="2026-09-11 17:27:37.696418808 +0000 UTC m=+432.651108715"
Sep 11 17:27:39.632192 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:39.632161    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:41.643384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.643353    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-p2dq4"
Sep 11 17:27:41.921471 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.921374    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"]
Sep 11 17:27:41.921622 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.921575    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" containerName="manager" containerID="cri-o://984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0" gracePeriod=2
Sep 11 17:27:41.943068 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.943041    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"]
Sep 11 17:27:41.958726 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.958692    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"]
Sep 11 17:27:41.959025 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.959011    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" containerName="manager"
Sep 11 17:27:41.959065 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.959028    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" containerName="manager"
Sep 11 17:27:41.959109 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.959098    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" containerName="manager"
Sep 11 17:27:41.961116 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:41.960918    2584 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"77bd77e8-0cba-4313-bf0d-09e683845469\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\": pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:41.963053 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.963022    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:41.963685 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.963663    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"]
Sep 11 17:27:41.963836 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.963817    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" containerName="manager" containerID="cri-o://723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab" gracePeriod=2
Sep 11 17:27:41.965963 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:41.965934    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:41.977636 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:41.977609    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"]
Sep 11 17:27:42.009073 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.009044    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"]
Sep 11 17:27:42.022158 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.022128    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"]
Sep 11 17:27:42.022519 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.022503    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" containerName="manager"
Sep 11 17:27:42.022611 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.022521    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" containerName="manager"
Sep 11 17:27:42.022666 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.022610    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" containerName="manager"
Sep 11 17:27:42.025664 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.025642    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"
Sep 11 17:27:42.050665 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.050640    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"]
Sep 11 17:27:42.062441 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.062414    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:42.063727 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.063706    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nrmbg\" (UniqueName: \"kubernetes.io/projected/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-kube-api-access-nrmbg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-msxrx\" (UID: \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:42.063834 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.063764    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-msxrx\" (UID: \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:42.163446 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.163391    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hmf57\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.164744 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.164716    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wj95\" (UniqueName: \"kubernetes.io/projected/0e83afb1-b0b9-4545-a4cb-b3e7356acbdf-kube-api-access-9wj95\") pod \"limitador-operator-controller-manager-74495c69f8-45fj8\" (UID: \"0e83afb1-b0b9-4545-a4cb-b3e7356acbdf\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"
Sep 11 17:27:42.164868 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.164764    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nrmbg\" (UniqueName: \"kubernetes.io/projected/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-kube-api-access-nrmbg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-msxrx\" (UID: \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:42.164868 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.164836    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-msxrx\" (UID: \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:42.165170 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.165142    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-76f8f686bf-msxrx\" (UID: \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:42.215771 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.215753    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.218796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.218776    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:42.227783 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.227748    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:42.230089 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.230062    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hmf57\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.237584 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.237565    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nrmbg\" (UniqueName: \"kubernetes.io/projected/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-kube-api-access-nrmbg\") pod \"kuadrant-operator-controller-manager-76f8f686bf-msxrx\" (UID: \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:42.238519 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.238500    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hmf57\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.240712 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.240693    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:42.266066 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.266046    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wj95\" (UniqueName: \"kubernetes.io/projected/0e83afb1-b0b9-4545-a4cb-b3e7356acbdf-kube-api-access-9wj95\") pod \"limitador-operator-controller-manager-74495c69f8-45fj8\" (UID: \"0e83afb1-b0b9-4545-a4cb-b3e7356acbdf\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"
Sep 11 17:27:42.284621 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.284594    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wj95\" (UniqueName: \"kubernetes.io/projected/0e83afb1-b0b9-4545-a4cb-b3e7356acbdf-kube-api-access-9wj95\") pod \"limitador-operator-controller-manager-74495c69f8-45fj8\" (UID: \"0e83afb1-b0b9-4545-a4cb-b3e7356acbdf\") " pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"
Sep 11 17:27:42.353771 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.353739    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:42.360716 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.360693    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"
Sep 11 17:27:42.366629 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.366601    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gmmf\" (UniqueName: \"kubernetes.io/projected/ba04a25b-a8ca-473c-beb5-24d14dff3ee7-kube-api-access-2gmmf\") pod \"ba04a25b-a8ca-473c-beb5-24d14dff3ee7\" (UID: \"ba04a25b-a8ca-473c-beb5-24d14dff3ee7\") "
Sep 11 17:27:42.366711 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.366639    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zm8gv\" (UniqueName: \"kubernetes.io/projected/77bd77e8-0cba-4313-bf0d-09e683845469-kube-api-access-zm8gv\") pod \"77bd77e8-0cba-4313-bf0d-09e683845469\" (UID: \"77bd77e8-0cba-4313-bf0d-09e683845469\") "
Sep 11 17:27:42.366773 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.366722    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77bd77e8-0cba-4313-bf0d-09e683845469-extensions-socket-volume\") pod \"77bd77e8-0cba-4313-bf0d-09e683845469\" (UID: \"77bd77e8-0cba-4313-bf0d-09e683845469\") "
Sep 11 17:27:42.367239 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.367209    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/77bd77e8-0cba-4313-bf0d-09e683845469-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "77bd77e8-0cba-4313-bf0d-09e683845469" (UID: "77bd77e8-0cba-4313-bf0d-09e683845469"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:42.368830 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.368802    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/77bd77e8-0cba-4313-bf0d-09e683845469-kube-api-access-zm8gv" (OuterVolumeSpecName: "kube-api-access-zm8gv") pod "77bd77e8-0cba-4313-bf0d-09e683845469" (UID: "77bd77e8-0cba-4313-bf0d-09e683845469"). InnerVolumeSpecName "kube-api-access-zm8gv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:27:42.368981 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.368958    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ba04a25b-a8ca-473c-beb5-24d14dff3ee7-kube-api-access-2gmmf" (OuterVolumeSpecName: "kube-api-access-2gmmf") pod "ba04a25b-a8ca-473c-beb5-24d14dff3ee7" (UID: "ba04a25b-a8ca-473c-beb5-24d14dff3ee7"). InnerVolumeSpecName "kube-api-access-2gmmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:27:42.467954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.467894    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/77bd77e8-0cba-4313-bf0d-09e683845469-extensions-socket-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:42.467954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.467921    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gmmf\" (UniqueName: \"kubernetes.io/projected/ba04a25b-a8ca-473c-beb5-24d14dff3ee7-kube-api-access-2gmmf\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:42.467954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.467931    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zm8gv\" (UniqueName: \"kubernetes.io/projected/77bd77e8-0cba-4313-bf0d-09e683845469-kube-api-access-zm8gv\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:42.660684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.660652    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"]
Sep 11 17:27:42.666674 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.666653    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"]
Sep 11 17:27:42.673489 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:42.673466    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb05aa0ba_92cf_4cf1_b282_b2eddcd862a4.slice/crio-e4fb4c149b56d3bcb21092542e6ad623fde8b56347a9e4486195fa6fe282e654 WatchSource:0}: Error finding container e4fb4c149b56d3bcb21092542e6ad623fde8b56347a9e4486195fa6fe282e654: Status 404 returned error can't find the container with id e4fb4c149b56d3bcb21092542e6ad623fde8b56347a9e4486195fa6fe282e654
Sep 11 17:27:42.674198 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:42.674185    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e83afb1_b0b9_4545_a4cb_b3e7356acbdf.slice/crio-537b8479ae01db654a5e0e637c57106316e4285a4e97c65114651c70740ffdc9 WatchSource:0}: Error finding container 537b8479ae01db654a5e0e637c57106316e4285a4e97c65114651c70740ffdc9: Status 404 returned error can't find the container with id 537b8479ae01db654a5e0e637c57106316e4285a4e97c65114651c70740ffdc9
Sep 11 17:27:42.705684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.705656    2584 generic.go:356] "Generic (PLEG): container finished" podID="77bd77e8-0cba-4313-bf0d-09e683845469" containerID="984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0" exitCode=0
Sep 11 17:27:42.705802 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.705763    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:42.705802 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.705777    2584 scope.go:117] "RemoveContainer" containerID="984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0"
Sep 11 17:27:42.707952 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.707916    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8" event={"ID":"0e83afb1-b0b9-4545-a4cb-b3e7356acbdf","Type":"ContainerStarted","Data":"537b8479ae01db654a5e0e637c57106316e4285a4e97c65114651c70740ffdc9"}
Sep 11 17:27:42.708612 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.708579    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:42.709731 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.709692    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx" event={"ID":"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4","Type":"ContainerStarted","Data":"e4fb4c149b56d3bcb21092542e6ad623fde8b56347a9e4486195fa6fe282e654"}
Sep 11 17:27:42.710502 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.710469    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hmf57\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.711349 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.711327    2584 generic.go:356] "Generic (PLEG): container finished" podID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" containerID="723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab" exitCode=0
Sep 11 17:27:42.711461 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.711379    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.715414 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.715371    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hmf57\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.716845 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.716821    2584 scope.go:117] "RemoveContainer" containerID="984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0"
Sep 11 17:27:42.717190 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.717169    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0\": container with ID starting with 984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0 not found: ID does not exist" containerID="984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0"
Sep 11 17:27:42.717272 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.717195    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0"} err="failed to get container status \"984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0\": rpc error: code = NotFound desc = could not find container \"984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0\": container with ID starting with 984839330aafc4c103f6c4751f930e5bb003b67a04512bcedf43065d89961ef0 not found: ID does not exist"
Sep 11 17:27:42.717272 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.717211    2584 scope.go:117] "RemoveContainer" containerID="723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab"
Sep 11 17:27:42.717521 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.717493    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:42.724662 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.724638    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:42.726555 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.726537    2584 scope.go:117] "RemoveContainer" containerID="723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab"
Sep 11 17:27:42.726817 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.726798    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab\": container with ID starting with 723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab not found: ID does not exist" containerID="723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab"
Sep 11 17:27:42.726817 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.726809    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hmf57\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.726938 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:42.726828    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab"} err="failed to get container status \"723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab\": rpc error: code = NotFound desc = could not find container \"723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab\": container with ID starting with 723d874ab7a5f12db71e6f9e8c2b50bfba14be5b1437cc04ab11618874f187ab not found: ID does not exist"
Sep 11 17:27:42.729730 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.729690    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-74495c69f8-hmf57\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-hmf57"
Sep 11 17:27:42.736711 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:42.736690    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-76f8f686bf-z9r2h\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-z9r2h"
Sep 11 17:27:43.709980 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:43.709943    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="77bd77e8-0cba-4313-bf0d-09e683845469" path="/var/lib/kubelet/pods/77bd77e8-0cba-4313-bf0d-09e683845469/volumes"
Sep 11 17:27:43.710347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:43.710275    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba04a25b-a8ca-473c-beb5-24d14dff3ee7" path="/var/lib/kubelet/pods/ba04a25b-a8ca-473c-beb5-24d14dff3ee7/volumes"
Sep 11 17:27:43.718960 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:43.718933    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx" event={"ID":"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4","Type":"ContainerStarted","Data":"ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167"}
Sep 11 17:27:43.719101 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:43.719052    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:43.722345 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:43.722319    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8" event={"ID":"0e83afb1-b0b9-4545-a4cb-b3e7356acbdf","Type":"ContainerStarted","Data":"93fdbd4844e323c9fb3a4dead79f471dc073d36e437b37159f24a56c34e1f978"}
Sep 11 17:27:43.722488 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:43.722440    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"
Sep 11 17:27:43.748095 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:43.748051    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx" podStartSLOduration=2.748037964 podStartE2EDuration="2.748037964s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:43.746090176 +0000 UTC m=+438.700780079" watchObservedRunningTime="2026-09-11 17:27:43.748037964 +0000 UTC m=+438.702727866"
Sep 11 17:27:43.770235 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:43.770189    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8" podStartSLOduration=2.770173807 podStartE2EDuration="2.770173807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:43.768699072 +0000 UTC m=+438.723388975" watchObservedRunningTime="2026-09-11 17:27:43.770173807 +0000 UTC m=+438.724863782"
Sep 11 17:27:54.730262 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:54.730178    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:54.730684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:54.730333    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-74495c69f8-45fj8"
Sep 11 17:27:57.780620 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:57.780581    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"]
Sep 11 17:27:57.781160 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:57.780781    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx" podUID="b05aa0ba-92cf-4cf1-b282-b2eddcd862a4" containerName="manager" containerID="cri-o://ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167" gracePeriod=10
Sep 11 17:27:58.038267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.038204    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:58.052744 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.052717    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"]
Sep 11 17:27:58.053042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.053029    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b05aa0ba-92cf-4cf1-b282-b2eddcd862a4" containerName="manager"
Sep 11 17:27:58.053042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.053043    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b05aa0ba-92cf-4cf1-b282-b2eddcd862a4" containerName="manager"
Sep 11 17:27:58.053124 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.053094    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b05aa0ba-92cf-4cf1-b282-b2eddcd862a4" containerName="manager"
Sep 11 17:27:58.056251 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.056235    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.074018 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.073987    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"]
Sep 11 17:27:58.196966 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.196930    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-extensions-socket-volume\") pod \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\" (UID: \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\") "
Sep 11 17:27:58.197132 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.196994    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nrmbg\" (UniqueName: \"kubernetes.io/projected/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-kube-api-access-nrmbg\") pod \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\" (UID: \"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4\") "
Sep 11 17:27:58.197132 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.197113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fvr5s\" (UID: \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.197203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.197133    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwtj8\" (UniqueName: \"kubernetes.io/projected/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-kube-api-access-bwtj8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fvr5s\" (UID: \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.197373 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.197338    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b05aa0ba-92cf-4cf1-b282-b2eddcd862a4" (UID: "b05aa0ba-92cf-4cf1-b282-b2eddcd862a4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:27:58.199015 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.198991    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-kube-api-access-nrmbg" (OuterVolumeSpecName: "kube-api-access-nrmbg") pod "b05aa0ba-92cf-4cf1-b282-b2eddcd862a4" (UID: "b05aa0ba-92cf-4cf1-b282-b2eddcd862a4"). InnerVolumeSpecName "kube-api-access-nrmbg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:27:58.297892 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.297806    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fvr5s\" (UID: \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.297892 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.297842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwtj8\" (UniqueName: \"kubernetes.io/projected/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-kube-api-access-bwtj8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fvr5s\" (UID: \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.297892 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.297887    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-extensions-socket-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:58.297892 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.297897    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nrmbg\" (UniqueName: \"kubernetes.io/projected/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4-kube-api-access-nrmbg\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:27:58.298211 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.298192    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fvr5s\" (UID: \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.311395 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.311368    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwtj8\" (UniqueName: \"kubernetes.io/projected/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-kube-api-access-bwtj8\") pod \"kuadrant-operator-controller-manager-5769f99d9f-fvr5s\" (UID: \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.365471 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.365429    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.639660 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.639635    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"]
Sep 11 17:27:58.642369 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:27:58.642341    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a980db8_020c_4dd9_8ce3_73d8ac67f1f4.slice/crio-cb011e6967a90746cd4371aafff35e284f814b849b8a578393883742a7d1dfaf WatchSource:0}: Error finding container cb011e6967a90746cd4371aafff35e284f814b849b8a578393883742a7d1dfaf: Status 404 returned error can't find the container with id cb011e6967a90746cd4371aafff35e284f814b849b8a578393883742a7d1dfaf
Sep 11 17:27:58.799816 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.799783    2584 generic.go:356] "Generic (PLEG): container finished" podID="b05aa0ba-92cf-4cf1-b282-b2eddcd862a4" containerID="ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167" exitCode=0
Sep 11 17:27:58.800215 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.799842    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"
Sep 11 17:27:58.800215 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.799872    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx" event={"ID":"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4","Type":"ContainerDied","Data":"ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167"}
Sep 11 17:27:58.800215 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.799926    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx" event={"ID":"b05aa0ba-92cf-4cf1-b282-b2eddcd862a4","Type":"ContainerDied","Data":"e4fb4c149b56d3bcb21092542e6ad623fde8b56347a9e4486195fa6fe282e654"}
Sep 11 17:27:58.800215 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.799960    2584 scope.go:117] "RemoveContainer" containerID="ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167"
Sep 11 17:27:58.801814 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.801788    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s" event={"ID":"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4","Type":"ContainerStarted","Data":"342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72"}
Sep 11 17:27:58.801910 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.801833    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s" event={"ID":"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4","Type":"ContainerStarted","Data":"cb011e6967a90746cd4371aafff35e284f814b849b8a578393883742a7d1dfaf"}
Sep 11 17:27:58.801910 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.801855    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:27:58.812153 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.812137    2584 scope.go:117] "RemoveContainer" containerID="ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167"
Sep 11 17:27:58.812443 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:27:58.812426    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167\": container with ID starting with ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167 not found: ID does not exist" containerID="ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167"
Sep 11 17:27:58.812492 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.812452    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167"} err="failed to get container status \"ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167\": rpc error: code = NotFound desc = could not find container \"ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167\": container with ID starting with ca45d173ef40da9a848025bf9089a61773318510fd069813a9629990dabd3167 not found: ID does not exist"
Sep 11 17:27:58.854102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.854050    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s" podStartSLOduration=0.854031392 podStartE2EDuration="854.031392ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:27:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:27:58.852643583 +0000 UTC m=+453.807333484" watchObservedRunningTime="2026-09-11 17:27:58.854031392 +0000 UTC m=+453.808721295"
Sep 11 17:27:58.873000 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.872965    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"]
Sep 11 17:27:58.879379 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:58.879348    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-76f8f686bf-msxrx"]
Sep 11 17:27:59.705052 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:27:59.705010    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b05aa0ba-92cf-4cf1-b282-b2eddcd862a4" path="/var/lib/kubelet/pods/b05aa0ba-92cf-4cf1-b282-b2eddcd862a4/volumes"
Sep 11 17:28:09.810380 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:09.810349    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:28:28.525223 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.525186    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:28:28.530286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.530261    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:28.532565 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.532537    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 11 17:28:28.536471 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.536448    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:28:28.567162 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.567125    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:28:28.618303 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.618272    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmfk6\" (UniqueName: \"kubernetes.io/projected/a1e2873c-1206-4802-a765-20258f974215-kube-api-access-kmfk6\") pod \"limitador-limitador-84994f7ffc-2dpmv\" (UID: \"a1e2873c-1206-4802-a765-20258f974215\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:28.618481 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.618313    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1e2873c-1206-4802-a765-20258f974215-config-file\") pod \"limitador-limitador-84994f7ffc-2dpmv\" (UID: \"a1e2873c-1206-4802-a765-20258f974215\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:28.719353 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.719322    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1e2873c-1206-4802-a765-20258f974215-config-file\") pod \"limitador-limitador-84994f7ffc-2dpmv\" (UID: \"a1e2873c-1206-4802-a765-20258f974215\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:28.719532 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.719456    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmfk6\" (UniqueName: \"kubernetes.io/projected/a1e2873c-1206-4802-a765-20258f974215-kube-api-access-kmfk6\") pod \"limitador-limitador-84994f7ffc-2dpmv\" (UID: \"a1e2873c-1206-4802-a765-20258f974215\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:28.720025 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.719998    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/a1e2873c-1206-4802-a765-20258f974215-config-file\") pod \"limitador-limitador-84994f7ffc-2dpmv\" (UID: \"a1e2873c-1206-4802-a765-20258f974215\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:28.727096 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.727069    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmfk6\" (UniqueName: \"kubernetes.io/projected/a1e2873c-1206-4802-a765-20258f974215-kube-api-access-kmfk6\") pod \"limitador-limitador-84994f7ffc-2dpmv\" (UID: \"a1e2873c-1206-4802-a765-20258f974215\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:28.842000 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:28.841912    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:29.112913 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:29.112804    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:28:29.115138 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:28:29.115100    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda1e2873c_1206_4802_a765_20258f974215.slice/crio-28418cfbbd51c1d3418c4a034085f3d56ec06383a885eca1ebfbdfa3dbdde705 WatchSource:0}: Error finding container 28418cfbbd51c1d3418c4a034085f3d56ec06383a885eca1ebfbdfa3dbdde705: Status 404 returned error can't find the container with id 28418cfbbd51c1d3418c4a034085f3d56ec06383a885eca1ebfbdfa3dbdde705
Sep 11 17:28:29.965667 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:29.965628    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv" event={"ID":"a1e2873c-1206-4802-a765-20258f974215","Type":"ContainerStarted","Data":"28418cfbbd51c1d3418c4a034085f3d56ec06383a885eca1ebfbdfa3dbdde705"}
Sep 11 17:28:30.973013 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:30.972979    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv" event={"ID":"a1e2873c-1206-4802-a765-20258f974215","Type":"ContainerStarted","Data":"14d949ec2460f0630aa738561b7f499258fa61121ce1e9dfb95d0470c4afe0c3"}
Sep 11 17:28:30.973430 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:30.973129    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:28:30.987850 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:30.987802    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv" podStartSLOduration=1.862566657 podStartE2EDuration="2.987790156s" totalImagesPullingTime="1.125223499s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:28:30.986905165 +0000 UTC m=+485.941595057" watchObservedRunningTime="2026-09-11 17:28:30.987790156 +0000 UTC m=+485.942480058"
Sep 11 17:28:41.979637 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:28:41.979603    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"
Sep 11 17:29:00.582587 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:00.582551    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-5dc82"]
Sep 11 17:29:00.585858 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:00.585835    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-5dc82"
Sep 11 17:29:00.588233 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:00.588210    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bcm5t\""
Sep 11 17:29:00.592858 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:00.592830    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-5dc82"]
Sep 11 17:29:00.642210 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:00.642176    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-5dc82"]
Sep 11 17:29:00.642443 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:29:00.642424    2584 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-2cmx2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-5dc82" podUID="e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6"
Sep 11 17:29:00.658370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:00.658342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2cmx2\" (UniqueName: \"kubernetes.io/projected/e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6-kube-api-access-2cmx2\") pod \"authorino-557f876f69-5dc82\" (UID: \"e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6\") " pod="kuadrant-system/authorino-557f876f69-5dc82"
Sep 11 17:29:00.758913 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:00.758877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2cmx2\" (UniqueName: \"kubernetes.io/projected/e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6-kube-api-access-2cmx2\") pod \"authorino-557f876f69-5dc82\" (UID: \"e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6\") " pod="kuadrant-system/authorino-557f876f69-5dc82"
Sep 11 17:29:00.767271 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:00.767245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2cmx2\" (UniqueName: \"kubernetes.io/projected/e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6-kube-api-access-2cmx2\") pod \"authorino-557f876f69-5dc82\" (UID: \"e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6\") " pod="kuadrant-system/authorino-557f876f69-5dc82"
Sep 11 17:29:01.129965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:01.129931    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-5dc82"
Sep 11 17:29:01.137302 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:01.137277    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-5dc82"
Sep 11 17:29:01.262348 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:01.262317    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2cmx2\" (UniqueName: \"kubernetes.io/projected/e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6-kube-api-access-2cmx2\") pod \"e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6\" (UID: \"e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6\") "
Sep 11 17:29:01.264438 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:01.264386    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6-kube-api-access-2cmx2" (OuterVolumeSpecName: "kube-api-access-2cmx2") pod "e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6" (UID: "e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6"). InnerVolumeSpecName "kube-api-access-2cmx2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:29:01.362934 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:01.362896    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2cmx2\" (UniqueName: \"kubernetes.io/projected/e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6-kube-api-access-2cmx2\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:29:02.135215 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:02.135188    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-5dc82"
Sep 11 17:29:02.162583 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:02.162550    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-5dc82"]
Sep 11 17:29:02.169028 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:02.168992    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-5dc82"]
Sep 11 17:29:03.709709 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:03.709677    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6" path="/var/lib/kubelet/pods/e47c431d-d3c4-4fe5-b44a-7ba8aae0cbe6/volumes"
Sep 11 17:29:42.978263 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:29:42.978231    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:30:00.142635 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:00.142595    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk"]
Sep 11 17:30:00.145937 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:00.145913    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk"
Sep 11 17:30:00.148506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:00.148483    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z84jg\""
Sep 11 17:30:00.153761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:00.153735    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk"]
Sep 11 17:30:00.156754 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:00.156731    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk"
Sep 11 17:30:00.430988 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:00.430962    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk"]
Sep 11 17:30:00.432611 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:30:00.432579    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc8cff11_feba_42d8_a43b_44e096fd1115.slice/crio-f607ee026052b11329bc59537da79f45e172b3d58d2159e50ebbc2ef1d08e023 WatchSource:0}: Error finding container f607ee026052b11329bc59537da79f45e172b3d58d2159e50ebbc2ef1d08e023: Status 404 returned error can't find the container with id f607ee026052b11329bc59537da79f45e172b3d58d2159e50ebbc2ef1d08e023
Sep 11 17:30:01.442110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:01.442071    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk" event={"ID":"cc8cff11-feba-42d8-a43b-44e096fd1115","Type":"ContainerStarted","Data":"f607ee026052b11329bc59537da79f45e172b3d58d2159e50ebbc2ef1d08e023"}
Sep 11 17:30:04.465214 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:04.465177    2584 generic.go:356] "Generic (PLEG): container finished" podID="cc8cff11-feba-42d8-a43b-44e096fd1115" containerID="3ba5b42d3dde33c2669a7c58b874776047db48547fd9c74bb7ba231d8e1c35d3" exitCode=0
Sep 11 17:30:04.465889 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:04.465848    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk" event={"ID":"cc8cff11-feba-42d8-a43b-44e096fd1115","Type":"ContainerDied","Data":"3ba5b42d3dde33c2669a7c58b874776047db48547fd9c74bb7ba231d8e1c35d3"}
Sep 11 17:30:05.034870 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.034838    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"]
Sep 11 17:30:05.038203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.038186    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.041818 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.041787    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 11 17:30:05.041918 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.041793    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-b865k\""
Sep 11 17:30:05.041918 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.041793    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Sep 11 17:30:05.041918 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.041798    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 11 17:30:05.047732 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.047706    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"]
Sep 11 17:30:05.093011 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.092978    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03c8a72-692d-40eb-bd99-872a9b62b53a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.093198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.093041    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.093198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.093064    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prl6n\" (UniqueName: \"kubernetes.io/projected/c03c8a72-692d-40eb-bd99-872a9b62b53a-kube-api-access-prl6n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.093198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.093081    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.093198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.093096    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.093198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.093120    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.193595 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.193567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.193595 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.193599    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03c8a72-692d-40eb-bd99-872a9b62b53a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.193856 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.193660    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.193856 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.193682    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prl6n\" (UniqueName: \"kubernetes.io/projected/c03c8a72-692d-40eb-bd99-872a9b62b53a-kube-api-access-prl6n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.193856 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.193705    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.193856 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.193728    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.194148 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.194126    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.194148 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.194145    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.194259 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.194186    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.195905 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.195855    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c03c8a72-692d-40eb-bd99-872a9b62b53a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.196449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.196427    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c03c8a72-692d-40eb-bd99-872a9b62b53a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.201645 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.201622    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prl6n\" (UniqueName: \"kubernetes.io/projected/c03c8a72-692d-40eb-bd99-872a9b62b53a-kube-api-access-prl6n\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb\" (UID: \"c03c8a72-692d-40eb-bd99-872a9b62b53a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.348595 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.348499    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:05.596666 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.596642    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk"
Sep 11 17:30:05.628424 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.628385    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"]
Sep 11 17:30:05.630996 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:30:05.630971    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc03c8a72_692d_40eb_bd99_872a9b62b53a.slice/crio-7617ce7032230fc65e5e7a8496e50f1ab2824650d30a223c3fbcb5f1b467a4e6 WatchSource:0}: Error finding container 7617ce7032230fc65e5e7a8496e50f1ab2824650d30a223c3fbcb5f1b467a4e6: Status 404 returned error can't find the container with id 7617ce7032230fc65e5e7a8496e50f1ab2824650d30a223c3fbcb5f1b467a4e6
Sep 11 17:30:05.733544 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:05.733514    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:30:06.479480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:06.479437    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb" event={"ID":"c03c8a72-692d-40eb-bd99-872a9b62b53a","Type":"ContainerStarted","Data":"7617ce7032230fc65e5e7a8496e50f1ab2824650d30a223c3fbcb5f1b467a4e6"}
Sep 11 17:30:06.480940 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:06.480912    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk" event={"ID":"cc8cff11-feba-42d8-a43b-44e096fd1115","Type":"ContainerDied","Data":"f607ee026052b11329bc59537da79f45e172b3d58d2159e50ebbc2ef1d08e023"}
Sep 11 17:30:06.481073 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:06.480940    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819130-58xpk"
Sep 11 17:30:06.481073 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:06.480961    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f607ee026052b11329bc59537da79f45e172b3d58d2159e50ebbc2ef1d08e023"
Sep 11 17:30:07.487280 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:07.487240    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb" event={"ID":"c03c8a72-692d-40eb-bd99-872a9b62b53a","Type":"ContainerStarted","Data":"260a63318fcdcd45bae4a3218e8ccb772c580bd539d3484bf2aead1979ad74a8"}
Sep 11 17:30:07.509276 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:07.509224    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb" podStartSLOduration=1.387152245 podStartE2EDuration="2.509208479s" totalImagesPullingTime="1.122056234s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:30:07.508078854 +0000 UTC m=+582.462768757" watchObservedRunningTime="2026-09-11 17:30:07.509208479 +0000 UTC m=+582.463898381"
Sep 11 17:30:15.349077 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:15.349039    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:15.349592 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:15.349105    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:15.361362 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:15.361337    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:15.544056 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:15.544027    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb"
Sep 11 17:30:16.825495 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:16.825458    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:30:25.520488 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:25.520453    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:30:25.520915 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:25.520716    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:30:29.121919 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:29.121882    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:30:39.584084 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:39.584044    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:30:47.433464 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.433426    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"]
Sep 11 17:30:47.433934 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.433779    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cc8cff11-feba-42d8-a43b-44e096fd1115" containerName="cleanup"
Sep 11 17:30:47.433934 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.433791    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="cc8cff11-feba-42d8-a43b-44e096fd1115" containerName="cleanup"
Sep 11 17:30:47.433934 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.433852    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="cc8cff11-feba-42d8-a43b-44e096fd1115" containerName="cleanup"
Sep 11 17:30:47.440304 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.440281    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.443140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.443124    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Sep 11 17:30:47.449504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.449479    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"]
Sep 11 17:30:47.544230 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.544190    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.544458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.544238    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd358574-a67f-4a0b-bf24-df99565bf090-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.544458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.544300    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.544458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.544340    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.544458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.544372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.544458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.544427    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gctf8\" (UniqueName: \"kubernetes.io/projected/dd358574-a67f-4a0b-bf24-df99565bf090-kube-api-access-gctf8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.645481 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.645446    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.645481 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.645485    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd358574-a67f-4a0b-bf24-df99565bf090-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.645707 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.645525    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.645707 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.645556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.645707 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.645578    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.645707 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.645609    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gctf8\" (UniqueName: \"kubernetes.io/projected/dd358574-a67f-4a0b-bf24-df99565bf090-kube-api-access-gctf8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.645957 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.645935    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.646015 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.645972    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.646015 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.646000    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.647927 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.647896    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd358574-a67f-4a0b-bf24-df99565bf090-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.648121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.648105    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd358574-a67f-4a0b-bf24-df99565bf090-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.661974 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.661941    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gctf8\" (UniqueName: \"kubernetes.io/projected/dd358574-a67f-4a0b-bf24-df99565bf090-kube-api-access-gctf8\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk\" (UID: \"dd358574-a67f-4a0b-bf24-df99565bf090\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:47.751867 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:47.751777    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:48.031332 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:48.031231    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"]
Sep 11 17:30:48.034005 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:30:48.033977    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd358574_a67f_4a0b_bf24_df99565bf090.slice/crio-1fdfabb448e09be56cec0232e159bca306e5da680ed2725a6d3c13dbc4575512 WatchSource:0}: Error finding container 1fdfabb448e09be56cec0232e159bca306e5da680ed2725a6d3c13dbc4575512: Status 404 returned error can't find the container with id 1fdfabb448e09be56cec0232e159bca306e5da680ed2725a6d3c13dbc4575512
Sep 11 17:30:48.035287 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:48.035272    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:30:48.698775 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:48.698739    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk" event={"ID":"dd358574-a67f-4a0b-bf24-df99565bf090","Type":"ContainerStarted","Data":"bd6f259294c8d232d756187041c846f646b1990c148b3ec5c90e3cd4c6cf6fb5"}
Sep 11 17:30:48.699176 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:48.698793    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk" event={"ID":"dd358574-a67f-4a0b-bf24-df99565bf090","Type":"ContainerStarted","Data":"1fdfabb448e09be56cec0232e159bca306e5da680ed2725a6d3c13dbc4575512"}
Sep 11 17:30:48.721235 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:48.721182    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk" podStartSLOduration=1.541282221 podStartE2EDuration="1.721166361s" totalImagesPullingTime="179.88414ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:30:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:30:48.719106582 +0000 UTC m=+623.673796485" watchObservedRunningTime="2026-09-11 17:30:48.721166361 +0000 UTC m=+623.675856262"
Sep 11 17:30:49.028732 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:49.028646    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:30:57.752726 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:57.752693    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:57.753104 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:57.752776    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:57.764932 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:57.764911    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:30:58.763700 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:30:58.763668    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk"
Sep 11 17:31:09.131898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:31:09.131863    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:31:16.831601 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:31:16.831556    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:32:23.786128 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.786091    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"]
Sep 11 17:32:23.789447 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.789430    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.792218 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.792192    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-d92fb3-openshift-default-dockercfg-sj6rw\""
Sep 11 17:32:23.792824 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.792811    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 17:32:23.814768 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.814742    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"]
Sep 11 17:32:23.952953 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.952915    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-token\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.953136 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.952993    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfkd2\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-kube-api-access-rfkd2\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.953136 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.953055    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-envoy\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.953136 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.953075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea5314-2948-4183-b6f3-9d7d95615ab4-istiod-ca-cert\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.953136 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.953113    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-podinfo\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.953277 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.953193    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-credential-socket\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.953277 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.953214    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-certs\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.953277 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.953229    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-socket\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:23.953277 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:23.953252    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-data\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054165 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054069    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-envoy\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054165 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054110    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea5314-2948-4183-b6f3-9d7d95615ab4-istiod-ca-cert\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054165 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054130    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-podinfo\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054469 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-credential-socket\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054469 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054200    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-certs\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054469 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054217    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-socket\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054469 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054243    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-data\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054469 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054283    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-token\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054469 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054310    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfkd2\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-kube-api-access-rfkd2\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054763 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054659    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-credential-socket\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054763 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054705    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-certs\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054763 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054725    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-data\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.054966 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054945    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-socket\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.055007 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.054961    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea5314-2948-4183-b6f3-9d7d95615ab4-istiod-ca-cert\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.057027 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.056996    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-envoy\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.057133 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.057110    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-podinfo\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.064371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.064347    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-token\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.064720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.064699    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfkd2\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-kube-api-access-rfkd2\") pod \"e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") " pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.099673 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.099641    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:24.379270 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:24.379244    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"]
Sep 11 17:32:24.381609 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:32:24.381583    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05ea5314_2948_4183_b6f3_9d7d95615ab4.slice/crio-adff838292e1da7cad4ae9b258e5fa7c8ed5b812e7630dd3cad9b9f67dc2b48b WatchSource:0}: Error finding container adff838292e1da7cad4ae9b258e5fa7c8ed5b812e7630dd3cad9b9f67dc2b48b: Status 404 returned error can't find the container with id adff838292e1da7cad4ae9b258e5fa7c8ed5b812e7630dd3cad9b9f67dc2b48b
Sep 11 17:32:25.210519 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.210484    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" event={"ID":"05ea5314-2948-4183-b6f3-9d7d95615ab4","Type":"ContainerStarted","Data":"adff838292e1da7cad4ae9b258e5fa7c8ed5b812e7630dd3cad9b9f67dc2b48b"}
Sep 11 17:32:25.423095 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.423058    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7738-f3716c"]
Sep 11 17:32:25.426711 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.426686    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-f3716c"
Sep 11 17:32:25.429853 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.429811    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jtt66\""
Sep 11 17:32:25.444326 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.444295    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-f3716c"]
Sep 11 17:32:25.567247 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.567165    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d2fq5\" (UniqueName: \"kubernetes.io/projected/7924e482-f2c8-4e86-9973-c4ca7d066929-kube-api-access-d2fq5\") pod \"test-curl-7738-f3716c\" (UID: \"7924e482-f2c8-4e86-9973-c4ca7d066929\") " pod="opendatahub/test-curl-7738-f3716c"
Sep 11 17:32:25.668150 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.668112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d2fq5\" (UniqueName: \"kubernetes.io/projected/7924e482-f2c8-4e86-9973-c4ca7d066929-kube-api-access-d2fq5\") pod \"test-curl-7738-f3716c\" (UID: \"7924e482-f2c8-4e86-9973-c4ca7d066929\") " pod="opendatahub/test-curl-7738-f3716c"
Sep 11 17:32:25.677134 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.677106    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d2fq5\" (UniqueName: \"kubernetes.io/projected/7924e482-f2c8-4e86-9973-c4ca7d066929-kube-api-access-d2fq5\") pod \"test-curl-7738-f3716c\" (UID: \"7924e482-f2c8-4e86-9973-c4ca7d066929\") " pod="opendatahub/test-curl-7738-f3716c"
Sep 11 17:32:25.741389 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.741355    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jtt66\""
Sep 11 17:32:25.748857 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:25.748822    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-f3716c"
Sep 11 17:32:26.035937 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:26.030561    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7738-f3716c"]
Sep 11 17:32:26.037734 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:32:26.037701    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7924e482_f2c8_4e86_9973_c4ca7d066929.slice/crio-0a8504d42d0b052c3d9df12f11079f3de95fb5af7557328ee61883dadd3bc8cd WatchSource:0}: Error finding container 0a8504d42d0b052c3d9df12f11079f3de95fb5af7557328ee61883dadd3bc8cd: Status 404 returned error can't find the container with id 0a8504d42d0b052c3d9df12f11079f3de95fb5af7557328ee61883dadd3bc8cd
Sep 11 17:32:26.217895 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:26.217853    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-f3716c" event={"ID":"7924e482-f2c8-4e86-9973-c4ca7d066929","Type":"ContainerStarted","Data":"0a8504d42d0b052c3d9df12f11079f3de95fb5af7557328ee61883dadd3bc8cd"}
Sep 11 17:32:27.542118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:27.542081    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:32:28.820954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:28.820874    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:32:28.820954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:28.820947    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:32:28.821258 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:28.820976    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:32:29.238204 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:29.238166    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" event={"ID":"05ea5314-2948-4183-b6f3-9d7d95615ab4","Type":"ContainerStarted","Data":"bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10"}
Sep 11 17:32:29.239536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:29.239506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7738-f3716c" event={"ID":"7924e482-f2c8-4e86-9973-c4ca7d066929","Type":"ContainerStarted","Data":"590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a"}
Sep 11 17:32:29.264215 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:29.264162    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" podStartSLOduration=1.8270896140000001 podStartE2EDuration="6.264144958s" totalImagesPullingTime="4.437055344s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:32:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:32:29.263113144 +0000 UTC m=+724.217803046" watchObservedRunningTime="2026-09-11 17:32:29.264144958 +0000 UTC m=+724.218834860"
Sep 11 17:32:29.280687 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:29.280630    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7738-f3716c" podStartSLOduration=1.4990237419999999 podStartE2EDuration="4.280612184s" totalImagesPullingTime="2.781588442s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:32:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:32:29.277907521 +0000 UTC m=+724.232597424" watchObservedRunningTime="2026-09-11 17:32:29.280612184 +0000 UTC m=+724.235302094"
Sep 11 17:32:29.858958 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:29.858918    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7738-f3716c"]
Sep 11 17:32:29.862551 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:29.862522    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7738-f3716c"]
Sep 11 17:32:30.099949 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:30.099865    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:30.104718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:30.104694    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:30.245452 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:30.245394    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:30.245646 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:32:30.245396    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7738-f3716c" container="test-curl-7738-f3716c"
Sep 11 17:32:30.246379 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:30.246358    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:31.256005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:31.255951    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7738-f3716c" podUID="7924e482-f2c8-4e86-9973-c4ca7d066929" containerName="test-curl-7738-f3716c" containerID="cri-o://590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a" gracePeriod=2
Sep 11 17:32:31.258259 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:32:31.258231    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7738-f3716c\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="7924e482-f2c8-4e86-9973-c4ca7d066929" pod="opendatahub/test-curl-7738-f3716c"
Sep 11 17:32:33.405743 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:33.405715    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-f3716c"
Sep 11 17:32:33.433883 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:33.433849    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d2fq5\" (UniqueName: \"kubernetes.io/projected/7924e482-f2c8-4e86-9973-c4ca7d066929-kube-api-access-d2fq5\") pod \"7924e482-f2c8-4e86-9973-c4ca7d066929\" (UID: \"7924e482-f2c8-4e86-9973-c4ca7d066929\") "
Sep 11 17:32:33.435967 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:33.435937    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7924e482-f2c8-4e86-9973-c4ca7d066929-kube-api-access-d2fq5" (OuterVolumeSpecName: "kube-api-access-d2fq5") pod "7924e482-f2c8-4e86-9973-c4ca7d066929" (UID: "7924e482-f2c8-4e86-9973-c4ca7d066929"). InnerVolumeSpecName "kube-api-access-d2fq5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:32:33.534618 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:33.534540    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d2fq5\" (UniqueName: \"kubernetes.io/projected/7924e482-f2c8-4e86-9973-c4ca7d066929-kube-api-access-d2fq5\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:32:33.705586 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:33.705554    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7924e482-f2c8-4e86-9973-c4ca7d066929" path="/var/lib/kubelet/pods/7924e482-f2c8-4e86-9973-c4ca7d066929/volumes"
Sep 11 17:32:34.277636 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:34.277593    2584 generic.go:356] "Generic (PLEG): container finished" podID="7924e482-f2c8-4e86-9973-c4ca7d066929" containerID="590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a" exitCode=137
Sep 11 17:32:34.277823 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:34.277646    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7738-f3716c"
Sep 11 17:32:34.277823 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:34.277698    2584 scope.go:117] "RemoveContainer" containerID="590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a"
Sep 11 17:32:34.286973 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:34.286948    2584 scope.go:117] "RemoveContainer" containerID="590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a"
Sep 11 17:32:34.287286 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:32:34.287263    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a\": container with ID starting with 590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a not found: ID does not exist" containerID="590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a"
Sep 11 17:32:34.287366 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:34.287294    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a"} err="failed to get container status \"590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a\": rpc error: code = NotFound desc = could not find container \"590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a\": container with ID starting with 590fdadb839881c9a5eae2694b2052b90a3beb5551d47643f7ea050477a75d8a not found: ID does not exist"
Sep 11 17:32:37.543828 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.543789    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:32:37.554489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.554458    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"]
Sep 11 17:32:37.554840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.554827    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7924e482-f2c8-4e86-9973-c4ca7d066929" containerName="test-curl-7738-f3716c"
Sep 11 17:32:37.554878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.554842    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7924e482-f2c8-4e86-9973-c4ca7d066929" containerName="test-curl-7738-f3716c"
Sep 11 17:32:37.554918 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.554914    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7924e482-f2c8-4e86-9973-c4ca7d066929" containerName="test-curl-7738-f3716c"
Sep 11 17:32:37.559560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.559537    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:37.561862 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.561841    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-40972c14\""
Sep 11 17:32:37.569491 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.567990    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08049db-0815-4d24-ad82-4633c782199d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj\" (UID: \"c08049db-0815-4d24-ad82-4633c782199d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:37.569491 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.568100    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7zk7\" (UniqueName: \"kubernetes.io/projected/c08049db-0815-4d24-ad82-4633c782199d-kube-api-access-n7zk7\") pod \"payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj\" (UID: \"c08049db-0815-4d24-ad82-4633c782199d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:37.577440 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.576706    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"]
Sep 11 17:32:37.669763 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.669712    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08049db-0815-4d24-ad82-4633c782199d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj\" (UID: \"c08049db-0815-4d24-ad82-4633c782199d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:37.669960 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.669778    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n7zk7\" (UniqueName: \"kubernetes.io/projected/c08049db-0815-4d24-ad82-4633c782199d-kube-api-access-n7zk7\") pod \"payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj\" (UID: \"c08049db-0815-4d24-ad82-4633c782199d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:37.670715 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.670686    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08049db-0815-4d24-ad82-4633c782199d-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj\" (UID: \"c08049db-0815-4d24-ad82-4633c782199d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:37.693198 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.693169    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7zk7\" (UniqueName: \"kubernetes.io/projected/c08049db-0815-4d24-ad82-4633c782199d-kube-api-access-n7zk7\") pod \"payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj\" (UID: \"c08049db-0815-4d24-ad82-4633c782199d\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:37.874003 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:37.873918    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:38.012597 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.012553    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"]
Sep 11 17:32:38.017284 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.017259    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.019770 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.019743    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-autores-3005e5-serving-cert\""
Sep 11 17:32:38.019911 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.019800    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:32:38.020886 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.020866    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nwfbn\""
Sep 11 17:32:38.021015 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.020901    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 17:32:38.021015 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.020869    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 17:32:38.032956 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.032929    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"]
Sep 11 17:32:38.074229 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.074184    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-metrics-certs\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.074448 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.074298    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02694eed-9ac2-4c6a-bc6f-debbd6418109-openshift-service-ca\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.074448 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.074345    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.074448 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.074372    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-494w5\" (UniqueName: \"kubernetes.io/projected/02694eed-9ac2-4c6a-bc6f-debbd6418109-kube-api-access-494w5\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.148418 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.148369    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"]
Sep 11 17:32:38.151964 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:32:38.151937    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08049db_0815_4d24_ad82_4633c782199d.slice/crio-6a6acf5d968a788482c37377ee428e17b2f31cd278f7c5bf1605dddd1eddbf9e WatchSource:0}: Error finding container 6a6acf5d968a788482c37377ee428e17b2f31cd278f7c5bf1605dddd1eddbf9e: Status 404 returned error can't find the container with id 6a6acf5d968a788482c37377ee428e17b2f31cd278f7c5bf1605dddd1eddbf9e
Sep 11 17:32:38.176927 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.175154    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02694eed-9ac2-4c6a-bc6f-debbd6418109-openshift-service-ca\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.176927 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.175228    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.176927 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.175258    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-494w5\" (UniqueName: \"kubernetes.io/projected/02694eed-9ac2-4c6a-bc6f-debbd6418109-kube-api-access-494w5\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.176927 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.175294    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-metrics-certs\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.176927 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:32:38.175919    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-serving-cert: secret "maas-api-e2e-autores-3005e5-serving-cert" not found
Sep 11 17:32:38.176927 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:32:38.176001    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls podName:02694eed-9ac2-4c6a-bc6f-debbd6418109 nodeName:}" failed. No retries permitted until 2026-09-11 17:32:38.675967829 +0000 UTC m=+733.630657724 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls") pod "maas-api-e2e-autores-3005e5-784d694558-mk2nr" (UID: "02694eed-9ac2-4c6a-bc6f-debbd6418109") : secret "maas-api-e2e-autores-3005e5-serving-cert" not found
Sep 11 17:32:38.176927 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.176878    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02694eed-9ac2-4c6a-bc6f-debbd6418109-openshift-service-ca\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.180278 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.180225    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-metrics-certs\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.188087 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.188022    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-494w5\" (UniqueName: \"kubernetes.io/projected/02694eed-9ac2-4c6a-bc6f-debbd6418109-kube-api-access-494w5\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.302463 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.302426    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj" event={"ID":"c08049db-0815-4d24-ad82-4633c782199d","Type":"ContainerStarted","Data":"6a6acf5d968a788482c37377ee428e17b2f31cd278f7c5bf1605dddd1eddbf9e"}
Sep 11 17:32:38.684423 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.683857    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.687817 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.687762    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls\") pod \"maas-api-e2e-autores-3005e5-784d694558-mk2nr\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") " pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:38.728128 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.728091    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"]
Sep 11 17:32:38.732715 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.732696    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:38.734944 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.734925    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-3005e5\""
Sep 11 17:32:38.735011 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.734928    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-3005e5-dockercfg-9fmrx\""
Sep 11 17:32:38.742732 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.742708    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"]
Sep 11 17:32:38.785899 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.785849    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klcsz\" (UniqueName: \"kubernetes.io/projected/d18eda81-5af1-44b3-8b28-34f998d1837d-kube-api-access-klcsz\") pod \"payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw\" (UID: \"d18eda81-5af1-44b3-8b28-34f998d1837d\") " pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:38.786098 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.785913    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d18eda81-5af1-44b3-8b28-34f998d1837d-plugins-config-volume\") pod \"payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw\" (UID: \"d18eda81-5af1-44b3-8b28-34f998d1837d\") " pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:38.888936 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.888885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klcsz\" (UniqueName: \"kubernetes.io/projected/d18eda81-5af1-44b3-8b28-34f998d1837d-kube-api-access-klcsz\") pod \"payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw\" (UID: \"d18eda81-5af1-44b3-8b28-34f998d1837d\") " pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:38.889112 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.888950    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d18eda81-5af1-44b3-8b28-34f998d1837d-plugins-config-volume\") pod \"payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw\" (UID: \"d18eda81-5af1-44b3-8b28-34f998d1837d\") " pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:38.890250 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.890216    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d18eda81-5af1-44b3-8b28-34f998d1837d-plugins-config-volume\") pod \"payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw\" (UID: \"d18eda81-5af1-44b3-8b28-34f998d1837d\") " pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:38.898541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.898502    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klcsz\" (UniqueName: \"kubernetes.io/projected/d18eda81-5af1-44b3-8b28-34f998d1837d-kube-api-access-klcsz\") pod \"payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw\" (UID: \"d18eda81-5af1-44b3-8b28-34f998d1837d\") " pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:38.929300 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:38.929270    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:39.044597 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:39.044555    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:39.241898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:39.241865    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"]
Sep 11 17:32:39.244008 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:32:39.243980    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02694eed_9ac2_4c6a_bc6f_debbd6418109.slice/crio-b773d51a08d820aa2519ac25a1603f94609a1e1957bf131b28fe6c4da6238841 WatchSource:0}: Error finding container b773d51a08d820aa2519ac25a1603f94609a1e1957bf131b28fe6c4da6238841: Status 404 returned error can't find the container with id b773d51a08d820aa2519ac25a1603f94609a1e1957bf131b28fe6c4da6238841
Sep 11 17:32:39.312332 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:39.312288    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr" event={"ID":"02694eed-9ac2-4c6a-bc6f-debbd6418109","Type":"ContainerStarted","Data":"b773d51a08d820aa2519ac25a1603f94609a1e1957bf131b28fe6c4da6238841"}
Sep 11 17:32:39.366136 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:32:39.366104    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd18eda81_5af1_44b3_8b28_34f998d1837d.slice/crio-c7f34ed247c2ced907a2493e8a8bd8e642771908b4ec0452fdadc3354efb6b64 WatchSource:0}: Error finding container c7f34ed247c2ced907a2493e8a8bd8e642771908b4ec0452fdadc3354efb6b64: Status 404 returned error can't find the container with id c7f34ed247c2ced907a2493e8a8bd8e642771908b4ec0452fdadc3354efb6b64
Sep 11 17:32:39.366507 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:39.366481    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"]
Sep 11 17:32:40.322242 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:40.322202    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw" event={"ID":"d18eda81-5af1-44b3-8b28-34f998d1837d","Type":"ContainerStarted","Data":"c7f34ed247c2ced907a2493e8a8bd8e642771908b4ec0452fdadc3354efb6b64"}
Sep 11 17:32:43.345574 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.345530    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr" event={"ID":"02694eed-9ac2-4c6a-bc6f-debbd6418109","Type":"ContainerStarted","Data":"cb170ff0379a1660ee8794c339bd2d1b5de2243acfee88f5b52dbf9637602ffb"}
Sep 11 17:32:43.346014 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.345609    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:43.347265 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.347238    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw" event={"ID":"d18eda81-5af1-44b3-8b28-34f998d1837d","Type":"ContainerStarted","Data":"6d5ba05a4ea388811113f5a9dd94240d8c1954e044d12937222f13b10c5704ee"}
Sep 11 17:32:43.347353 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.347295    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:43.348827 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.348792    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj" event={"ID":"c08049db-0815-4d24-ad82-4633c782199d","Type":"ContainerStarted","Data":"42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985"}
Sep 11 17:32:43.348998 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.348983    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:43.370752 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.370698    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr" podStartSLOduration=2.709368534 podStartE2EDuration="6.370680329s" totalImagesPullingTime="3.661311795s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:32:43.367071061 +0000 UTC m=+738.321760962" watchObservedRunningTime="2026-09-11 17:32:43.370680329 +0000 UTC m=+738.325370232"
Sep 11 17:32:43.396225 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.396161    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw" podStartSLOduration=1.889413743 podStartE2EDuration="5.39614111s" totalImagesPullingTime="3.506727367s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:32:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:32:43.389417992 +0000 UTC m=+738.344107892" watchObservedRunningTime="2026-09-11 17:32:43.39614111 +0000 UTC m=+738.350831013"
Sep 11 17:32:43.420358 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:43.420291    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj" podStartSLOduration=1.7387262479999999 podStartE2EDuration="6.420275084s" totalImagesPullingTime="4.681548836s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:32:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:32:43.418318591 +0000 UTC m=+738.373008496" watchObservedRunningTime="2026-09-11 17:32:43.420275084 +0000 UTC m=+738.374964976"
Sep 11 17:32:46.287549 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:46.287514    2584 patch_prober.go:28] interesting pod/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 17:32:46.287953 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:46.287581    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 17:32:47.375930 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:47.375894    2584 generic.go:356] "Generic (PLEG): container finished" podID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerID="bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10" exitCode=0
Sep 11 17:32:47.376419 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:47.375962    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" event={"ID":"05ea5314-2948-4183-b6f3-9d7d95615ab4","Type":"ContainerDied","Data":"bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10"}
Sep 11 17:32:47.376419 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:47.376360    2584 scope.go:117] "RemoveContainer" containerID="bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10"
Sep 11 17:32:47.378953 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:47.378920    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:32:47.379036 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:47.378987    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:32:47.379036 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:47.379023    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:32:48.388140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:48.388094    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" event={"ID":"05ea5314-2948-4183-b6f3-9d7d95615ab4","Type":"ContainerStarted","Data":"e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a"}
Sep 11 17:32:49.100570 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:49.100535    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:49.100748 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:49.100727    2584 patch_prober.go:28] interesting pod/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 17:32:49.100802 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:49.100773    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 17:32:49.359863 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:49.359781    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:32:50.100498 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:50.100465    2584 patch_prober.go:28] interesting pod/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 17:32:50.100963 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:50.100524    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 17:32:51.101093 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:51.101052    2584 patch_prober.go:28] interesting pod/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 17:32:51.101521 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:51.101112    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 17:32:52.100864 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:52.100819    2584 patch_prober.go:28] interesting pod/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 17:32:52.101061 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:52.100893    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 17:32:53.100016 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:53.099980    2584 patch_prober.go:28] interesting pod/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused" start-of-body=
Sep 11 17:32:53.100422 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:53.100049    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.46:15021/healthz/ready\": dial tcp 10.132.0.46:15021: connect: connection refused"
Sep 11 17:32:54.103632 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:54.103597    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:54.103980 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:54.103960    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:54.104652 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:54.104633    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:32:54.356297 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:54.356209    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:32:54.356297 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:54.356288    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:32:56.233230 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:32:56.233193    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:33:01.919589 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:01.919555    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"]
Sep 11 17:33:01.929992 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:01.929965    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:01.933366 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:01.933342    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-d148f3-serving-cert\""
Sep 11 17:33:01.940660 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:01.940637    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"]
Sep 11 17:33:02.015293 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.015254    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.015506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.015311    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shd9r\" (UniqueName: \"kubernetes.io/projected/ce132e49-b956-4c50-9c68-47fdfc46cba4-kube-api-access-shd9r\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.015506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.015342    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce132e49-b956-4c50-9c68-47fdfc46cba4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.015506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.015392    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-metrics-certs\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.116158 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.116119    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.116338 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.116174    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shd9r\" (UniqueName: \"kubernetes.io/projected/ce132e49-b956-4c50-9c68-47fdfc46cba4-kube-api-access-shd9r\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.116338 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:33:02.116281    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-serving-cert: secret "maas-api-e2e-inf-b-d148f3-serving-cert" not found
Sep 11 17:33:02.116338 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.116293    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce132e49-b956-4c50-9c68-47fdfc46cba4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.116519 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:33:02.116340    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls podName:ce132e49-b956-4c50-9c68-47fdfc46cba4 nodeName:}" failed. No retries permitted until 2026-09-11 17:33:02.616324982 +0000 UTC m=+757.571014865 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls") pod "maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg" (UID: "ce132e49-b956-4c50-9c68-47fdfc46cba4") : secret "maas-api-e2e-inf-b-d148f3-serving-cert" not found
Sep 11 17:33:02.116519 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.116424    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-metrics-certs\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.116907 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.116887    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce132e49-b956-4c50-9c68-47fdfc46cba4-openshift-service-ca\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.118904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.118880    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-metrics-certs\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.127265 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.127242    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shd9r\" (UniqueName: \"kubernetes.io/projected/ce132e49-b956-4c50-9c68-47fdfc46cba4-kube-api-access-shd9r\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.600906 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.600867    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"]
Sep 11 17:33:02.604560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.604542    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:02.607758 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.607737    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-d148f3\""
Sep 11 17:33:02.607903 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.607814    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-inf-b-d148f3-dockercfg-f74bk\""
Sep 11 17:33:02.620589 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.620560    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"]
Sep 11 17:33:02.621472 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.621448    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.623972 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.623949    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls\") pod \"maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.634194 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.634167    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"]
Sep 11 17:33:02.638017 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.637992    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:02.654703 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.654674    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"]
Sep 11 17:33:02.722667 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.722633    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7v54\" (UniqueName: \"kubernetes.io/projected/f4a13099-b634-4f23-9faf-cdf98c47dbf4-kube-api-access-k7v54\") pod \"payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5\" (UID: \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:02.722840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.722688    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fklg5\" (UniqueName: \"kubernetes.io/projected/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-kube-api-access-fklg5\") pod \"payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz\" (UID: \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:02.722840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.722783    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz\" (UID: \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:02.722840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.722820    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a13099-b634-4f23-9faf-cdf98c47dbf4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5\" (UID: \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:02.824132 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.824090    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fklg5\" (UniqueName: \"kubernetes.io/projected/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-kube-api-access-fklg5\") pod \"payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz\" (UID: \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:02.824325 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.824141    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz\" (UID: \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:02.824325 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.824176    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a13099-b634-4f23-9faf-cdf98c47dbf4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5\" (UID: \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:02.824325 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.824237    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7v54\" (UniqueName: \"kubernetes.io/projected/f4a13099-b634-4f23-9faf-cdf98c47dbf4-kube-api-access-k7v54\") pod \"payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5\" (UID: \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:02.824986 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.824966    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a13099-b634-4f23-9faf-cdf98c47dbf4-plugins-config-volume\") pod \"payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5\" (UID: \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:02.825031 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.824989    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz\" (UID: \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:02.832762 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.832737    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fklg5\" (UniqueName: \"kubernetes.io/projected/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-kube-api-access-fklg5\") pod \"payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz\" (UID: \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:02.832933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.832916    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7v54\" (UniqueName: \"kubernetes.io/projected/f4a13099-b634-4f23-9faf-cdf98c47dbf4-kube-api-access-k7v54\") pod \"payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5\" (UID: \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\") " pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:02.841802 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.841778    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:02.915826 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.915797    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:02.948864 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:02.948829    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:03.118642 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.118617    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"]
Sep 11 17:33:03.119798 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:33:03.119770    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce132e49_b956_4c50_9c68_47fdfc46cba4.slice/crio-164447eb2ed5e155f981c97b5ce6a996f06115d9f24faaa9e8957ce194e25dcf WatchSource:0}: Error finding container 164447eb2ed5e155f981c97b5ce6a996f06115d9f24faaa9e8957ce194e25dcf: Status 404 returned error can't find the container with id 164447eb2ed5e155f981c97b5ce6a996f06115d9f24faaa9e8957ce194e25dcf
Sep 11 17:33:03.203319 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.202115    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"]
Sep 11 17:33:03.205927 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:33:03.205901    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f42d19_2cfd_4aae_a6fe_a25a136d40bd.slice/crio-a1b2809c3151319e0962479d1dbb55af1d79b7a707768eddf3b18d39091ac43d WatchSource:0}: Error finding container a1b2809c3151319e0962479d1dbb55af1d79b7a707768eddf3b18d39091ac43d: Status 404 returned error can't find the container with id a1b2809c3151319e0962479d1dbb55af1d79b7a707768eddf3b18d39091ac43d
Sep 11 17:33:03.235461 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.235436    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"]
Sep 11 17:33:03.244628 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:33:03.244597    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4a13099_b634_4f23_9faf_cdf98c47dbf4.slice/crio-6a7c8442eba41de0dd5e21280c929c8bbd3128cddd4d64ed67a67d38f7e84f10 WatchSource:0}: Error finding container 6a7c8442eba41de0dd5e21280c929c8bbd3128cddd4d64ed67a67d38f7e84f10: Status 404 returned error can't find the container with id 6a7c8442eba41de0dd5e21280c929c8bbd3128cddd4d64ed67a67d38f7e84f10
Sep 11 17:33:03.478959 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.478908    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz" event={"ID":"58f42d19-2cfd-4aae-a6fe-a25a136d40bd","Type":"ContainerStarted","Data":"b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b"}
Sep 11 17:33:03.479212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.478974    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz" event={"ID":"58f42d19-2cfd-4aae-a6fe-a25a136d40bd","Type":"ContainerStarted","Data":"a1b2809c3151319e0962479d1dbb55af1d79b7a707768eddf3b18d39091ac43d"}
Sep 11 17:33:03.479212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.479008    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:03.480281 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.480255    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg" event={"ID":"ce132e49-b956-4c50-9c68-47fdfc46cba4","Type":"ContainerStarted","Data":"164447eb2ed5e155f981c97b5ce6a996f06115d9f24faaa9e8957ce194e25dcf"}
Sep 11 17:33:03.481909 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.481886    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5" event={"ID":"f4a13099-b634-4f23-9faf-cdf98c47dbf4","Type":"ContainerStarted","Data":"c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a"}
Sep 11 17:33:03.482029 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.481926    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5" event={"ID":"f4a13099-b634-4f23-9faf-cdf98c47dbf4","Type":"ContainerStarted","Data":"6a7c8442eba41de0dd5e21280c929c8bbd3128cddd4d64ed67a67d38f7e84f10"}
Sep 11 17:33:03.482029 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.481947    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:03.551566 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:03.551509    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz" podStartSLOduration=1.551486074 podStartE2EDuration="1.551486074s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:33:03.551441116 +0000 UTC m=+758.506131017" watchObservedRunningTime="2026-09-11 17:33:03.551486074 +0000 UTC m=+758.506175978"
Sep 11 17:33:04.490658 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:04.490610    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg" event={"ID":"ce132e49-b956-4c50-9c68-47fdfc46cba4","Type":"ContainerStarted","Data":"2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6"}
Sep 11 17:33:04.491191 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:04.490695    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:04.517532 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:04.517480    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg" podStartSLOduration=3.109141391 podStartE2EDuration="3.517464005s" totalImagesPullingTime="408.322614ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:33:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:33:04.514496055 +0000 UTC m=+759.469185957" watchObservedRunningTime="2026-09-11 17:33:04.517464005 +0000 UTC m=+759.472153939"
Sep 11 17:33:04.517735 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:04.517716    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5" podStartSLOduration=2.517709846 podStartE2EDuration="2.517709846s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:33:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:33:03.671698731 +0000 UTC m=+758.626388635" watchObservedRunningTime="2026-09-11 17:33:04.517709846 +0000 UTC m=+759.472400035"
Sep 11 17:33:09.040002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:09.039962    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:33:10.502455 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:10.502421    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:33:14.492586 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:14.492547    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:33:14.492974 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:14.492633    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:33:17.149434 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.149364    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"]
Sep 11 17:33:17.150242 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.150186    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj" podUID="c08049db-0815-4d24-ad82-4633c782199d" containerName="payload-pre-processing" containerID="cri-o://42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985" gracePeriod=30
Sep 11 17:33:17.184769 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:33:17.184730    2584 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08049db_0815_4d24_ad82_4633c782199d.slice/crio-42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985.scope\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc08049db_0815_4d24_ad82_4633c782199d.slice/crio-conmon-42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985.scope\": RecentStats: unable to find data in memory cache]"
Sep 11 17:33:17.405111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.405047    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:33:17.562555 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.562527    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08049db-0815-4d24-ad82-4633c782199d-plugins-config-volume\") pod \"c08049db-0815-4d24-ad82-4633c782199d\" (UID: \"c08049db-0815-4d24-ad82-4633c782199d\") "
Sep 11 17:33:17.562729 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.562577    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n7zk7\" (UniqueName: \"kubernetes.io/projected/c08049db-0815-4d24-ad82-4633c782199d-kube-api-access-n7zk7\") pod \"c08049db-0815-4d24-ad82-4633c782199d\" (UID: \"c08049db-0815-4d24-ad82-4633c782199d\") "
Sep 11 17:33:17.562914 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.562892    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c08049db-0815-4d24-ad82-4633c782199d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "c08049db-0815-4d24-ad82-4633c782199d" (UID: "c08049db-0815-4d24-ad82-4633c782199d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:33:17.564801 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.564770    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c08049db-0815-4d24-ad82-4633c782199d-kube-api-access-n7zk7" (OuterVolumeSpecName: "kube-api-access-n7zk7") pod "c08049db-0815-4d24-ad82-4633c782199d" (UID: "c08049db-0815-4d24-ad82-4633c782199d"). InnerVolumeSpecName "kube-api-access-n7zk7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:33:17.567785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.567717    2584 generic.go:356] "Generic (PLEG): container finished" podID="c08049db-0815-4d24-ad82-4633c782199d" containerID="42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985" exitCode=0
Sep 11 17:33:17.567785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.567797    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj" event={"ID":"c08049db-0815-4d24-ad82-4633c782199d","Type":"ContainerDied","Data":"42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985"}
Sep 11 17:33:17.568063 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.567855    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj" event={"ID":"c08049db-0815-4d24-ad82-4633c782199d","Type":"ContainerDied","Data":"6a6acf5d968a788482c37377ee428e17b2f31cd278f7c5bf1605dddd1eddbf9e"}
Sep 11 17:33:17.568063 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.567891    2584 scope.go:117] "RemoveContainer" containerID="42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985"
Sep 11 17:33:17.568183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.568075    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"
Sep 11 17:33:17.581031 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.581009    2584 scope.go:117] "RemoveContainer" containerID="42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985"
Sep 11 17:33:17.581374 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:33:17.581356    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985\": container with ID starting with 42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985 not found: ID does not exist" containerID="42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985"
Sep 11 17:33:17.581456 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.581384    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985"} err="failed to get container status \"42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985\": rpc error: code = NotFound desc = could not find container \"42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985\": container with ID starting with 42ad083932a989d13970683c92ff2971f6d24a76fe960504ba3f1992ba5fc985 not found: ID does not exist"
Sep 11 17:33:17.592980 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.592943    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"]
Sep 11 17:33:17.597564 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.597535    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-40972c14-6cb45c75fd-6kcbj"]
Sep 11 17:33:17.663444 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.663335    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c08049db-0815-4d24-ad82-4633c782199d-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:33:17.663444 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.663362    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n7zk7\" (UniqueName: \"kubernetes.io/projected/c08049db-0815-4d24-ad82-4633c782199d-kube-api-access-n7zk7\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:33:17.705315 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:17.705280    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c08049db-0815-4d24-ad82-4633c782199d" path="/var/lib/kubelet/pods/c08049db-0815-4d24-ad82-4633c782199d/volumes"
Sep 11 17:33:26.056274 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:26.056239    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:33:42.639176 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:33:42.639138    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:34:00.126946 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:00.126854    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:34:03.580237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.580207    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"]
Sep 11 17:34:03.580651 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.580637    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c08049db-0815-4d24-ad82-4633c782199d" containerName="payload-pre-processing"
Sep 11 17:34:03.580699 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.580653    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c08049db-0815-4d24-ad82-4633c782199d" containerName="payload-pre-processing"
Sep 11 17:34:03.580741 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.580716    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c08049db-0815-4d24-ad82-4633c782199d" containerName="payload-pre-processing"
Sep 11 17:34:03.583973 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.583951    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.586647 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.586628    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-a1d8713f-openshift-default-dockercfg-lpx4q\""
Sep 11 17:34:03.601629 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.601609    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"]
Sep 11 17:34:03.651315 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.651291    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istiod-ca-cert\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.651478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.651329    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-data\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.651478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.651346    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-certs\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.651896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.651865    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-podinfo\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.652136 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.652108    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8bw\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-kube-api-access-mh8bw\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.652327 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.652310    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-envoy\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.652509 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.652491    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-credential-socket\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.652649 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.652634    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-socket\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.652755 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.652741    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-token\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.753987 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.753952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-socket\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.753987 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.753993    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-token\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754123    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istiod-ca-cert\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-data\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754249 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754222    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-certs\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754395 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754289    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-podinfo\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754395 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754353    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8bw\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-kube-api-access-mh8bw\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754426    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-envoy\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754431    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-socket\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754489    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-credential-socket\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754521    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-certs\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754771    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-credential-socket\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754897 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754876    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istiod-ca-cert\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.754958 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.754900    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-data\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.756654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.756633    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-envoy\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.756764 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.756721    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-podinfo\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.762172 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.762149    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-token\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.762272 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.762245    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8bw\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-kube-api-access-mh8bw\") pod \"e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") " pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:03.894308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:03.894278    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:04.172982 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:04.172956    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"]
Sep 11 17:34:04.174936 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:34:04.174908    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2569bb41_7046_48ee_b3a7_0eb26d91faf7.slice/crio-a502630830c4c3d296beb19d2e479bc16a5b4d948b47bc153820c6471cf2bb87 WatchSource:0}: Error finding container a502630830c4c3d296beb19d2e479bc16a5b4d948b47bc153820c6471cf2bb87: Status 404 returned error can't find the container with id a502630830c4c3d296beb19d2e479bc16a5b4d948b47bc153820c6471cf2bb87
Sep 11 17:34:04.177229 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:04.177195    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:04.177313 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:04.177261    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:04.177313 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:04.177296    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:04.833171 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:04.833130    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" event={"ID":"2569bb41-7046-48ee-b3a7-0eb26d91faf7","Type":"ContainerStarted","Data":"8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc"}
Sep 11 17:34:04.833626 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:04.833195    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" event={"ID":"2569bb41-7046-48ee-b3a7-0eb26d91faf7","Type":"ContainerStarted","Data":"a502630830c4c3d296beb19d2e479bc16a5b4d948b47bc153820c6471cf2bb87"}
Sep 11 17:34:04.854560 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:04.854500    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" podStartSLOduration=1.8544805119999999 podStartE2EDuration="1.854480512s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:34:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:34:04.853653915 +0000 UTC m=+819.808343817" watchObservedRunningTime="2026-09-11 17:34:04.854480512 +0000 UTC m=+819.809170414"
Sep 11 17:34:04.895313 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:04.895284    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:05.899698 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:05.899669    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:06.844151 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:06.844124    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:06.845152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:06.845131    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:16.334296 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:16.334262    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:34:26.959693 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:26.959660    2584 generic.go:356] "Generic (PLEG): container finished" podID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerID="8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc" exitCode=0
Sep 11 17:34:26.960386 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:26.959735    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" event={"ID":"2569bb41-7046-48ee-b3a7-0eb26d91faf7","Type":"ContainerDied","Data":"8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc"}
Sep 11 17:34:26.960386 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:26.960227    2584 scope.go:117] "RemoveContainer" containerID="8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc"
Sep 11 17:34:26.961439 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:26.961378    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:26.961501 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:26.961472    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:26.961544 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:26.961514    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:27.967650 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:27.967618    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" event={"ID":"2569bb41-7046-48ee-b3a7-0eb26d91faf7","Type":"ContainerStarted","Data":"65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c"}
Sep 11 17:34:28.894931 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:28.894877    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:28.895322 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:28.895296    2584 patch_prober.go:28] interesting pod/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 17:34:28.895449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:28.895361    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 17:34:29.895476 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:29.895438    2584 patch_prober.go:28] interesting pod/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 17:34:29.895961 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:29.895505    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 17:34:30.894942 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:30.894909    2584 patch_prober.go:28] interesting pod/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 17:34:30.895183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:30.895153    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 17:34:31.895097 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:31.895051    2584 patch_prober.go:28] interesting pod/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 17:34:31.895744 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:31.895120    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 17:34:32.895117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:32.895075    2584 patch_prober.go:28] interesting pod/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused" start-of-body=
Sep 11 17:34:32.895728 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:32.895693    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.54:15021/healthz/ready\": dial tcp 10.132.0.54:15021: connect: connection refused"
Sep 11 17:34:33.898541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:33.898510    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:33.898924 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:33.898775    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:33.899388 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:33.899371    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:35.861947 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:35.861915    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:34:45.849511 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:45.849477    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"]
Sep 11 17:34:45.849980 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:45.849727    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr" podUID="02694eed-9ac2-4c6a-bc6f-debbd6418109" containerName="maas-api" containerID="cri-o://cb170ff0379a1660ee8794c339bd2d1b5de2243acfee88f5b52dbf9637602ffb" gracePeriod=30
Sep 11 17:34:45.902775 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:45.902740    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"]
Sep 11 17:34:45.902998 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:45.902959    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw" podUID="d18eda81-5af1-44b3-8b28-34f998d1837d" containerName="payload-processing" containerID="cri-o://6d5ba05a4ea388811113f5a9dd94240d8c1954e044d12937222f13b10c5704ee" gracePeriod=30
Sep 11 17:34:46.085152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.085107    2584 generic.go:356] "Generic (PLEG): container finished" podID="d18eda81-5af1-44b3-8b28-34f998d1837d" containerID="6d5ba05a4ea388811113f5a9dd94240d8c1954e044d12937222f13b10c5704ee" exitCode=0
Sep 11 17:34:46.085309 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.085148    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw" event={"ID":"d18eda81-5af1-44b3-8b28-34f998d1837d","Type":"ContainerDied","Data":"6d5ba05a4ea388811113f5a9dd94240d8c1954e044d12937222f13b10c5704ee"}
Sep 11 17:34:46.087094 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.087069    2584 generic.go:356] "Generic (PLEG): container finished" podID="02694eed-9ac2-4c6a-bc6f-debbd6418109" containerID="cb170ff0379a1660ee8794c339bd2d1b5de2243acfee88f5b52dbf9637602ffb" exitCode=0
Sep 11 17:34:46.087217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.087167    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr" event={"ID":"02694eed-9ac2-4c6a-bc6f-debbd6418109","Type":"ContainerDied","Data":"cb170ff0379a1660ee8794c339bd2d1b5de2243acfee88f5b52dbf9637602ffb"}
Sep 11 17:34:46.160489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.160455    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:34:46.191309 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.191281    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:34:46.261427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.261367    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02694eed-9ac2-4c6a-bc6f-debbd6418109-openshift-service-ca\") pod \"02694eed-9ac2-4c6a-bc6f-debbd6418109\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") "
Sep 11 17:34:46.261621 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.261469    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls\") pod \"02694eed-9ac2-4c6a-bc6f-debbd6418109\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") "
Sep 11 17:34:46.261621 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.261504    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-metrics-certs\") pod \"02694eed-9ac2-4c6a-bc6f-debbd6418109\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") "
Sep 11 17:34:46.261621 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.261564    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-klcsz\" (UniqueName: \"kubernetes.io/projected/d18eda81-5af1-44b3-8b28-34f998d1837d-kube-api-access-klcsz\") pod \"d18eda81-5af1-44b3-8b28-34f998d1837d\" (UID: \"d18eda81-5af1-44b3-8b28-34f998d1837d\") "
Sep 11 17:34:46.261621 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.261602    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-494w5\" (UniqueName: \"kubernetes.io/projected/02694eed-9ac2-4c6a-bc6f-debbd6418109-kube-api-access-494w5\") pod \"02694eed-9ac2-4c6a-bc6f-debbd6418109\" (UID: \"02694eed-9ac2-4c6a-bc6f-debbd6418109\") "
Sep 11 17:34:46.261830 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.261636    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d18eda81-5af1-44b3-8b28-34f998d1837d-plugins-config-volume\") pod \"d18eda81-5af1-44b3-8b28-34f998d1837d\" (UID: \"d18eda81-5af1-44b3-8b28-34f998d1837d\") "
Sep 11 17:34:46.261830 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.261776    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02694eed-9ac2-4c6a-bc6f-debbd6418109-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "02694eed-9ac2-4c6a-bc6f-debbd6418109" (UID: "02694eed-9ac2-4c6a-bc6f-debbd6418109"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:34:46.262038 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.262012    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/02694eed-9ac2-4c6a-bc6f-debbd6418109-openshift-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:46.262158 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.262085    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d18eda81-5af1-44b3-8b28-34f998d1837d-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "d18eda81-5af1-44b3-8b28-34f998d1837d" (UID: "d18eda81-5af1-44b3-8b28-34f998d1837d"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:34:46.263907 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.263880    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02694eed-9ac2-4c6a-bc6f-debbd6418109-kube-api-access-494w5" (OuterVolumeSpecName: "kube-api-access-494w5") pod "02694eed-9ac2-4c6a-bc6f-debbd6418109" (UID: "02694eed-9ac2-4c6a-bc6f-debbd6418109"). InnerVolumeSpecName "kube-api-access-494w5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:34:46.263907 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.263898    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "02694eed-9ac2-4c6a-bc6f-debbd6418109" (UID: "02694eed-9ac2-4c6a-bc6f-debbd6418109"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:34:46.264057 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.264040    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "02694eed-9ac2-4c6a-bc6f-debbd6418109" (UID: "02694eed-9ac2-4c6a-bc6f-debbd6418109"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:34:46.264097 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.264046    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d18eda81-5af1-44b3-8b28-34f998d1837d-kube-api-access-klcsz" (OuterVolumeSpecName: "kube-api-access-klcsz") pod "d18eda81-5af1-44b3-8b28-34f998d1837d" (UID: "d18eda81-5af1-44b3-8b28-34f998d1837d"). InnerVolumeSpecName "kube-api-access-klcsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:34:46.362897 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.362858    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-maas-api-tls\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:46.362897 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.362890    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02694eed-9ac2-4c6a-bc6f-debbd6418109-metrics-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:46.362897 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.362904    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-klcsz\" (UniqueName: \"kubernetes.io/projected/d18eda81-5af1-44b3-8b28-34f998d1837d-kube-api-access-klcsz\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:46.363162 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.362915    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-494w5\" (UniqueName: \"kubernetes.io/projected/02694eed-9ac2-4c6a-bc6f-debbd6418109-kube-api-access-494w5\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:46.363162 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:46.362928    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/d18eda81-5af1-44b3-8b28-34f998d1837d-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:47.094661 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.094631    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"
Sep 11 17:34:47.095099 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.094677    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr" event={"ID":"02694eed-9ac2-4c6a-bc6f-debbd6418109","Type":"ContainerDied","Data":"b773d51a08d820aa2519ac25a1603f94609a1e1957bf131b28fe6c4da6238841"}
Sep 11 17:34:47.095099 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.094750    2584 scope.go:117] "RemoveContainer" containerID="cb170ff0379a1660ee8794c339bd2d1b5de2243acfee88f5b52dbf9637602ffb"
Sep 11 17:34:47.096113 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.096088    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw" event={"ID":"d18eda81-5af1-44b3-8b28-34f998d1837d","Type":"ContainerDied","Data":"c7f34ed247c2ced907a2493e8a8bd8e642771908b4ec0452fdadc3354efb6b64"}
Sep 11 17:34:47.096190 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.096119    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"
Sep 11 17:34:47.105063 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.105043    2584 scope.go:117] "RemoveContainer" containerID="6d5ba05a4ea388811113f5a9dd94240d8c1954e044d12937222f13b10c5704ee"
Sep 11 17:34:47.121412 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.121371    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"]
Sep 11 17:34:47.123705 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.123684    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-autores-3005e5-784d694558-mk2nr"]
Sep 11 17:34:47.137261 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.137224    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"]
Sep 11 17:34:47.141872 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.141844    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-3005e5-5566d477cc-kmtqw"]
Sep 11 17:34:47.706474 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.706430    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02694eed-9ac2-4c6a-bc6f-debbd6418109" path="/var/lib/kubelet/pods/02694eed-9ac2-4c6a-bc6f-debbd6418109/volumes"
Sep 11 17:34:47.706906 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:47.706885    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d18eda81-5af1-44b3-8b28-34f998d1837d" path="/var/lib/kubelet/pods/d18eda81-5af1-44b3-8b28-34f998d1837d/volumes"
Sep 11 17:34:49.361529 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:49.361492    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"]
Sep 11 17:34:49.361941 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:49.361718    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy" containerID="cri-o://65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c" gracePeriod=30
Sep 11 17:34:49.533209 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:49.533167    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:34:50.100051 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.100019    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"]
Sep 11 17:34:50.100612 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.100592    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02694eed-9ac2-4c6a-bc6f-debbd6418109" containerName="maas-api"
Sep 11 17:34:50.100674 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.100616    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="02694eed-9ac2-4c6a-bc6f-debbd6418109" containerName="maas-api"
Sep 11 17:34:50.100674 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.100634    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d18eda81-5af1-44b3-8b28-34f998d1837d" containerName="payload-processing"
Sep 11 17:34:50.100674 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.100643    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d18eda81-5af1-44b3-8b28-34f998d1837d" containerName="payload-processing"
Sep 11 17:34:50.100784 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.100772    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d18eda81-5af1-44b3-8b28-34f998d1837d" containerName="payload-processing"
Sep 11 17:34:50.100820 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.100787    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="02694eed-9ac2-4c6a-bc6f-debbd6418109" containerName="maas-api"
Sep 11 17:34:50.105740 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.105718    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.108091 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.108066    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-c4a3e530-openshift-default-dockercfg-d7m7b\""
Sep 11 17:34:50.115152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.115125    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"]
Sep 11 17:34:50.200542 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200504    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-token\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.200722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200566    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-socket\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.200722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200601    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b3ac88b-2113-4f77-9aae-9025419844b0-istiod-ca-cert\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.200722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200642    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-podinfo\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.200722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200674    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-credential-socket\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.200722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-certs\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.200891 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200732    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-data\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.200891 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200751    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5dzv\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-kube-api-access-h5dzv\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.200891 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.200776    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-envoy\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302024 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.301972    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-podinfo\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302024 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302018    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-credential-socket\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302039    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-certs\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302155    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-data\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302192    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5dzv\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-kube-api-access-h5dzv\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302241    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-envoy\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302263    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-token\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302609 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302345    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-socket\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302609 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302381    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b3ac88b-2113-4f77-9aae-9025419844b0-istiod-ca-cert\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302609 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302448    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-certs\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302609 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302485    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-credential-socket\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302814 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302787    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-socket\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.302870 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.302831    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-data\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.303099 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.303078    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b3ac88b-2113-4f77-9aae-9025419844b0-istiod-ca-cert\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.304529 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.304501    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-envoy\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.304663 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.304645    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-podinfo\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.310801 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.310749    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5dzv\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-kube-api-access-h5dzv\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.311088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.311068    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-token\") pod \"e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") " pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.417105 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.417069    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:50.710561 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.707221    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"]
Sep 11 17:34:50.710561 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:34:50.708100    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b3ac88b_2113_4f77_9aae_9025419844b0.slice/crio-65bfc701e72133ac546b30935898c8f4bff0e2ca66519d49495e332c110b5de9 WatchSource:0}: Error finding container 65bfc701e72133ac546b30935898c8f4bff0e2ca66519d49495e332c110b5de9: Status 404 returned error can't find the container with id 65bfc701e72133ac546b30935898c8f4bff0e2ca66519d49495e332c110b5de9
Sep 11 17:34:50.712481 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.711602    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:50.712481 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.711737    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:50.712481 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:50.711830    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:34:51.124354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:51.124262    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" event={"ID":"3b3ac88b-2113-4f77-9aae-9025419844b0","Type":"ContainerStarted","Data":"59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f"}
Sep 11 17:34:51.124354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:51.124314    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" event={"ID":"3b3ac88b-2113-4f77-9aae-9025419844b0","Type":"ContainerStarted","Data":"65bfc701e72133ac546b30935898c8f4bff0e2ca66519d49495e332c110b5de9"}
Sep 11 17:34:51.143415 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:51.143327    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podStartSLOduration=1.1433112 podStartE2EDuration="1.1433112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:34:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:34:51.142381303 +0000 UTC m=+866.097071206" watchObservedRunningTime="2026-09-11 17:34:51.1433112 +0000 UTC m=+866.098001102"
Sep 11 17:34:51.418144 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:51.418105    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:51.423696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:51.423670    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:52.130225 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:52.130184    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:52.131149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:52.131130    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:34:54.630210 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.630190    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:54.745072 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745044    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-data\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745072 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745075    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-podinfo\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745302 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745095    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-envoy\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745302 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745142    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istiod-ca-cert\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745302 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745254    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-certs\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745484 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745296    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-data" (OuterVolumeSpecName: "istio-data") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:34:54.745484 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745321    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mh8bw\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-kube-api-access-mh8bw\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745580 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745533    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:34:54.745580 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745558    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:34:54.745674 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745645    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-token\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745730 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745715    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-socket\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745780 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745767    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-credential-socket\") pod \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\" (UID: \"2569bb41-7046-48ee-b3a7-0eb26d91faf7\") "
Sep 11 17:34:54.745955 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.745933    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:34:54.746095 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.746076    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istiod-ca-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:54.746163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.746101    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:54.746163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.746116    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-workload-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:54.746163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.746116    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:34:54.746163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.746130    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-data\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:54.747460 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.747437    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:34:54.747534 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.747511    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-kube-api-access-mh8bw" (OuterVolumeSpecName: "kube-api-access-mh8bw") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "kube-api-access-mh8bw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:34:54.747702 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.747687    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-token" (OuterVolumeSpecName: "istio-token") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:34:54.747740 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.747690    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2569bb41-7046-48ee-b3a7-0eb26d91faf7" (UID: "2569bb41-7046-48ee-b3a7-0eb26d91faf7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:34:54.847047 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.847017    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-credential-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:54.847047 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.847042    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-podinfo\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:54.847047 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.847052    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-envoy\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:54.847287 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.847060    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mh8bw\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-kube-api-access-mh8bw\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:54.847287 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:54.847068    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2569bb41-7046-48ee-b3a7-0eb26d91faf7-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:34:55.148871 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.148839    2584 generic.go:356] "Generic (PLEG): container finished" podID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerID="65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c" exitCode=0
Sep 11 17:34:55.149044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.148921    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" event={"ID":"2569bb41-7046-48ee-b3a7-0eb26d91faf7","Type":"ContainerDied","Data":"65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c"}
Sep 11 17:34:55.149044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.148960    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7" event={"ID":"2569bb41-7046-48ee-b3a7-0eb26d91faf7","Type":"ContainerDied","Data":"a502630830c4c3d296beb19d2e479bc16a5b4d948b47bc153820c6471cf2bb87"}
Sep 11 17:34:55.149044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.148964    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"
Sep 11 17:34:55.149044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.148982    2584 scope.go:117] "RemoveContainer" containerID="65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c"
Sep 11 17:34:55.162683 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.162642    2584 scope.go:117] "RemoveContainer" containerID="8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc"
Sep 11 17:34:55.172685 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.172614    2584 scope.go:117] "RemoveContainer" containerID="65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c"
Sep 11 17:34:55.173021 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:34:55.172993    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c\": container with ID starting with 65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c not found: ID does not exist" containerID="65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c"
Sep 11 17:34:55.173116 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.173036    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c"} err="failed to get container status \"65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c\": rpc error: code = NotFound desc = could not find container \"65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c\": container with ID starting with 65b3c4c04df3c3f1c01f86b7f46954f1827cdfe40a8a47e0bbfa14bd95ad5f8c not found: ID does not exist"
Sep 11 17:34:55.173116 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.173062    2584 scope.go:117] "RemoveContainer" containerID="8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc"
Sep 11 17:34:55.173387 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:34:55.173359    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc\": container with ID starting with 8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc not found: ID does not exist" containerID="8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc"
Sep 11 17:34:55.173558 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.173393    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc"} err="failed to get container status \"8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc\": rpc error: code = NotFound desc = could not find container \"8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc\": container with ID starting with 8321237706c72eeff128ceee31773a67388a713310d1157231d996e9a55976bc not found: ID does not exist"
Sep 11 17:34:55.175763 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.175737    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"]
Sep 11 17:34:55.178183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.178161    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-a1d8713f-openshift-default-7d5c7468d6-4mfn7"]
Sep 11 17:34:55.179134 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:34:55.179114    2584 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2569bb41_7046_48ee_b3a7_0eb26d91faf7.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2569bb41_7046_48ee_b3a7_0eb26d91faf7.slice/crio-a502630830c4c3d296beb19d2e479bc16a5b4d948b47bc153820c6471cf2bb87\": RecentStats: unable to find data in memory cache]"
Sep 11 17:34:55.707507 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:34:55.707474    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" path="/var/lib/kubelet/pods/2569bb41-7046-48ee-b3a7-0eb26d91faf7/volumes"
Sep 11 17:35:07.998809 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:07.997921    2584 patch_prober.go:28] interesting pod/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:42270->10.132.0.55:15021: read: connection reset by peer" start-of-body=
Sep 11 17:35:07.998809 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:07.997994    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": read tcp 10.132.0.2:42270->10.132.0.55:15021: read: connection reset by peer"
Sep 11 17:35:08.247312 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:08.247212    2584 generic.go:356] "Generic (PLEG): container finished" podID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerID="59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f" exitCode=0
Sep 11 17:35:08.247312 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:08.247256    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" event={"ID":"3b3ac88b-2113-4f77-9aae-9025419844b0","Type":"ContainerDied","Data":"59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f"}
Sep 11 17:35:08.247682 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:08.247667    2584 scope.go:117] "RemoveContainer" containerID="59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f"
Sep 11 17:35:08.248716 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:08.248690    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:35:08.248781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:08.248768    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:35:08.248836 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:08.248825    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:35:09.254387 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:09.254354    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" event={"ID":"3b3ac88b-2113-4f77-9aae-9025419844b0","Type":"ContainerStarted","Data":"c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c"}
Sep 11 17:35:09.418243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:09.418202    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:35:09.418441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:09.418386    2584 patch_prober.go:28] interesting pod/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 17:35:09.418489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:09.418467    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 17:35:09.736491 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:09.736455    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:35:10.417638 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:10.417600    2584 patch_prober.go:28] interesting pod/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 17:35:10.418054 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:10.417656    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 17:35:11.417393 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:11.417361    2584 patch_prober.go:28] interesting pod/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 17:35:11.417588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:11.417442    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 17:35:12.417925 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:12.417882    2584 patch_prober.go:28] interesting pod/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 17:35:12.418443 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:12.417949    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 17:35:13.418052 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:13.418018    2584 patch_prober.go:28] interesting pod/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 17:35:13.418476 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:13.418086    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 17:35:14.417954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:14.417916    2584 patch_prober.go:28] interesting pod/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body=
Sep 11 17:35:14.418151 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:14.417984    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused"
Sep 11 17:35:15.421770 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:15.421735    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:35:15.422156 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:15.422105    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:35:15.422908 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:15.422884    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:35:24.882174 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:24.882135    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"]
Sep 11 17:35:24.882566 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:24.882346    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy" containerID="cri-o://c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c" gracePeriod=30
Sep 11 17:35:25.560845 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:25.560800    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:35:25.561046 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:25.560962    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:35:30.144446 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.144367    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:35:30.264139 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264103    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-envoy\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264139 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264142    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-token\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264193    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-data\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264217    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h5dzv\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-kube-api-access-h5dzv\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264257    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-podinfo\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264282    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-socket\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264311    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-certs\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264394    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b3ac88b-2113-4f77-9aae-9025419844b0-istiod-ca-cert\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264432    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-credential-socket\") pod \"3b3ac88b-2113-4f77-9aae-9025419844b0\" (UID: \"3b3ac88b-2113-4f77-9aae-9025419844b0\") "
Sep 11 17:35:30.264671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264538    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:35:30.264823 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264722    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-data\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.264823 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264721    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:35:30.264929 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264834    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:35:30.264929 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264883    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b3ac88b-2113-4f77-9aae-9025419844b0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:35:30.265033 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.264935    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:35:30.266389 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.266363    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:35:30.266590 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.266560    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:35:30.266667 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.266589    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:35:30.266712 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.266647    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-kube-api-access-h5dzv" (OuterVolumeSpecName: "kube-api-access-h5dzv") pod "3b3ac88b-2113-4f77-9aae-9025419844b0" (UID: "3b3ac88b-2113-4f77-9aae-9025419844b0"). InnerVolumeSpecName "kube-api-access-h5dzv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:35:30.322672 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.322636    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:35:30.365689 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.365652    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h5dzv\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-kube-api-access-h5dzv\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.365689 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.365682    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-podinfo\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.365689 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.365695    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.365933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.365709    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-workload-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.365933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.365720    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b3ac88b-2113-4f77-9aae-9025419844b0-istiod-ca-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.365933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.365730    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-credential-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.365933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.365741    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-envoy\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.365933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.365752    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b3ac88b-2113-4f77-9aae-9025419844b0-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:35:30.390812 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.390772    2584 generic.go:356] "Generic (PLEG): container finished" podID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerID="c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c" exitCode=0
Sep 11 17:35:30.390994 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.390823    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"
Sep 11 17:35:30.390994 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.390862    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" event={"ID":"3b3ac88b-2113-4f77-9aae-9025419844b0","Type":"ContainerDied","Data":"c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c"}
Sep 11 17:35:30.390994 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.390922    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b" event={"ID":"3b3ac88b-2113-4f77-9aae-9025419844b0","Type":"ContainerDied","Data":"65bfc701e72133ac546b30935898c8f4bff0e2ca66519d49495e332c110b5de9"}
Sep 11 17:35:30.390994 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.390950    2584 scope.go:117] "RemoveContainer" containerID="c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c"
Sep 11 17:35:30.400813 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.400794    2584 scope.go:117] "RemoveContainer" containerID="59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f"
Sep 11 17:35:30.409201 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.409178    2584 scope.go:117] "RemoveContainer" containerID="c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c"
Sep 11 17:35:30.409498 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:35:30.409477    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c\": container with ID starting with c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c not found: ID does not exist" containerID="c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c"
Sep 11 17:35:30.409557 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.409509    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c"} err="failed to get container status \"c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c\": rpc error: code = NotFound desc = could not find container \"c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c\": container with ID starting with c853ef47e05b124eb10c86f0c7bf43fa691bc5bcf1c90eb628b5c9870f7a075c not found: ID does not exist"
Sep 11 17:35:30.409557 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.409529    2584 scope.go:117] "RemoveContainer" containerID="59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f"
Sep 11 17:35:30.409794 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:35:30.409776    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f\": container with ID starting with 59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f not found: ID does not exist" containerID="59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f"
Sep 11 17:35:30.409839 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.409800    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f"} err="failed to get container status \"59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f\": rpc error: code = NotFound desc = could not find container \"59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f\": container with ID starting with 59cd6ea76f6eccbfb74a7af9e6a42e8ba3c8affc963268b29dd9dfdb3687437f not found: ID does not exist"
Sep 11 17:35:30.413481 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.413457    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"]
Sep 11 17:35:30.416653 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:30.416631    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-c4a3e530-openshift-default-c9cb65996-jzc9b"]
Sep 11 17:35:31.705547 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:31.705513    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" path="/var/lib/kubelet/pods/3b3ac88b-2113-4f77-9aae-9025419844b0/volumes"
Sep 11 17:35:44.084794 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.084757    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"]
Sep 11 17:35:44.085769 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085747    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy"
Sep 11 17:35:44.085769 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085769    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy"
Sep 11 17:35:44.085926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085788    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy"
Sep 11 17:35:44.085926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085793    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy"
Sep 11 17:35:44.085926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085800    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy"
Sep 11 17:35:44.085926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085805    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy"
Sep 11 17:35:44.085926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085876    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy"
Sep 11 17:35:44.085926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085908    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy"
Sep 11 17:35:44.085926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.085915    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2569bb41-7046-48ee-b3a7-0eb26d91faf7" containerName="istio-proxy"
Sep 11 17:35:44.090616 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.090596    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.093136 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.093115    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-87b0dc-openshift-default-dockercfg-brjgs\""
Sep 11 17:35:44.099751 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.099728    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"]
Sep 11 17:35:44.179686 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.179656    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-data\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.179904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.179693    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-socket\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.179904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.179725    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txv2h\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-kube-api-access-txv2h\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.179904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.179772    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-token\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.179904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.179857    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-credential-socket\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.179904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.179886    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-envoy\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.180216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.179973    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-podinfo\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.180216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.179991    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-certs\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.180216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.180006    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istiod-ca-cert\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.281480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-podinfo\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.281480 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281483    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-certs\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.281706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281498    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istiod-ca-cert\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.281706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281523    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-data\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.281706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281552    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-socket\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.281706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281575    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txv2h\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-kube-api-access-txv2h\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.281706 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281598    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-token\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.282002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281709    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-credential-socket\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.282002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281749    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-envoy\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.282002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281881    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-certs\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.282002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281923    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-socket\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.282002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.281998    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-data\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.282192 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.282059    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-credential-socket\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.282513 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.282495    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istiod-ca-cert\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.283988 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.283966    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-envoy\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.284268 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.284206    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-podinfo\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.289943 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.289921    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-token\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.290180 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.290159    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txv2h\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-kube-api-access-txv2h\") pod \"e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") " pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.403773 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.403730    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:44.681382 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.681356    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"]
Sep 11 17:35:44.683685 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:35:44.683655    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c69eb0_4e44_414d_9e06_ddf19bcd6478.slice/crio-b4d18ec259e528d703dc937971074fb25588b62d59d1297034d974ee1ce874f8 WatchSource:0}: Error finding container b4d18ec259e528d703dc937971074fb25588b62d59d1297034d974ee1ce874f8: Status 404 returned error can't find the container with id b4d18ec259e528d703dc937971074fb25588b62d59d1297034d974ee1ce874f8
Sep 11 17:35:44.685909 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.685871    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:35:44.686000 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.685961    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:35:44.686039 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:44.685999    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:35:45.480563 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:45.480523    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" event={"ID":"b3c69eb0-4e44-414d-9e06-ddf19bcd6478","Type":"ContainerStarted","Data":"263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4"}
Sep 11 17:35:45.480958 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:45.480621    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" event={"ID":"b3c69eb0-4e44-414d-9e06-ddf19bcd6478","Type":"ContainerStarted","Data":"b4d18ec259e528d703dc937971074fb25588b62d59d1297034d974ee1ce874f8"}
Sep 11 17:35:45.504315 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:45.504254    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" podStartSLOduration=1.504235768 podStartE2EDuration="1.504235768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:35:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:35:45.504142691 +0000 UTC m=+920.458832646" watchObservedRunningTime="2026-09-11 17:35:45.504235768 +0000 UTC m=+920.458925670"
Sep 11 17:35:46.404635 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:46.404590    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:46.409200 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:46.409179    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:46.486649 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:46.486619    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:46.487582 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:46.487560    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:35:49.930320 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:35:49.930288    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:36:08.925109 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:08.925068    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:36:10.648545 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:10.648507    2584 generic.go:356] "Generic (PLEG): container finished" podID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerID="263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4" exitCode=0
Sep 11 17:36:10.648978 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:10.648581    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" event={"ID":"b3c69eb0-4e44-414d-9e06-ddf19bcd6478","Type":"ContainerDied","Data":"263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4"}
Sep 11 17:36:10.649046 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:10.649027    2584 scope.go:117] "RemoveContainer" containerID="263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4"
Sep 11 17:36:10.650120 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:10.650086    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:36:10.650186 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:10.650155    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:36:10.650228 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:10.650188    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:36:11.655467 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:11.655432    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" event={"ID":"b3c69eb0-4e44-414d-9e06-ddf19bcd6478","Type":"ContainerStarted","Data":"f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8"}
Sep 11 17:36:12.404696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:12.404659    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:36:12.405995 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:12.405966    2584 patch_prober.go:28] interesting pod/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 17:36:12.406121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:12.406026    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 17:36:13.404441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:13.404379    2584 patch_prober.go:28] interesting pod/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 17:36:13.404830 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:13.404483    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 17:36:14.404717 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:14.404679    2584 patch_prober.go:28] interesting pod/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 17:36:14.405132 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:14.404752    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 17:36:15.404252 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:15.404216    2584 patch_prober.go:28] interesting pod/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 17:36:15.404467 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:15.404268    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 17:36:16.404968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:16.404926    2584 patch_prober.go:28] interesting pod/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body=
Sep 11 17:36:16.405389 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:16.404985    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused"
Sep 11 17:36:16.487872 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:16.487025    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:36:17.408880 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:17.408850    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:36:17.409923 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:17.409906    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:36:26.037957 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:26.037923    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:36:39.129119 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:39.129085    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:36:48.543240 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:36:48.543151    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:37:01.978594 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:01.978559    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"]
Sep 11 17:37:01.979110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:01.979075    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy"
Sep 11 17:37:01.979110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:01.979092    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy"
Sep 11 17:37:01.979185 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:01.979160    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b3ac88b-2113-4f77-9aae-9025419844b0" containerName="istio-proxy"
Sep 11 17:37:01.981797 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:01.981781    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:01.987374 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:01.987350    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-2340fb02-openshift-default-dockercfg-z64m9\""
Sep 11 17:37:02.010528 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.010496    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"]
Sep 11 17:37:02.074551 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074518    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-credential-socket\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.074730 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074595    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-certs\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.074730 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074617    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-envoy\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.074730 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074641    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-istio-token\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.074730 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3582b016-c230-491f-9598-d75c66bdcfef-istiod-ca-cert\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.074730 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074690    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-socket\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.074730 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074707    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-data\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.074730 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074729    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zccdf\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-kube-api-access-zccdf\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.074966 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.074809    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3582b016-c230-491f-9598-d75c66bdcfef-istio-podinfo\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.175526 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175477    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-istio-token\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.175526 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175524    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3582b016-c230-491f-9598-d75c66bdcfef-istiod-ca-cert\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.175793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-socket\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.175793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175585    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-data\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.175793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175617    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zccdf\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-kube-api-access-zccdf\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.175793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175719    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3582b016-c230-491f-9598-d75c66bdcfef-istio-podinfo\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.175793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175759    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-credential-socket\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.176084 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175845    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-certs\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.176084 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.175877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-envoy\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.176297 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.176212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-data\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.176520 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.176494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-socket\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.177737 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.177690    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3582b016-c230-491f-9598-d75c66bdcfef-istiod-ca-cert\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.178264 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.178201    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-certs\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.178828 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.178777    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-envoy\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.178933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.178867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-credential-socket\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.179232 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.179198    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3582b016-c230-491f-9598-d75c66bdcfef-istio-podinfo\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.187640 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.187614    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-istio-token\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.187908 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.187882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zccdf\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-kube-api-access-zccdf\") pod \"e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") " pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.292047 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.291948    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:02.573110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.573079    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"]
Sep 11 17:37:02.575374 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:37:02.575344    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3582b016_c230_491f_9598_d75c66bdcfef.slice/crio-7eb4245e5f825c025c7241af7fb6553dc939800ee50205b4e42300e6b78802a5 WatchSource:0}: Error finding container 7eb4245e5f825c025c7241af7fb6553dc939800ee50205b4e42300e6b78802a5: Status 404 returned error can't find the container with id 7eb4245e5f825c025c7241af7fb6553dc939800ee50205b4e42300e6b78802a5
Sep 11 17:37:02.578140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.578107    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:37:02.578237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.578171    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:37:02.578237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.578198    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:37:02.973033 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.972995    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" event={"ID":"3582b016-c230-491f-9598-d75c66bdcfef","Type":"ContainerStarted","Data":"3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4"}
Sep 11 17:37:02.973233 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.973057    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" event={"ID":"3582b016-c230-491f-9598-d75c66bdcfef","Type":"ContainerStarted","Data":"7eb4245e5f825c025c7241af7fb6553dc939800ee50205b4e42300e6b78802a5"}
Sep 11 17:37:02.996635 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:02.996581    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" podStartSLOduration=1.996565249 podStartE2EDuration="1.996565249s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:37:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:37:02.99519105 +0000 UTC m=+997.949880970" watchObservedRunningTime="2026-09-11 17:37:02.996565249 +0000 UTC m=+997.951255150"
Sep 11 17:37:03.292349 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:03.292269    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:03.297466 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:03.297439    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:03.979462 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:03.979428    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:03.980340 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:03.980320    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:07.327049 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:07.327012    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:37:08.798707 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.798665    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"]
Sep 11 17:37:08.802555 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.802530    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:08.805080 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.805055    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-2340fb02\""
Sep 11 17:37:08.805209 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.805111    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-2340fb02-dockercfg-s4nk2\""
Sep 11 17:37:08.815509 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.815480    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"]
Sep 11 17:37:08.827132 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.827105    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"]
Sep 11 17:37:08.830798 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.830778    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:08.835691 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.835668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0577ea7d-f617-4d9a-a096-83554fa9746f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t\" (UID: \"0577ea7d-f617-4d9a-a096-83554fa9746f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:08.835810 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.835723    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cdfhz\" (UniqueName: \"kubernetes.io/projected/0577ea7d-f617-4d9a-a096-83554fa9746f-kube-api-access-cdfhz\") pod \"payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t\" (UID: \"0577ea7d-f617-4d9a-a096-83554fa9746f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:08.848571 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.848542    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"]
Sep 11 17:37:08.936464 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.936430    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w744x\" (UniqueName: \"kubernetes.io/projected/00b4e884-05d9-454f-bb27-e6c74b741b0b-kube-api-access-w744x\") pod \"payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv\" (UID: \"00b4e884-05d9-454f-bb27-e6c74b741b0b\") " pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:08.936648 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.936495    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0577ea7d-f617-4d9a-a096-83554fa9746f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t\" (UID: \"0577ea7d-f617-4d9a-a096-83554fa9746f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:08.936648 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.936543    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b4e884-05d9-454f-bb27-e6c74b741b0b-plugins-config-volume\") pod \"payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv\" (UID: \"00b4e884-05d9-454f-bb27-e6c74b741b0b\") " pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:08.936648 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.936561    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cdfhz\" (UniqueName: \"kubernetes.io/projected/0577ea7d-f617-4d9a-a096-83554fa9746f-kube-api-access-cdfhz\") pod \"payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t\" (UID: \"0577ea7d-f617-4d9a-a096-83554fa9746f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:08.937203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.937183    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0577ea7d-f617-4d9a-a096-83554fa9746f-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t\" (UID: \"0577ea7d-f617-4d9a-a096-83554fa9746f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:08.944511 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:08.944492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cdfhz\" (UniqueName: \"kubernetes.io/projected/0577ea7d-f617-4d9a-a096-83554fa9746f-kube-api-access-cdfhz\") pod \"payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t\" (UID: \"0577ea7d-f617-4d9a-a096-83554fa9746f\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:09.037993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:09.037956    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b4e884-05d9-454f-bb27-e6c74b741b0b-plugins-config-volume\") pod \"payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv\" (UID: \"00b4e884-05d9-454f-bb27-e6c74b741b0b\") " pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:09.038201 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:09.038010    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w744x\" (UniqueName: \"kubernetes.io/projected/00b4e884-05d9-454f-bb27-e6c74b741b0b-kube-api-access-w744x\") pod \"payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv\" (UID: \"00b4e884-05d9-454f-bb27-e6c74b741b0b\") " pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:09.038773 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:09.038747    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b4e884-05d9-454f-bb27-e6c74b741b0b-plugins-config-volume\") pod \"payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv\" (UID: \"00b4e884-05d9-454f-bb27-e6c74b741b0b\") " pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:09.046817 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:09.046796    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w744x\" (UniqueName: \"kubernetes.io/projected/00b4e884-05d9-454f-bb27-e6c74b741b0b-kube-api-access-w744x\") pod \"payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv\" (UID: \"00b4e884-05d9-454f-bb27-e6c74b741b0b\") " pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:09.114160 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:09.114076    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:09.141752 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:09.141721    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:09.390579 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:09.390553    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"]
Sep 11 17:37:09.391819 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:37:09.391797    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0577ea7d_f617_4d9a_a096_83554fa9746f.slice/crio-74cef173dc75f62f4b2280e7bfcfebcb19e33213eec0943ea3b5a83f201d15cf WatchSource:0}: Error finding container 74cef173dc75f62f4b2280e7bfcfebcb19e33213eec0943ea3b5a83f201d15cf: Status 404 returned error can't find the container with id 74cef173dc75f62f4b2280e7bfcfebcb19e33213eec0943ea3b5a83f201d15cf
Sep 11 17:37:09.432053 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:09.432013    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"]
Sep 11 17:37:09.434008 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:37:09.433976    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b4e884_05d9_454f_bb27_e6c74b741b0b.slice/crio-4afddac2877b9a3827e3da81dc2b6a8addee49f992d394c4e02e52d26d4f0ffc WatchSource:0}: Error finding container 4afddac2877b9a3827e3da81dc2b6a8addee49f992d394c4e02e52d26d4f0ffc: Status 404 returned error can't find the container with id 4afddac2877b9a3827e3da81dc2b6a8addee49f992d394c4e02e52d26d4f0ffc
Sep 11 17:37:10.016027 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:10.015980    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv" event={"ID":"00b4e884-05d9-454f-bb27-e6c74b741b0b","Type":"ContainerStarted","Data":"20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac"}
Sep 11 17:37:10.016570 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:10.016048    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv" event={"ID":"00b4e884-05d9-454f-bb27-e6c74b741b0b","Type":"ContainerStarted","Data":"4afddac2877b9a3827e3da81dc2b6a8addee49f992d394c4e02e52d26d4f0ffc"}
Sep 11 17:37:10.016570 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:10.016186    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:10.017717 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:10.017693    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t" event={"ID":"0577ea7d-f617-4d9a-a096-83554fa9746f","Type":"ContainerStarted","Data":"433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae"}
Sep 11 17:37:10.017793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:10.017745    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t" event={"ID":"0577ea7d-f617-4d9a-a096-83554fa9746f","Type":"ContainerStarted","Data":"74cef173dc75f62f4b2280e7bfcfebcb19e33213eec0943ea3b5a83f201d15cf"}
Sep 11 17:37:10.017793 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:10.017777    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:10.033874 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:10.033825    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv" podStartSLOduration=2.033809296 podStartE2EDuration="2.033809296s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:37:10.031291423 +0000 UTC m=+1004.985981324" watchObservedRunningTime="2026-09-11 17:37:10.033809296 +0000 UTC m=+1004.988499228"
Sep 11 17:37:10.048183 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:10.048133    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t" podStartSLOduration=2.048118175 podStartE2EDuration="2.048118175s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:37:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:37:10.047493205 +0000 UTC m=+1005.002183106" watchObservedRunningTime="2026-09-11 17:37:10.048118175 +0000 UTC m=+1005.002808078"
Sep 11 17:37:16.300376 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:16.300333    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"]
Sep 11 17:37:16.301199 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:16.301163    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy" containerID="cri-o://f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8" gracePeriod=30
Sep 11 17:37:17.411831 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:17.411793    2584 patch_prober.go:28] interesting pod/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 17:37:17.412212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:17.411867    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:37:21.026607 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.026574    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:21.026978 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.026656    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:21.563653 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.563630    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:37:21.655879 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.655844    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-socket\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.655909    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txv2h\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-kube-api-access-txv2h\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.655962    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-podinfo\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.655995    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-data\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656017    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-token\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656058    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-envoy\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656332 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656081    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istiod-ca-cert\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656332 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656095    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:37:21.656332 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656112    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-certs\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656332 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656149    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-credential-socket\") pod \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\" (UID: \"b3c69eb0-4e44-414d-9e06-ddf19bcd6478\") "
Sep 11 17:37:21.656332 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656292    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-data" (OuterVolumeSpecName: "istio-data") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:37:21.656623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656526    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:21.656623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656547    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-data\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:21.656623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656581    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:37:21.656788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656681    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:37:21.656788 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.656737    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:37:21.658319 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.658296    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-kube-api-access-txv2h" (OuterVolumeSpecName: "kube-api-access-txv2h") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "kube-api-access-txv2h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:37:21.658319 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.658308    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:37:21.658508 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.658481    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:37:21.658638 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.658622    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-token" (OuterVolumeSpecName: "istio-token") pod "b3c69eb0-4e44-414d-9e06-ddf19bcd6478" (UID: "b3c69eb0-4e44-414d-9e06-ddf19bcd6478"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:37:21.757514 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.757477    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-podinfo\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:21.757514 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.757504    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:21.757514 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.757515    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istio-envoy\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:21.757817 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.757598    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-istiod-ca-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:21.757817 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.757608    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-workload-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:21.757817 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.757628    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-credential-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:21.757817 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:21.757642    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txv2h\" (UniqueName: \"kubernetes.io/projected/b3c69eb0-4e44-414d-9e06-ddf19bcd6478-kube-api-access-txv2h\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:22.101498 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.101454    2584 generic.go:356] "Generic (PLEG): container finished" podID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerID="f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8" exitCode=0
Sep 11 17:37:22.101984 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.101512    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"
Sep 11 17:37:22.101984 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.101507    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" event={"ID":"b3c69eb0-4e44-414d-9e06-ddf19bcd6478","Type":"ContainerDied","Data":"f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8"}
Sep 11 17:37:22.101984 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.101723    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6" event={"ID":"b3c69eb0-4e44-414d-9e06-ddf19bcd6478","Type":"ContainerDied","Data":"b4d18ec259e528d703dc937971074fb25588b62d59d1297034d974ee1ce874f8"}
Sep 11 17:37:22.101984 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.101768    2584 scope.go:117] "RemoveContainer" containerID="f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8"
Sep 11 17:37:22.113272 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.113246    2584 scope.go:117] "RemoveContainer" containerID="263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4"
Sep 11 17:37:22.119617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.119588    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"]
Sep 11 17:37:22.123203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.123167    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-87b0dc-openshift-default-79c7c87f44-572f6"]
Sep 11 17:37:22.123725 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.123705    2584 scope.go:117] "RemoveContainer" containerID="f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8"
Sep 11 17:37:22.124043 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:37:22.124024    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8\": container with ID starting with f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8 not found: ID does not exist" containerID="f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8"
Sep 11 17:37:22.124124 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.124051    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8"} err="failed to get container status \"f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8\": rpc error: code = NotFound desc = could not find container \"f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8\": container with ID starting with f24be25ac7a6a45ca66f300d7cc6781a91a3f86cc1389743bcb298007a4a89d8 not found: ID does not exist"
Sep 11 17:37:22.124124 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.124069    2584 scope.go:117] "RemoveContainer" containerID="263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4"
Sep 11 17:37:22.124355 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:37:22.124339    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4\": container with ID starting with 263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4 not found: ID does not exist" containerID="263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4"
Sep 11 17:37:22.124414 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:22.124359    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4"} err="failed to get container status \"263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4\": rpc error: code = NotFound desc = could not find container \"263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4\": container with ID starting with 263fe36e6e80756d87abed6e84b44193909dc6ac896b6786eed8a8bec52e2bb4 not found: ID does not exist"
Sep 11 17:37:23.707147 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:23.707104    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" path="/var/lib/kubelet/pods/b3c69eb0-4e44-414d-9e06-ddf19bcd6478/volumes"
Sep 11 17:37:23.727031 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:23.726989    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:37:25.122121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:25.122089    2584 generic.go:356] "Generic (PLEG): container finished" podID="3582b016-c230-491f-9598-d75c66bdcfef" containerID="3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4" exitCode=0
Sep 11 17:37:25.122545 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:25.122167    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" event={"ID":"3582b016-c230-491f-9598-d75c66bdcfef","Type":"ContainerDied","Data":"3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4"}
Sep 11 17:37:25.122613 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:25.122598    2584 scope.go:117] "RemoveContainer" containerID="3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4"
Sep 11 17:37:25.123590 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:25.123563    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:37:25.123670 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:25.123629    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:37:25.123670 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:25.123661    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:37:26.129910 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:26.129877    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" event={"ID":"3582b016-c230-491f-9598-d75c66bdcfef","Type":"ContainerStarted","Data":"d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219"}
Sep 11 17:37:26.292515 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:26.292463    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:26.293136 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:26.293091    2584 patch_prober.go:28] interesting pod/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 17:37:26.293242 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:26.293195    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 17:37:27.292790 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:27.292752    2584 patch_prober.go:28] interesting pod/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 17:37:27.293358 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:27.293325    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 17:37:28.293064 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:28.293027    2584 patch_prober.go:28] interesting pod/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 17:37:28.293644 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:28.293612    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 17:37:29.292488 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:29.292442    2584 patch_prober.go:28] interesting pod/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 17:37:29.292741 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:29.292512    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 17:37:30.293549 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:30.293078    2584 patch_prober.go:28] interesting pod/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body=
Sep 11 17:37:30.293549 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:30.293155    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused"
Sep 11 17:37:31.324178 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:31.324085    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:31.324742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:31.324445    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:31.325961 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:31.325941    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:37:52.518204 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.518169    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"]
Sep 11 17:37:52.518849 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.518505    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv" podUID="00b4e884-05d9-454f-bb27-e6c74b741b0b" containerName="payload-processing" containerID="cri-o://20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac" gracePeriod=30
Sep 11 17:37:52.528424 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.528098    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"]
Sep 11 17:37:52.528424 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.528335    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t" podUID="0577ea7d-f617-4d9a-a096-83554fa9746f" containerName="payload-pre-processing" containerID="cri-o://433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae" gracePeriod=30
Sep 11 17:37:52.812494 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.812463    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:52.815561 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.815538    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:52.950634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.950599    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b4e884-05d9-454f-bb27-e6c74b741b0b-plugins-config-volume\") pod \"00b4e884-05d9-454f-bb27-e6c74b741b0b\" (UID: \"00b4e884-05d9-454f-bb27-e6c74b741b0b\") "
Sep 11 17:37:52.950782 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.950648    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cdfhz\" (UniqueName: \"kubernetes.io/projected/0577ea7d-f617-4d9a-a096-83554fa9746f-kube-api-access-cdfhz\") pod \"0577ea7d-f617-4d9a-a096-83554fa9746f\" (UID: \"0577ea7d-f617-4d9a-a096-83554fa9746f\") "
Sep 11 17:37:52.950782 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.950681    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0577ea7d-f617-4d9a-a096-83554fa9746f-plugins-config-volume\") pod \"0577ea7d-f617-4d9a-a096-83554fa9746f\" (UID: \"0577ea7d-f617-4d9a-a096-83554fa9746f\") "
Sep 11 17:37:52.950782 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.950751    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w744x\" (UniqueName: \"kubernetes.io/projected/00b4e884-05d9-454f-bb27-e6c74b741b0b-kube-api-access-w744x\") pod \"00b4e884-05d9-454f-bb27-e6c74b741b0b\" (UID: \"00b4e884-05d9-454f-bb27-e6c74b741b0b\") "
Sep 11 17:37:52.951062 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.951037    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00b4e884-05d9-454f-bb27-e6c74b741b0b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00b4e884-05d9-454f-bb27-e6c74b741b0b" (UID: "00b4e884-05d9-454f-bb27-e6c74b741b0b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:37:52.951112 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.951047    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0577ea7d-f617-4d9a-a096-83554fa9746f-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "0577ea7d-f617-4d9a-a096-83554fa9746f" (UID: "0577ea7d-f617-4d9a-a096-83554fa9746f"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:37:52.952956 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.952932    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b4e884-05d9-454f-bb27-e6c74b741b0b-kube-api-access-w744x" (OuterVolumeSpecName: "kube-api-access-w744x") pod "00b4e884-05d9-454f-bb27-e6c74b741b0b" (UID: "00b4e884-05d9-454f-bb27-e6c74b741b0b"). InnerVolumeSpecName "kube-api-access-w744x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:37:52.953081 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:52.952969    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0577ea7d-f617-4d9a-a096-83554fa9746f-kube-api-access-cdfhz" (OuterVolumeSpecName: "kube-api-access-cdfhz") pod "0577ea7d-f617-4d9a-a096-83554fa9746f" (UID: "0577ea7d-f617-4d9a-a096-83554fa9746f"). InnerVolumeSpecName "kube-api-access-cdfhz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:37:53.051896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.051794    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00b4e884-05d9-454f-bb27-e6c74b741b0b-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:53.051896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.051832    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cdfhz\" (UniqueName: \"kubernetes.io/projected/0577ea7d-f617-4d9a-a096-83554fa9746f-kube-api-access-cdfhz\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:53.051896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.051847    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/0577ea7d-f617-4d9a-a096-83554fa9746f-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:53.051896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.051858    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w744x\" (UniqueName: \"kubernetes.io/projected/00b4e884-05d9-454f-bb27-e6c74b741b0b-kube-api-access-w744x\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:37:53.290702 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.290668    2584 generic.go:356] "Generic (PLEG): container finished" podID="00b4e884-05d9-454f-bb27-e6c74b741b0b" containerID="20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac" exitCode=0
Sep 11 17:37:53.290878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.290720    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"
Sep 11 17:37:53.290878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.290757    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv" event={"ID":"00b4e884-05d9-454f-bb27-e6c74b741b0b","Type":"ContainerDied","Data":"20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac"}
Sep 11 17:37:53.290878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.290823    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv" event={"ID":"00b4e884-05d9-454f-bb27-e6c74b741b0b","Type":"ContainerDied","Data":"4afddac2877b9a3827e3da81dc2b6a8addee49f992d394c4e02e52d26d4f0ffc"}
Sep 11 17:37:53.290878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.290857    2584 scope.go:117] "RemoveContainer" containerID="20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac"
Sep 11 17:37:53.292152 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.292128    2584 generic.go:356] "Generic (PLEG): container finished" podID="0577ea7d-f617-4d9a-a096-83554fa9746f" containerID="433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae" exitCode=0
Sep 11 17:37:53.292248 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.292169    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"
Sep 11 17:37:53.292248 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.292183    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t" event={"ID":"0577ea7d-f617-4d9a-a096-83554fa9746f","Type":"ContainerDied","Data":"433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae"}
Sep 11 17:37:53.292248 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.292231    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t" event={"ID":"0577ea7d-f617-4d9a-a096-83554fa9746f","Type":"ContainerDied","Data":"74cef173dc75f62f4b2280e7bfcfebcb19e33213eec0943ea3b5a83f201d15cf"}
Sep 11 17:37:53.308389 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.308371    2584 scope.go:117] "RemoveContainer" containerID="20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac"
Sep 11 17:37:53.308733 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:37:53.308712    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac\": container with ID starting with 20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac not found: ID does not exist" containerID="20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac"
Sep 11 17:37:53.308821 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.308744    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac"} err="failed to get container status \"20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac\": rpc error: code = NotFound desc = could not find container \"20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac\": container with ID starting with 20510fd4e7d269983863486bf8a3cb73185770db8b453c159167b6101c37eaac not found: ID does not exist"
Sep 11 17:37:53.308821 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.308767    2584 scope.go:117] "RemoveContainer" containerID="433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae"
Sep 11 17:37:53.316979 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.316957    2584 scope.go:117] "RemoveContainer" containerID="433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae"
Sep 11 17:37:53.317248 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:37:53.317229    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae\": container with ID starting with 433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae not found: ID does not exist" containerID="433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae"
Sep 11 17:37:53.317298 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.317256    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae"} err="failed to get container status \"433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae\": rpc error: code = NotFound desc = could not find container \"433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae\": container with ID starting with 433f798cfb6857f1242611cfd82ca79e55cbff25579a632a85958f7a8eee78ae not found: ID does not exist"
Sep 11 17:37:53.322483 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.322456    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"]
Sep 11 17:37:53.326085 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.326061    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-2340fb02-76f6cd897-6rlfv"]
Sep 11 17:37:53.336066 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.336044    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"]
Sep 11 17:37:53.339915 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.339892    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-2340fb02-8596bb5754-5qt5t"]
Sep 11 17:37:53.705412 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.705366    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b4e884-05d9-454f-bb27-e6c74b741b0b" path="/var/lib/kubelet/pods/00b4e884-05d9-454f-bb27-e6c74b741b0b/volumes"
Sep 11 17:37:53.705768 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:53.705719    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0577ea7d-f617-4d9a-a096-83554fa9746f" path="/var/lib/kubelet/pods/0577ea7d-f617-4d9a-a096-83554fa9746f/volumes"
Sep 11 17:37:54.939995 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:54.939959    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:37:59.277201 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:59.277167    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"]
Sep 11 17:37:59.277769 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:37:59.277427    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy" containerID="cri-o://d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219" gracePeriod=30
Sep 11 17:38:01.327251 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:01.327212    2584 patch_prober.go:28] interesting pod/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 11 17:38:01.327720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:01.327286    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 11 17:38:04.530996 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.530969    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:38:04.547260 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547195    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-envoy\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547260 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547231    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-credential-socket\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547260 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547255    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-certs\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547278    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3582b016-c230-491f-9598-d75c66bdcfef-istiod-ca-cert\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547301    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-socket\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547326    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-data\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547348    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-istio-token\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547370    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3582b016-c230-491f-9598-d75c66bdcfef-istio-podinfo\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547431    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zccdf\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-kube-api-access-zccdf\") pod \"3582b016-c230-491f-9598-d75c66bdcfef\" (UID: \"3582b016-c230-491f-9598-d75c66bdcfef\") "
Sep 11 17:38:04.547803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547567    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:04.547803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547543    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:04.547803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547659    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:04.547803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547716    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3582b016-c230-491f-9598-d75c66bdcfef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:38:04.547803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547767    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:04.547803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547784    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-workload-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:04.547803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547797    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-credential-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:04.548163 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.547963    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-data" (OuterVolumeSpecName: "istio-data") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:04.549628 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.549589    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3582b016-c230-491f-9598-d75c66bdcfef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:38:04.549774 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.549692    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-kube-api-access-zccdf" (OuterVolumeSpecName: "kube-api-access-zccdf") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "kube-api-access-zccdf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:38:04.549774 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.549708    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-istio-token" (OuterVolumeSpecName: "istio-token") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:38:04.549774 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.549760    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3582b016-c230-491f-9598-d75c66bdcfef" (UID: "3582b016-c230-491f-9598-d75c66bdcfef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:04.654550 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.649438    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-envoy\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:04.654550 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.649478    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3582b016-c230-491f-9598-d75c66bdcfef-istiod-ca-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:04.654550 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.649491    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3582b016-c230-491f-9598-d75c66bdcfef-istio-data\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:04.654550 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.649510    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:04.654550 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.649524    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3582b016-c230-491f-9598-d75c66bdcfef-istio-podinfo\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:04.654550 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:04.649537    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zccdf\" (UniqueName: \"kubernetes.io/projected/3582b016-c230-491f-9598-d75c66bdcfef-kube-api-access-zccdf\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:05.366360 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.366323    2584 generic.go:356] "Generic (PLEG): container finished" podID="3582b016-c230-491f-9598-d75c66bdcfef" containerID="d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219" exitCode=0
Sep 11 17:38:05.366562 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.366387    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" event={"ID":"3582b016-c230-491f-9598-d75c66bdcfef","Type":"ContainerDied","Data":"d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219"}
Sep 11 17:38:05.366562 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.366392    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"
Sep 11 17:38:05.366562 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.366455    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt" event={"ID":"3582b016-c230-491f-9598-d75c66bdcfef","Type":"ContainerDied","Data":"7eb4245e5f825c025c7241af7fb6553dc939800ee50205b4e42300e6b78802a5"}
Sep 11 17:38:05.366562 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.366476    2584 scope.go:117] "RemoveContainer" containerID="d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219"
Sep 11 17:38:05.376281 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.376260    2584 scope.go:117] "RemoveContainer" containerID="3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4"
Sep 11 17:38:05.384974 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.384953    2584 scope.go:117] "RemoveContainer" containerID="d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219"
Sep 11 17:38:05.385241 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:05.385221    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219\": container with ID starting with d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219 not found: ID does not exist" containerID="d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219"
Sep 11 17:38:05.385306 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.385252    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219"} err="failed to get container status \"d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219\": rpc error: code = NotFound desc = could not find container \"d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219\": container with ID starting with d01cc225dd0fc86b4833370878b1a8a4df00b85a06f91b4dce1ad2a07173a219 not found: ID does not exist"
Sep 11 17:38:05.385306 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.385277    2584 scope.go:117] "RemoveContainer" containerID="3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4"
Sep 11 17:38:05.385712 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:05.385671    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4\": container with ID starting with 3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4 not found: ID does not exist" containerID="3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4"
Sep 11 17:38:05.385826 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.385707    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4"} err="failed to get container status \"3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4\": rpc error: code = NotFound desc = could not find container \"3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4\": container with ID starting with 3dd5b4342192a91b6362b9184d29c1023051514e6dda23d915c45853a6f5a6d4 not found: ID does not exist"
Sep 11 17:38:05.388451 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.388428    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"]
Sep 11 17:38:05.392581 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.392557    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-2340fb02-openshift-default-7b8c87f848-smjtt"]
Sep 11 17:38:05.706707 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:05.706676    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3582b016-c230-491f-9598-d75c66bdcfef" path="/var/lib/kubelet/pods/3582b016-c230-491f-9598-d75c66bdcfef/volumes"
Sep 11 17:38:06.633356 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:06.633324    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:38:13.752042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:13.752010    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"]
Sep 11 17:38:13.752471 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:13.752213    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy" containerID="cri-o://e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a" gracePeriod=30
Sep 11 17:38:15.025434 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:15.025380    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:38:18.998577 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:18.998545    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:38:19.071868 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.071792    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-envoy\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.071868 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.071841    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfkd2\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-kube-api-access-rfkd2\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.072088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.071878    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-socket\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.072088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.071909    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-token\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.072088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.071989    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-podinfo\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.072088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072028    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-data\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.072088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072060    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-certs\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.072360 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072094    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea5314-2948-4183-b6f3-9d7d95615ab4-istiod-ca-cert\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.072360 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072133    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-credential-socket\") pod \"05ea5314-2948-4183-b6f3-9d7d95615ab4\" (UID: \"05ea5314-2948-4183-b6f3-9d7d95615ab4\") "
Sep 11 17:38:19.072360 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072169    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:19.072546 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072383    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.072546 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072380    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:19.072546 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072482    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05ea5314-2948-4183-b6f3-9d7d95615ab4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:38:19.072767 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072599    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:19.072767 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.072730    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-data" (OuterVolumeSpecName: "istio-data") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:19.074533 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.074503    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-token" (OuterVolumeSpecName: "istio-token") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:38:19.074639 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.074532    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-kube-api-access-rfkd2" (OuterVolumeSpecName: "kube-api-access-rfkd2") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "kube-api-access-rfkd2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:38:19.074639 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.074542    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:38:19.074822 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.074800    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "05ea5314-2948-4183-b6f3-9d7d95615ab4" (UID: "05ea5314-2948-4183-b6f3-9d7d95615ab4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:38:19.173862 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.173819    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-podinfo\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.173862 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.173855    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-data\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.173862 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.173868    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-workload-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.174217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.173881    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/05ea5314-2948-4183-b6f3-9d7d95615ab4-istiod-ca-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.174217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.173893    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-credential-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.174217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.173906    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-envoy\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.174217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.173919    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfkd2\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-kube-api-access-rfkd2\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.174217 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.173932    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/05ea5314-2948-4183-b6f3-9d7d95615ab4-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:19.446466 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.446429    2584 generic.go:356] "Generic (PLEG): container finished" podID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerID="e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a" exitCode=0
Sep 11 17:38:19.446623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.446477    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"
Sep 11 17:38:19.446623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.446504    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" event={"ID":"05ea5314-2948-4183-b6f3-9d7d95615ab4","Type":"ContainerDied","Data":"e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a"}
Sep 11 17:38:19.446623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.446554    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc" event={"ID":"05ea5314-2948-4183-b6f3-9d7d95615ab4","Type":"ContainerDied","Data":"adff838292e1da7cad4ae9b258e5fa7c8ed5b812e7630dd3cad9b9f67dc2b48b"}
Sep 11 17:38:19.446623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.446576    2584 scope.go:117] "RemoveContainer" containerID="e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a"
Sep 11 17:38:19.456156 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.456139    2584 scope.go:117] "RemoveContainer" containerID="bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10"
Sep 11 17:38:19.463783 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.463767    2584 scope.go:117] "RemoveContainer" containerID="e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a"
Sep 11 17:38:19.464046 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:19.464028    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a\": container with ID starting with e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a not found: ID does not exist" containerID="e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a"
Sep 11 17:38:19.464122 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.464058    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a"} err="failed to get container status \"e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a\": rpc error: code = NotFound desc = could not find container \"e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a\": container with ID starting with e3f4c36345d44c806546ee3d16f9e5cf5d0bd6dbf8dfa30ff1a7d311483f3e6a not found: ID does not exist"
Sep 11 17:38:19.464122 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.464080    2584 scope.go:117] "RemoveContainer" containerID="bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10"
Sep 11 17:38:19.464341 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:19.464326    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10\": container with ID starting with bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10 not found: ID does not exist" containerID="bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10"
Sep 11 17:38:19.464377 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.464346    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10"} err="failed to get container status \"bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10\": rpc error: code = NotFound desc = could not find container \"bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10\": container with ID starting with bbfe46f16f2e7c936a3452d54f80b554efa1a150155b77de894b5ab04c57bd10 not found: ID does not exist"
Sep 11 17:38:19.469638 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.469618    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"]
Sep 11 17:38:19.475451 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.475429    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-d92fb3-openshift-default-6f68ff8f8b-xwndc"]
Sep 11 17:38:19.705673 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:19.705582    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" path="/var/lib/kubelet/pods/05ea5314-2948-4183-b6f3-9d7d95615ab4/volumes"
Sep 11 17:38:24.750220 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:24.750179    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"]
Sep 11 17:38:24.750735 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:24.750490    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg" podUID="ce132e49-b956-4c50-9c68-47fdfc46cba4" containerName="maas-api" containerID="cri-o://2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6" gracePeriod=30
Sep 11 17:38:24.804241 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:24.804204    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"]
Sep 11 17:38:24.804474 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:24.804436    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5" podUID="f4a13099-b634-4f23-9faf-cdf98c47dbf4" containerName="payload-processing" containerID="cri-o://c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a" gracePeriod=30
Sep 11 17:38:24.809583 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:24.809560    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"]
Sep 11 17:38:24.809766 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:24.809742    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz" podUID="58f42d19-2cfd-4aae-a6fe-a25a136d40bd" containerName="payload-pre-processing" containerID="cri-o://b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b" gracePeriod=30
Sep 11 17:38:25.076489 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.076459    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:38:25.109565 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.109538    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:38:25.114614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.114592    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:38:25.130891 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.130865    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-metrics-certs\") pod \"ce132e49-b956-4c50-9c68-47fdfc46cba4\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") "
Sep 11 17:38:25.131042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.130931    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls\") pod \"ce132e49-b956-4c50-9c68-47fdfc46cba4\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") "
Sep 11 17:38:25.131042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.130956    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce132e49-b956-4c50-9c68-47fdfc46cba4-openshift-service-ca\") pod \"ce132e49-b956-4c50-9c68-47fdfc46cba4\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") "
Sep 11 17:38:25.131042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.131006    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-shd9r\" (UniqueName: \"kubernetes.io/projected/ce132e49-b956-4c50-9c68-47fdfc46cba4-kube-api-access-shd9r\") pod \"ce132e49-b956-4c50-9c68-47fdfc46cba4\" (UID: \"ce132e49-b956-4c50-9c68-47fdfc46cba4\") "
Sep 11 17:38:25.131460 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.131420    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce132e49-b956-4c50-9c68-47fdfc46cba4-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ce132e49-b956-4c50-9c68-47fdfc46cba4" (UID: "ce132e49-b956-4c50-9c68-47fdfc46cba4"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:38:25.133635 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.133609    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ce132e49-b956-4c50-9c68-47fdfc46cba4" (UID: "ce132e49-b956-4c50-9c68-47fdfc46cba4"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:38:25.133635 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.133613    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ce132e49-b956-4c50-9c68-47fdfc46cba4-kube-api-access-shd9r" (OuterVolumeSpecName: "kube-api-access-shd9r") pod "ce132e49-b956-4c50-9c68-47fdfc46cba4" (UID: "ce132e49-b956-4c50-9c68-47fdfc46cba4"). InnerVolumeSpecName "kube-api-access-shd9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:38:25.134369 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.134353    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "ce132e49-b956-4c50-9c68-47fdfc46cba4" (UID: "ce132e49-b956-4c50-9c68-47fdfc46cba4"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:38:25.231718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.231680    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fklg5\" (UniqueName: \"kubernetes.io/projected/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-kube-api-access-fklg5\") pod \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\" (UID: \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\") "
Sep 11 17:38:25.231718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.231723    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-plugins-config-volume\") pod \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\" (UID: \"58f42d19-2cfd-4aae-a6fe-a25a136d40bd\") "
Sep 11 17:38:25.231954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.231751    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a13099-b634-4f23-9faf-cdf98c47dbf4-plugins-config-volume\") pod \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\" (UID: \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\") "
Sep 11 17:38:25.231954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.231807    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7v54\" (UniqueName: \"kubernetes.io/projected/f4a13099-b634-4f23-9faf-cdf98c47dbf4-kube-api-access-k7v54\") pod \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\" (UID: \"f4a13099-b634-4f23-9faf-cdf98c47dbf4\") "
Sep 11 17:38:25.231954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.231934    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-metrics-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:25.231954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.231944    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ce132e49-b956-4c50-9c68-47fdfc46cba4-maas-api-tls\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:25.231954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.231953    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce132e49-b956-4c50-9c68-47fdfc46cba4-openshift-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:25.232216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.231962    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-shd9r\" (UniqueName: \"kubernetes.io/projected/ce132e49-b956-4c50-9c68-47fdfc46cba4-kube-api-access-shd9r\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:25.232267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.232216    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f4a13099-b634-4f23-9faf-cdf98c47dbf4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f4a13099-b634-4f23-9faf-cdf98c47dbf4" (UID: "f4a13099-b634-4f23-9faf-cdf98c47dbf4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:38:25.232267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.232237    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "58f42d19-2cfd-4aae-a6fe-a25a136d40bd" (UID: "58f42d19-2cfd-4aae-a6fe-a25a136d40bd"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:38:25.233920 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.233888    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-kube-api-access-fklg5" (OuterVolumeSpecName: "kube-api-access-fklg5") pod "58f42d19-2cfd-4aae-a6fe-a25a136d40bd" (UID: "58f42d19-2cfd-4aae-a6fe-a25a136d40bd"). InnerVolumeSpecName "kube-api-access-fklg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:38:25.234029 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.233924    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f4a13099-b634-4f23-9faf-cdf98c47dbf4-kube-api-access-k7v54" (OuterVolumeSpecName: "kube-api-access-k7v54") pod "f4a13099-b634-4f23-9faf-cdf98c47dbf4" (UID: "f4a13099-b634-4f23-9faf-cdf98c47dbf4"). InnerVolumeSpecName "kube-api-access-k7v54". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:38:25.332750 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.332653    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fklg5\" (UniqueName: \"kubernetes.io/projected/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-kube-api-access-fklg5\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:25.332750 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.332683    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/58f42d19-2cfd-4aae-a6fe-a25a136d40bd-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:25.332750 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.332693    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f4a13099-b634-4f23-9faf-cdf98c47dbf4-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:25.332750 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.332701    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7v54\" (UniqueName: \"kubernetes.io/projected/f4a13099-b634-4f23-9faf-cdf98c47dbf4-kube-api-access-k7v54\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:38:25.482954 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.482921    2584 generic.go:356] "Generic (PLEG): container finished" podID="ce132e49-b956-4c50-9c68-47fdfc46cba4" containerID="2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6" exitCode=0
Sep 11 17:38:25.483150 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.482983    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"
Sep 11 17:38:25.483150 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.482997    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg" event={"ID":"ce132e49-b956-4c50-9c68-47fdfc46cba4","Type":"ContainerDied","Data":"2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6"}
Sep 11 17:38:25.483150 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.483107    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg" event={"ID":"ce132e49-b956-4c50-9c68-47fdfc46cba4","Type":"ContainerDied","Data":"164447eb2ed5e155f981c97b5ce6a996f06115d9f24faaa9e8957ce194e25dcf"}
Sep 11 17:38:25.483150 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.483135    2584 scope.go:117] "RemoveContainer" containerID="2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6"
Sep 11 17:38:25.484443 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.484422    2584 generic.go:356] "Generic (PLEG): container finished" podID="f4a13099-b634-4f23-9faf-cdf98c47dbf4" containerID="c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a" exitCode=0
Sep 11 17:38:25.484568 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.484479    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"
Sep 11 17:38:25.484568 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.484545    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5" event={"ID":"f4a13099-b634-4f23-9faf-cdf98c47dbf4","Type":"ContainerDied","Data":"c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a"}
Sep 11 17:38:25.484687 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.484594    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5" event={"ID":"f4a13099-b634-4f23-9faf-cdf98c47dbf4","Type":"ContainerDied","Data":"6a7c8442eba41de0dd5e21280c929c8bbd3128cddd4d64ed67a67d38f7e84f10"}
Sep 11 17:38:25.485949 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.485922    2584 generic.go:356] "Generic (PLEG): container finished" podID="58f42d19-2cfd-4aae-a6fe-a25a136d40bd" containerID="b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b" exitCode=0
Sep 11 17:38:25.486042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.485963    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz" event={"ID":"58f42d19-2cfd-4aae-a6fe-a25a136d40bd","Type":"ContainerDied","Data":"b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b"}
Sep 11 17:38:25.486042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.485987    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"
Sep 11 17:38:25.486042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.486002    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz" event={"ID":"58f42d19-2cfd-4aae-a6fe-a25a136d40bd","Type":"ContainerDied","Data":"a1b2809c3151319e0962479d1dbb55af1d79b7a707768eddf3b18d39091ac43d"}
Sep 11 17:38:25.494268 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.494246    2584 scope.go:117] "RemoveContainer" containerID="2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6"
Sep 11 17:38:25.494597 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:25.494578    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6\": container with ID starting with 2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6 not found: ID does not exist" containerID="2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6"
Sep 11 17:38:25.494691 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.494602    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6"} err="failed to get container status \"2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6\": rpc error: code = NotFound desc = could not find container \"2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6\": container with ID starting with 2c87f8351155f61056cf732e31ed5fee73607ce72c3f0a13f571361db553abd6 not found: ID does not exist"
Sep 11 17:38:25.494691 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.494619    2584 scope.go:117] "RemoveContainer" containerID="c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a"
Sep 11 17:38:25.502914 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.502898    2584 scope.go:117] "RemoveContainer" containerID="c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a"
Sep 11 17:38:25.503186 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:25.503165    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a\": container with ID starting with c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a not found: ID does not exist" containerID="c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a"
Sep 11 17:38:25.503233 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.503193    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a"} err="failed to get container status \"c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a\": rpc error: code = NotFound desc = could not find container \"c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a\": container with ID starting with c34d8904f42b7937a6940b65583f9193efd702baa8443900e6392816f1a53a3a not found: ID does not exist"
Sep 11 17:38:25.503233 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.503208    2584 scope.go:117] "RemoveContainer" containerID="b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b"
Sep 11 17:38:25.510982 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.510963    2584 scope.go:117] "RemoveContainer" containerID="b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b"
Sep 11 17:38:25.511292 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:25.511273    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b\": container with ID starting with b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b not found: ID does not exist" containerID="b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b"
Sep 11 17:38:25.511342 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.511299    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b"} err="failed to get container status \"b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b\": rpc error: code = NotFound desc = could not find container \"b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b\": container with ID starting with b604c17028dcd1740bf0c29741d2a3b2fd3ca9e3a9718e79b37cf1f2b9e5744b not found: ID does not exist"
Sep 11 17:38:25.517687 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.517664    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"]
Sep 11 17:38:25.523524 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.523500    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-d148f3-65f5c49c5-thcqg"]
Sep 11 17:38:25.534235 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.534203    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"]
Sep 11 17:38:25.536293 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.536270    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-d148f3-5f84bb8498-b2mkz"]
Sep 11 17:38:25.546147 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.546107    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"]
Sep 11 17:38:25.549135 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.549112    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-inf-b-d148f3-7fb7585b6c-vv9n5"]
Sep 11 17:38:25.706675 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.706647    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="58f42d19-2cfd-4aae-a6fe-a25a136d40bd" path="/var/lib/kubelet/pods/58f42d19-2cfd-4aae-a6fe-a25a136d40bd/volumes"
Sep 11 17:38:25.707024 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.707011    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce132e49-b956-4c50-9c68-47fdfc46cba4" path="/var/lib/kubelet/pods/ce132e49-b956-4c50-9c68-47fdfc46cba4/volumes"
Sep 11 17:38:25.707314 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:25.707303    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f4a13099-b634-4f23-9faf-cdf98c47dbf4" path="/var/lib/kubelet/pods/f4a13099-b634-4f23-9faf-cdf98c47dbf4/volumes"
Sep 11 17:38:27.246314 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:27.246276    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:38:31.763286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763248    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"]
Sep 11 17:38:31.763803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763785    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="58f42d19-2cfd-4aae-a6fe-a25a136d40bd" containerName="payload-pre-processing"
Sep 11 17:38:31.763846 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763806    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="58f42d19-2cfd-4aae-a6fe-a25a136d40bd" containerName="payload-pre-processing"
Sep 11 17:38:31.763846 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763821    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f4a13099-b634-4f23-9faf-cdf98c47dbf4" containerName="payload-processing"
Sep 11 17:38:31.763846 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763830    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="f4a13099-b634-4f23-9faf-cdf98c47dbf4" containerName="payload-processing"
Sep 11 17:38:31.763846 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763841    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763851    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763859    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b4e884-05d9-454f-bb27-e6c74b741b0b" containerName="payload-processing"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763868    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b4e884-05d9-454f-bb27-e6c74b741b0b" containerName="payload-processing"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763884    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763893    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763903    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763914    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763925    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763933    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763952    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce132e49-b956-4c50-9c68-47fdfc46cba4" containerName="maas-api"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763960    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce132e49-b956-4c50-9c68-47fdfc46cba4" containerName="maas-api"
Sep 11 17:38:31.763975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763971    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763980    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763988    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0577ea7d-f617-4d9a-a096-83554fa9746f" containerName="payload-pre-processing"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.763996    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="0577ea7d-f617-4d9a-a096-83554fa9746f" containerName="payload-pre-processing"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764013    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764022    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764105    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="58f42d19-2cfd-4aae-a6fe-a25a136d40bd" containerName="payload-pre-processing"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764116    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b4e884-05d9-454f-bb27-e6c74b741b0b" containerName="payload-processing"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764125    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764134    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="f4a13099-b634-4f23-9faf-cdf98c47dbf4" containerName="payload-processing"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764142    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764151    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764159    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3c69eb0-4e44-414d-9e06-ddf19bcd6478" containerName="istio-proxy"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764171    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="0577ea7d-f617-4d9a-a096-83554fa9746f" containerName="payload-pre-processing"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764180    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce132e49-b956-4c50-9c68-47fdfc46cba4" containerName="maas-api"
Sep 11 17:38:31.764364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.764188    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="3582b016-c230-491f-9598-d75c66bdcfef" containerName="istio-proxy"
Sep 11 17:38:31.769851 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.769824    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.772413 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.772387    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 11 17:38:31.772575 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.772458    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-w2-b6b979-openshift-default-dockercfg-nlgzt\""
Sep 11 17:38:31.779624 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.778946    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"]
Sep 11 17:38:31.889620 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889583    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istiod-ca-cert\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.889620 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889623    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-data\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.889833 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889644    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhr7z\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-kube-api-access-rhr7z\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.889833 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889763    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-socket\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.889833 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889810    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-certs\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.889833 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889829    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-credential-socket\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.890037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889868    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-podinfo\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.890037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889913    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-envoy\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.890037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.889954    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-token\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.990914 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.990877    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-token\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.990914 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.990914    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istiod-ca-cert\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.990935    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-data\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.990952    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rhr7z\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-kube-api-access-rhr7z\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991010    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-socket\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991038    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-certs\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991065    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-credential-socket\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991091    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-podinfo\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991161 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991124    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-envoy\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991566 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991361    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-data\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991566 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991467    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-socket\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991566 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991546    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-credential-socket\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991739 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991593    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-certs\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.991838 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.991818    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istiod-ca-cert\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.993517 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.993500    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-envoy\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.993697 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.993679    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-podinfo\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.998670 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.998642    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-token\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:31.999285 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:31.999269    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhr7z\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-kube-api-access-rhr7z\") pod \"e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") " pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:32.083562 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.083477    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:32.349184 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.349109    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"]
Sep 11 17:38:32.349583 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.349568    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="05ea5314-2948-4183-b6f3-9d7d95615ab4" containerName="istio-proxy"
Sep 11 17:38:32.353396 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.353377    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.355900 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.355874    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-w3-4c36f4-openshift-default-dockercfg-h8kjz\""
Sep 11 17:38:32.369866 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.369833    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"]
Sep 11 17:38:32.373066 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.373043    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"]
Sep 11 17:38:32.374970 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:38:32.374942    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f9f392d_6b38_479c_8a0e_e5328c1236c3.slice/crio-7d0f6cc738539c10206b3ae14ea2f6bde0037e2dd46a46ebd9dc0f32200bf0b8 WatchSource:0}: Error finding container 7d0f6cc738539c10206b3ae14ea2f6bde0037e2dd46a46ebd9dc0f32200bf0b8: Status 404 returned error can't find the container with id 7d0f6cc738539c10206b3ae14ea2f6bde0037e2dd46a46ebd9dc0f32200bf0b8
Sep 11 17:38:32.377220 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.377188    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:32.377305 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.377251    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:32.377305 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.377295    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:32.495720 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.495670    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-certs\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.495903 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.495730    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-socket\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.495903 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.495767    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/068056b7-93e4-4dcb-bda0-16f27236340d-istiod-ca-cert\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.495903 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.495794    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-data\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.495903 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.495828    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-envoy\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.496062 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.495905    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-istio-token\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.496062 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.495959    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx7wn\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-kube-api-access-qx7wn\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.496062 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.496017    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-credential-socket\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.496062 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.496056    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/068056b7-93e4-4dcb-bda0-16f27236340d-istio-podinfo\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.525774 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.525739    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" event={"ID":"1f9f392d-6b38-479c-8a0e-e5328c1236c3","Type":"ContainerStarted","Data":"ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf"}
Sep 11 17:38:32.525949 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.525800    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" event={"ID":"1f9f392d-6b38-479c-8a0e-e5328c1236c3","Type":"ContainerStarted","Data":"7d0f6cc738539c10206b3ae14ea2f6bde0037e2dd46a46ebd9dc0f32200bf0b8"}
Sep 11 17:38:32.549066 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.549008    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" podStartSLOduration=1.548992376 podStartE2EDuration="1.548992376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:38:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:38:32.547643334 +0000 UTC m=+1087.502333245" watchObservedRunningTime="2026-09-11 17:38:32.548992376 +0000 UTC m=+1087.503682278"
Sep 11 17:38:32.596871 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.596835    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-data\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.596885    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-envoy\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.596904    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-istio-token\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.596934    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx7wn\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-kube-api-access-qx7wn\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597314 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597286    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-credential-socket\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/068056b7-93e4-4dcb-bda0-16f27236340d-istio-podinfo\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597444 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597362    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-data\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597475    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-certs\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597563 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597519    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-socket\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597618 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597578    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/068056b7-93e4-4dcb-bda0-16f27236340d-istiod-ca-cert\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597630    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-credential-socket\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.597796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597778    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-socket\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.598006 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.597978    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-certs\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.598523 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.598500    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/068056b7-93e4-4dcb-bda0-16f27236340d-istiod-ca-cert\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.599328 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.599282    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-envoy\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.600180 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.600159    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/068056b7-93e4-4dcb-bda0-16f27236340d-istio-podinfo\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.605313 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.605283    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-istio-token\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.605457 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.605377    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx7wn\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-kube-api-access-qx7wn\") pod \"e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") " pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.665165 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.665134    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:32.949391 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.949367    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"]
Sep 11 17:38:32.951385 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:38:32.951363    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod068056b7_93e4_4dcb_bda0_16f27236340d.slice/crio-b92667180d9b59558d0fcc5b16b58ed7a24babcf15a7c109df31a6093e425b65 WatchSource:0}: Error finding container b92667180d9b59558d0fcc5b16b58ed7a24babcf15a7c109df31a6093e425b65: Status 404 returned error can't find the container with id b92667180d9b59558d0fcc5b16b58ed7a24babcf15a7c109df31a6093e425b65
Sep 11 17:38:32.953554 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.953526    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:32.953612 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.953603    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:32.953654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:32.953642    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:33.084035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:33.084005    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:33.089076 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:33.089049    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:33.532514 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:33.532478    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" event={"ID":"068056b7-93e4-4dcb-bda0-16f27236340d","Type":"ContainerStarted","Data":"a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5"}
Sep 11 17:38:33.532717 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:33.532559    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" event={"ID":"068056b7-93e4-4dcb-bda0-16f27236340d","Type":"ContainerStarted","Data":"b92667180d9b59558d0fcc5b16b58ed7a24babcf15a7c109df31a6093e425b65"}
Sep 11 17:38:33.532883 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:33.532862    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:33.533716 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:33.533696    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:33.555840 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:33.555784    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" podStartSLOduration=1.555767117 podStartE2EDuration="1.555767117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:38:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:38:33.55446056 +0000 UTC m=+1088.509150463" watchObservedRunningTime="2026-09-11 17:38:33.555767117 +0000 UTC m=+1088.510457059"
Sep 11 17:38:33.665381 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:33.665333    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:34.671822 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:34.671789    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:35.545347 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:35.545318    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:35.546286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:35.546264    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:37.426671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.426640    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"]
Sep 11 17:38:37.430227 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.430207    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.434375 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.434349    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w2-b6b979-serving-cert\""
Sep 11 17:38:37.434921 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.434902    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 17:38:37.435006 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.434932    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nwfbn\""
Sep 11 17:38:37.435476 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.435455    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:38:37.435591 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.435510    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 17:38:37.442252 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.442230    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"]
Sep 11 17:38:37.542309 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.542273    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hztl5\" (UniqueName: \"kubernetes.io/projected/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-kube-api-access-hztl5\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.542506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.542318    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.542506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.542337    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.542506 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.542459    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.643496 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.643459    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hztl5\" (UniqueName: \"kubernetes.io/projected/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-kube-api-access-hztl5\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.643670 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.643528    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.643670 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.643556    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.643670 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.643623    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.644247 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.644224    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.646137 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.646105    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-maas-api-tls\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.646220 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.646120    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-metrics-certs\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.654629 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.654610    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hztl5\" (UniqueName: \"kubernetes.io/projected/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-kube-api-access-hztl5\") pod \"maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:37.740208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:37.740119    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:38.018317 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.018290    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"]
Sep 11 17:38:38.019582 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:38:38.019555    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b7de54b_aadc_4dac_aed3_1527aa8aa0e7.slice/crio-ac720bd6cf9937f06cd44d04ea79a397102a2766e7267e3d9fa2e3ff5a368bee WatchSource:0}: Error finding container ac720bd6cf9937f06cd44d04ea79a397102a2766e7267e3d9fa2e3ff5a368bee: Status 404 returned error can't find the container with id ac720bd6cf9937f06cd44d04ea79a397102a2766e7267e3d9fa2e3ff5a368bee
Sep 11 17:38:38.021153 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.021131    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:38:38.212533 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.212494    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"]
Sep 11 17:38:38.217288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.217270    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:38.220819 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.220792    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w2-b6b979-dockercfg-7nblc\""
Sep 11 17:38:38.221364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.221344    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w2-b6b979\""
Sep 11 17:38:38.233187 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.233151    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"]
Sep 11 17:38:38.350504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.350396    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggs7m\" (UniqueName: \"kubernetes.io/projected/05e74885-444c-4737-8c8a-5fbdaf212dbe-kube-api-access-ggs7m\") pod \"payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245\" (UID: \"05e74885-444c-4737-8c8a-5fbdaf212dbe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:38.350504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.350469    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e74885-444c-4737-8c8a-5fbdaf212dbe-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245\" (UID: \"05e74885-444c-4737-8c8a-5fbdaf212dbe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:38.451582 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.451530    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e74885-444c-4737-8c8a-5fbdaf212dbe-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245\" (UID: \"05e74885-444c-4737-8c8a-5fbdaf212dbe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:38.451952 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.451711    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggs7m\" (UniqueName: \"kubernetes.io/projected/05e74885-444c-4737-8c8a-5fbdaf212dbe-kube-api-access-ggs7m\") pod \"payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245\" (UID: \"05e74885-444c-4737-8c8a-5fbdaf212dbe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:38.452199 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.452179    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e74885-444c-4737-8c8a-5fbdaf212dbe-plugins-config-volume\") pod \"payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245\" (UID: \"05e74885-444c-4737-8c8a-5fbdaf212dbe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:38.460719 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.460694    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggs7m\" (UniqueName: \"kubernetes.io/projected/05e74885-444c-4737-8c8a-5fbdaf212dbe-kube-api-access-ggs7m\") pod \"payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245\" (UID: \"05e74885-444c-4737-8c8a-5fbdaf212dbe\") " pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:38.503953 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.503914    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"]
Sep 11 17:38:38.508256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.508229    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.510808 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.510788    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-4c36f4-serving-cert\""
Sep 11 17:38:38.517960 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.517933    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"]
Sep 11 17:38:38.527633 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.527602    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:38.562206 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.562173    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh" event={"ID":"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7","Type":"ContainerStarted","Data":"245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72"}
Sep 11 17:38:38.562420 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.562235    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh" event={"ID":"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7","Type":"ContainerStarted","Data":"ac720bd6cf9937f06cd44d04ea79a397102a2766e7267e3d9fa2e3ff5a368bee"}
Sep 11 17:38:38.562420 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.562285    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:38.590425 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.588900    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh" podStartSLOduration=1.240172438 podStartE2EDuration="1.588883428s" totalImagesPullingTime="348.71099ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:38:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:38:38.588068525 +0000 UTC m=+1093.542758428" watchObservedRunningTime="2026-09-11 17:38:38.588883428 +0000 UTC m=+1093.543573330"
Sep 11 17:38:38.653502 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.653466    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412b8606-7b9a-429e-b258-bf382c2306c5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.653649 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.653546    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvrdg\" (UniqueName: \"kubernetes.io/projected/412b8606-7b9a-429e-b258-bf382c2306c5-kube-api-access-rvrdg\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.653759 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.653732    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.653824 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.653808    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.754293 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.754259    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412b8606-7b9a-429e-b258-bf382c2306c5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.754504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.754344    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvrdg\" (UniqueName: \"kubernetes.io/projected/412b8606-7b9a-429e-b258-bf382c2306c5-kube-api-access-rvrdg\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.754504 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.754378    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.754651 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.754567    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.754708 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:38.754690    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-serving-cert: secret "maas-api-e2e-shared-a-w3-4c36f4-serving-cert" not found
Sep 11 17:38:38.754773 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:38:38.754738    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls podName:412b8606-7b9a-429e-b258-bf382c2306c5 nodeName:}" failed. No retries permitted until 2026-09-11 17:38:39.254724061 +0000 UTC m=+1094.209413940 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls") pod "maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc" (UID: "412b8606-7b9a-429e-b258-bf382c2306c5") : secret "maas-api-e2e-shared-a-w3-4c36f4-serving-cert" not found
Sep 11 17:38:38.755111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.755087    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412b8606-7b9a-429e-b258-bf382c2306c5-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.756873 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.756852    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.768671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.768583    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvrdg\" (UniqueName: \"kubernetes.io/projected/412b8606-7b9a-429e-b258-bf382c2306c5-kube-api-access-rvrdg\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:38.808900 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:38:38.808863    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod05e74885_444c_4737_8c8a_5fbdaf212dbe.slice/crio-0b2635c7324633811a083f002c52f767e47c32d908baf8a8cf7d2c62596fce38 WatchSource:0}: Error finding container 0b2635c7324633811a083f002c52f767e47c32d908baf8a8cf7d2c62596fce38: Status 404 returned error can't find the container with id 0b2635c7324633811a083f002c52f767e47c32d908baf8a8cf7d2c62596fce38
Sep 11 17:38:38.811260 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:38.811236    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"]
Sep 11 17:38:39.258000 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:39.257968    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:39.260350 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:39.260321    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:39.422009 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:39.421962    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:39.571739 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:39.571633    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245" event={"ID":"05e74885-444c-4737-8c8a-5fbdaf212dbe","Type":"ContainerStarted","Data":"b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6"}
Sep 11 17:38:39.571739 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:39.571698    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245" event={"ID":"05e74885-444c-4737-8c8a-5fbdaf212dbe","Type":"ContainerStarted","Data":"0b2635c7324633811a083f002c52f767e47c32d908baf8a8cf7d2c62596fce38"}
Sep 11 17:38:39.572248 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:39.571951    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:39.591296 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:39.591240    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245" podStartSLOduration=1.591222358 podStartE2EDuration="1.591222358s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:38:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:38:39.590525209 +0000 UTC m=+1094.545215111" watchObservedRunningTime="2026-09-11 17:38:39.591222358 +0000 UTC m=+1094.545912260"
Sep 11 17:38:39.708097 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:38:39.708069    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod412b8606_7b9a_429e_b258_bf382c2306c5.slice/crio-7ba5d8d7d393a294f1019b6a6c4c3edced19f679a94dfdf0ecc5f4ec87bfb5e3 WatchSource:0}: Error finding container 7ba5d8d7d393a294f1019b6a6c4c3edced19f679a94dfdf0ecc5f4ec87bfb5e3: Status 404 returned error can't find the container with id 7ba5d8d7d393a294f1019b6a6c4c3edced19f679a94dfdf0ecc5f4ec87bfb5e3
Sep 11 17:38:39.708209 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:39.708189    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"]
Sep 11 17:38:40.580184 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:40.580141    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc" event={"ID":"412b8606-7b9a-429e-b258-bf382c2306c5","Type":"ContainerStarted","Data":"95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af"}
Sep 11 17:38:40.580635 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:40.580204    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc" event={"ID":"412b8606-7b9a-429e-b258-bf382c2306c5","Type":"ContainerStarted","Data":"7ba5d8d7d393a294f1019b6a6c4c3edced19f679a94dfdf0ecc5f4ec87bfb5e3"}
Sep 11 17:38:40.580635 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:40.580233    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:40.601140 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:40.601089    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc" podStartSLOduration=2.183317646 podStartE2EDuration="2.601072353s" totalImagesPullingTime="417.754707ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:38:40.599078248 +0000 UTC m=+1095.553768150" watchObservedRunningTime="2026-09-11 17:38:40.601072353 +0000 UTC m=+1095.555762289"
Sep 11 17:38:42.237010 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:42.236974    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:38:44.586811 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:44.586773    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:38:46.603890 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:46.603852    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:38:50.584297 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:50.583582    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:38:53.672299 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:53.672260    2584 generic.go:356] "Generic (PLEG): container finished" podID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerID="ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf" exitCode=0
Sep 11 17:38:53.672870 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:53.672345    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" event={"ID":"1f9f392d-6b38-479c-8a0e-e5328c1236c3","Type":"ContainerDied","Data":"ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf"}
Sep 11 17:38:53.672946 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:53.672920    2584 scope.go:117] "RemoveContainer" containerID="ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf"
Sep 11 17:38:53.674129 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:53.674101    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:53.674247 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:53.674182    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:53.674247 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:53.674239    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:54.683353 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:54.683305    2584 generic.go:356] "Generic (PLEG): container finished" podID="068056b7-93e4-4dcb-bda0-16f27236340d" containerID="a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5" exitCode=0
Sep 11 17:38:54.683895 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:54.683514    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" event={"ID":"068056b7-93e4-4dcb-bda0-16f27236340d","Type":"ContainerDied","Data":"a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5"}
Sep 11 17:38:54.684030 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:54.684004    2584 scope.go:117] "RemoveContainer" containerID="a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5"
Sep 11 17:38:54.685434 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:54.685355    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:54.685536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:54.685466    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:54.685536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:54.685517    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:38:54.689447 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:54.689420    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" event={"ID":"1f9f392d-6b38-479c-8a0e-e5328c1236c3","Type":"ContainerStarted","Data":"305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800"}
Sep 11 17:38:55.084464 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:55.084292    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:38:55.085043 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:55.085018    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 17:38:55.085238 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:55.085214    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 17:38:55.711844 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:55.711807    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" event={"ID":"068056b7-93e4-4dcb-bda0-16f27236340d","Type":"ContainerStarted","Data":"4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576"}
Sep 11 17:38:56.084431 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:56.084309    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 17:38:56.084431 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:56.084389    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 17:38:56.665424 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:56.665372    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:38:56.665726 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:56.665707    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 17:38:56.665774 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:56.665750    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 17:38:57.084718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:57.084627    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 17:38:57.085173 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:57.084697    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 17:38:57.666723 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:57.666676    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 17:38:57.666925 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:57.666752    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 17:38:58.084987 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:58.084879    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 17:38:58.084987 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:58.084948    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 17:38:58.665715 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:58.665671    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 17:38:58.665881 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:58.665733    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 17:38:59.084078 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:59.083974    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 17:38:59.084355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:59.084310    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 17:38:59.666168 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:59.666136    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 17:38:59.666621 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:38:59.666592    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 17:39:00.084244 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:00.084144    2584 patch_prober.go:28] interesting pod/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused" start-of-body=
Sep 11 17:39:00.084535 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:00.084498    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.60:15021/healthz/ready\": dial tcp 10.132.0.60:15021: connect: connection refused"
Sep 11 17:39:00.665889 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:00.665856    2584 patch_prober.go:28] interesting pod/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused" start-of-body=
Sep 11 17:39:00.666055 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:00.665911    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.61:15021/healthz/ready\": dial tcp 10.132.0.61:15021: connect: connection refused"
Sep 11 17:39:01.089289 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:01.089205    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:39:01.089833 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:01.089810    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:39:01.090534 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:01.090508    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:39:01.669807 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:01.669776    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:39:01.670139 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:01.670120    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:39:01.670809 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:01.670787    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:39:12.461181 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.461148    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"]
Sep 11 17:39:12.465733 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.465715    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:12.468559 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.468532    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-b-w3-db95fd-dockercfg-6jdl2\""
Sep 11 17:39:12.468559 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.468553    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-b-w3-db95fd\""
Sep 11 17:39:12.479543 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.479518    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"]
Sep 11 17:39:12.570209 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.570162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqnst\" (UniqueName: \"kubernetes.io/projected/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-kube-api-access-hqnst\") pod \"payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z\" (UID: \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:12.570578 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.570555    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z\" (UID: \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:12.671571 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.671523    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqnst\" (UniqueName: \"kubernetes.io/projected/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-kube-api-access-hqnst\") pod \"payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z\" (UID: \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:12.671571 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.671576    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z\" (UID: \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:12.672600 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.672575    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z\" (UID: \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:12.679859 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.679831    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqnst\" (UniqueName: \"kubernetes.io/projected/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-kube-api-access-hqnst\") pod \"payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z\" (UID: \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:12.777338 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:12.777260    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:13.072341 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:13.072300    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"]
Sep 11 17:39:13.073530 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:39:13.073500    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00bc0f8a_bd2b_4c38_80dd_957798fbaa06.slice/crio-9df29deb0df219c7ac4932ddc30d7eae234cf50470127190a34898c37ca00b3d WatchSource:0}: Error finding container 9df29deb0df219c7ac4932ddc30d7eae234cf50470127190a34898c37ca00b3d: Status 404 returned error can't find the container with id 9df29deb0df219c7ac4932ddc30d7eae234cf50470127190a34898c37ca00b3d
Sep 11 17:39:13.826698 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:13.826662    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z" event={"ID":"00bc0f8a-bd2b-4c38-80dd-957798fbaa06","Type":"ContainerStarted","Data":"d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31"}
Sep 11 17:39:13.827089 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:13.826722    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z" event={"ID":"00bc0f8a-bd2b-4c38-80dd-957798fbaa06","Type":"ContainerStarted","Data":"9df29deb0df219c7ac4932ddc30d7eae234cf50470127190a34898c37ca00b3d"}
Sep 11 17:39:13.827089 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:13.826750    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:13.845444 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:13.845374    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z" podStartSLOduration=1.845358257 podStartE2EDuration="1.845358257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:39:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:39:13.84254912 +0000 UTC m=+1128.797239021" watchObservedRunningTime="2026-09-11 17:39:13.845358257 +0000 UTC m=+1128.800048159"
Sep 11 17:39:17.370199 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:17.370152    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:39:21.045510 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.045472    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"]
Sep 11 17:39:21.049083 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.049066    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.051825 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.051805    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-3d144889-dockercfg-9mxrw\""
Sep 11 17:39:21.051933 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.051845    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-3d144889\""
Sep 11 17:39:21.059156 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.059130    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"]
Sep 11 17:39:21.090452 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.090390    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"]
Sep 11 17:39:21.093863 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.093845    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.100210 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.100177    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"]
Sep 11 17:39:21.146535 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.146492    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ac6cbea-3716-4e90-9c92-08b2c0196193-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj\" (UID: \"2ac6cbea-3716-4e90-9c92-08b2c0196193\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.146739 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.146646    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bjrk9\" (UniqueName: \"kubernetes.io/projected/2ac6cbea-3716-4e90-9c92-08b2c0196193-kube-api-access-bjrk9\") pod \"payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj\" (UID: \"2ac6cbea-3716-4e90-9c92-08b2c0196193\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.146832 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.146737    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn92j\" (UniqueName: \"kubernetes.io/projected/6fd67239-3d64-4054-a5a5-5c1928346a84-kube-api-access-zn92j\") pod \"payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4\" (UID: \"6fd67239-3d64-4054-a5a5-5c1928346a84\") " pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.146832 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.146788    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fd67239-3d64-4054-a5a5-5c1928346a84-plugins-config-volume\") pod \"payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4\" (UID: \"6fd67239-3d64-4054-a5a5-5c1928346a84\") " pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.247733 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.247689    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ac6cbea-3716-4e90-9c92-08b2c0196193-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj\" (UID: \"2ac6cbea-3716-4e90-9c92-08b2c0196193\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.247913 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.247758    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bjrk9\" (UniqueName: \"kubernetes.io/projected/2ac6cbea-3716-4e90-9c92-08b2c0196193-kube-api-access-bjrk9\") pod \"payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj\" (UID: \"2ac6cbea-3716-4e90-9c92-08b2c0196193\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.247913 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.247777    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn92j\" (UniqueName: \"kubernetes.io/projected/6fd67239-3d64-4054-a5a5-5c1928346a84-kube-api-access-zn92j\") pod \"payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4\" (UID: \"6fd67239-3d64-4054-a5a5-5c1928346a84\") " pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.247913 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.247803    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fd67239-3d64-4054-a5a5-5c1928346a84-plugins-config-volume\") pod \"payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4\" (UID: \"6fd67239-3d64-4054-a5a5-5c1928346a84\") " pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.248427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.248378    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ac6cbea-3716-4e90-9c92-08b2c0196193-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj\" (UID: \"2ac6cbea-3716-4e90-9c92-08b2c0196193\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.248567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.248550    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fd67239-3d64-4054-a5a5-5c1928346a84-plugins-config-volume\") pod \"payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4\" (UID: \"6fd67239-3d64-4054-a5a5-5c1928346a84\") " pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.255943 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.255914    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn92j\" (UniqueName: \"kubernetes.io/projected/6fd67239-3d64-4054-a5a5-5c1928346a84-kube-api-access-zn92j\") pod \"payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4\" (UID: \"6fd67239-3d64-4054-a5a5-5c1928346a84\") " pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.256066 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.255920    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bjrk9\" (UniqueName: \"kubernetes.io/projected/2ac6cbea-3716-4e90-9c92-08b2c0196193-kube-api-access-bjrk9\") pod \"payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj\" (UID: \"2ac6cbea-3716-4e90-9c92-08b2c0196193\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.361248 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.361152    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.405811 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.405774    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.638449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.638421    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"]
Sep 11 17:39:21.639618 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:39:21.639595    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ac6cbea_3716_4e90_9c92_08b2c0196193.slice/crio-b2cc7540344cb8c71b4ad5b65fc92e63216ec5663a1e9782e52ddc8100f98f0c WatchSource:0}: Error finding container b2cc7540344cb8c71b4ad5b65fc92e63216ec5663a1e9782e52ddc8100f98f0c: Status 404 returned error can't find the container with id b2cc7540344cb8c71b4ad5b65fc92e63216ec5663a1e9782e52ddc8100f98f0c
Sep 11 17:39:21.686597 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.686573    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"]
Sep 11 17:39:21.689590 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:39:21.689565    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fd67239_3d64_4054_a5a5_5c1928346a84.slice/crio-70202d14a50a6172764ef45f3eefc4a2b21dc02dfbe9ef791a113e6eb2ab1241 WatchSource:0}: Error finding container 70202d14a50a6172764ef45f3eefc4a2b21dc02dfbe9ef791a113e6eb2ab1241: Status 404 returned error can't find the container with id 70202d14a50a6172764ef45f3eefc4a2b21dc02dfbe9ef791a113e6eb2ab1241
Sep 11 17:39:21.875479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.875437    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4" event={"ID":"6fd67239-3d64-4054-a5a5-5c1928346a84","Type":"ContainerStarted","Data":"df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a"}
Sep 11 17:39:21.875684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.875506    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4" event={"ID":"6fd67239-3d64-4054-a5a5-5c1928346a84","Type":"ContainerStarted","Data":"70202d14a50a6172764ef45f3eefc4a2b21dc02dfbe9ef791a113e6eb2ab1241"}
Sep 11 17:39:21.875684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.875539    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:21.877443 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.877393    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj" event={"ID":"2ac6cbea-3716-4e90-9c92-08b2c0196193","Type":"ContainerStarted","Data":"757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0"}
Sep 11 17:39:21.877603 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.877465    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj" event={"ID":"2ac6cbea-3716-4e90-9c92-08b2c0196193","Type":"ContainerStarted","Data":"b2cc7540344cb8c71b4ad5b65fc92e63216ec5663a1e9782e52ddc8100f98f0c"}
Sep 11 17:39:21.877603 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.877492    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:21.894572 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.894461    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4" podStartSLOduration=0.894440905 podStartE2EDuration="894.440905ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:39:21.892586052 +0000 UTC m=+1136.847275956" watchObservedRunningTime="2026-09-11 17:39:21.894440905 +0000 UTC m=+1136.849130809"
Sep 11 17:39:21.915603 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:21.915548    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj" podStartSLOduration=0.915533141 podStartE2EDuration="915.533141ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:39:21.914216806 +0000 UTC m=+1136.868906710" watchObservedRunningTime="2026-09-11 17:39:21.915533141 +0000 UTC m=+1136.870223044"
Sep 11 17:39:24.834035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:24.834006    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:39:32.885899 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:32.885864    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:39:32.886280 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:32.885945    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:39:33.027828 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:33.027796    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:39:47.239119 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:39:47.239082    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:40:07.625831 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:07.625794    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:40:25.601343 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:25.601310    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:40:25.602235 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:25.602217    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:40:26.711694 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:26.711658    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"]
Sep 11 17:40:26.712202 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:26.711929    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4" podUID="6fd67239-3d64-4054-a5a5-5c1928346a84" containerName="payload-processing" containerID="cri-o://df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a" gracePeriod=30
Sep 11 17:40:26.716461 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:26.716432    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"]
Sep 11 17:40:26.717054 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:26.717023    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj" podUID="2ac6cbea-3716-4e90-9c92-08b2c0196193" containerName="payload-pre-processing" containerID="cri-o://757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0" gracePeriod=30
Sep 11 17:40:26.966951 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:26.966891    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:40:26.998859 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:26.998835    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:40:27.130227 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.130181    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:40:27.146802 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.146771    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ac6cbea-3716-4e90-9c92-08b2c0196193-plugins-config-volume\") pod \"2ac6cbea-3716-4e90-9c92-08b2c0196193\" (UID: \"2ac6cbea-3716-4e90-9c92-08b2c0196193\") "
Sep 11 17:40:27.146951 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.146924    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bjrk9\" (UniqueName: \"kubernetes.io/projected/2ac6cbea-3716-4e90-9c92-08b2c0196193-kube-api-access-bjrk9\") pod \"2ac6cbea-3716-4e90-9c92-08b2c0196193\" (UID: \"2ac6cbea-3716-4e90-9c92-08b2c0196193\") "
Sep 11 17:40:27.147026 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.147013    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn92j\" (UniqueName: \"kubernetes.io/projected/6fd67239-3d64-4054-a5a5-5c1928346a84-kube-api-access-zn92j\") pod \"6fd67239-3d64-4054-a5a5-5c1928346a84\" (UID: \"6fd67239-3d64-4054-a5a5-5c1928346a84\") "
Sep 11 17:40:27.147085 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.147052    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fd67239-3d64-4054-a5a5-5c1928346a84-plugins-config-volume\") pod \"6fd67239-3d64-4054-a5a5-5c1928346a84\" (UID: \"6fd67239-3d64-4054-a5a5-5c1928346a84\") "
Sep 11 17:40:27.147085 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.147061    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2ac6cbea-3716-4e90-9c92-08b2c0196193-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2ac6cbea-3716-4e90-9c92-08b2c0196193" (UID: "2ac6cbea-3716-4e90-9c92-08b2c0196193"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:40:27.147307 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.147292    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2ac6cbea-3716-4e90-9c92-08b2c0196193-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:40:27.147457 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.147437    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fd67239-3d64-4054-a5a5-5c1928346a84-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "6fd67239-3d64-4054-a5a5-5c1928346a84" (UID: "6fd67239-3d64-4054-a5a5-5c1928346a84"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:40:27.148976 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.148956    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fd67239-3d64-4054-a5a5-5c1928346a84-kube-api-access-zn92j" (OuterVolumeSpecName: "kube-api-access-zn92j") pod "6fd67239-3d64-4054-a5a5-5c1928346a84" (UID: "6fd67239-3d64-4054-a5a5-5c1928346a84"). InnerVolumeSpecName "kube-api-access-zn92j". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:40:27.149020 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.148983    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ac6cbea-3716-4e90-9c92-08b2c0196193-kube-api-access-bjrk9" (OuterVolumeSpecName: "kube-api-access-bjrk9") pod "2ac6cbea-3716-4e90-9c92-08b2c0196193" (UID: "2ac6cbea-3716-4e90-9c92-08b2c0196193"). InnerVolumeSpecName "kube-api-access-bjrk9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:40:27.248362 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.248285    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn92j\" (UniqueName: \"kubernetes.io/projected/6fd67239-3d64-4054-a5a5-5c1928346a84-kube-api-access-zn92j\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:40:27.248362 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.248309    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/6fd67239-3d64-4054-a5a5-5c1928346a84-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:40:27.248362 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.248318    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bjrk9\" (UniqueName: \"kubernetes.io/projected/2ac6cbea-3716-4e90-9c92-08b2c0196193-kube-api-access-bjrk9\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:40:27.258493 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.258464    2584 generic.go:356] "Generic (PLEG): container finished" podID="2ac6cbea-3716-4e90-9c92-08b2c0196193" containerID="757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0" exitCode=0
Sep 11 17:40:27.258608 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.258504    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"
Sep 11 17:40:27.258608 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.258548    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj" event={"ID":"2ac6cbea-3716-4e90-9c92-08b2c0196193","Type":"ContainerDied","Data":"757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0"}
Sep 11 17:40:27.258608 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.258596    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj" event={"ID":"2ac6cbea-3716-4e90-9c92-08b2c0196193","Type":"ContainerDied","Data":"b2cc7540344cb8c71b4ad5b65fc92e63216ec5663a1e9782e52ddc8100f98f0c"}
Sep 11 17:40:27.258741 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.258625    2584 scope.go:117] "RemoveContainer" containerID="757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0"
Sep 11 17:40:27.260026 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.260005    2584 generic.go:356] "Generic (PLEG): container finished" podID="6fd67239-3d64-4054-a5a5-5c1928346a84" containerID="df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a" exitCode=0
Sep 11 17:40:27.260106 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.260040    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"
Sep 11 17:40:27.260106 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.260048    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4" event={"ID":"6fd67239-3d64-4054-a5a5-5c1928346a84","Type":"ContainerDied","Data":"df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a"}
Sep 11 17:40:27.260106 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.260089    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4" event={"ID":"6fd67239-3d64-4054-a5a5-5c1928346a84","Type":"ContainerDied","Data":"70202d14a50a6172764ef45f3eefc4a2b21dc02dfbe9ef791a113e6eb2ab1241"}
Sep 11 17:40:27.268958 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.268934    2584 scope.go:117] "RemoveContainer" containerID="757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0"
Sep 11 17:40:27.269686 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:40:27.269662    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0\": container with ID starting with 757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0 not found: ID does not exist" containerID="757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0"
Sep 11 17:40:27.269803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.269697    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0"} err="failed to get container status \"757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0\": rpc error: code = NotFound desc = could not find container \"757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0\": container with ID starting with 757610e0ee5bcaa207c0e58f6b33f6d58693c6b3032825aacb8e6949aeccdec0 not found: ID does not exist"
Sep 11 17:40:27.269803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.269720    2584 scope.go:117] "RemoveContainer" containerID="df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a"
Sep 11 17:40:27.279080 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.279063    2584 scope.go:117] "RemoveContainer" containerID="df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a"
Sep 11 17:40:27.279328 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:40:27.279313    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a\": container with ID starting with df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a not found: ID does not exist" containerID="df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a"
Sep 11 17:40:27.279374 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.279334    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a"} err="failed to get container status \"df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a\": rpc error: code = NotFound desc = could not find container \"df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a\": container with ID starting with df3d31bab39028c90a4b5a43db25152ffbeb2b17d8329e5e2bd6c29a22c5915a not found: ID does not exist"
Sep 11 17:40:27.289068 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.289040    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"]
Sep 11 17:40:27.296896 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.296877    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-3d144889-5cddd94c5d-lxjvj"]
Sep 11 17:40:27.309771 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.309750    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"]
Sep 11 17:40:27.318257 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.318236    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-3d144889-6747df5d77-lhhs4"]
Sep 11 17:40:27.706313 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.706282    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ac6cbea-3716-4e90-9c92-08b2c0196193" path="/var/lib/kubelet/pods/2ac6cbea-3716-4e90-9c92-08b2c0196193/volumes"
Sep 11 17:40:27.706690 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:27.706676    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fd67239-3d64-4054-a5a5-5c1928346a84" path="/var/lib/kubelet/pods/6fd67239-3d64-4054-a5a5-5c1928346a84/volumes"
Sep 11 17:40:44.927409 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:44.927371    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:40:59.827699 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:40:59.827666    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:41:16.640761 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:41:16.640724    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:41:32.338037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:41:32.337999    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:41:49.652385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:41:49.652348    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:42:04.046283 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:04.046244    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:42:19.745472 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:19.745436    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:42:21.433993 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.433957    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"]
Sep 11 17:42:21.434385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.434338    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ac6cbea-3716-4e90-9c92-08b2c0196193" containerName="payload-pre-processing"
Sep 11 17:42:21.434385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.434349    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ac6cbea-3716-4e90-9c92-08b2c0196193" containerName="payload-pre-processing"
Sep 11 17:42:21.434385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.434364    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fd67239-3d64-4054-a5a5-5c1928346a84" containerName="payload-processing"
Sep 11 17:42:21.434385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.434370    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fd67239-3d64-4054-a5a5-5c1928346a84" containerName="payload-processing"
Sep 11 17:42:21.434615 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.434447    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fd67239-3d64-4054-a5a5-5c1928346a84" containerName="payload-processing"
Sep 11 17:42:21.434615 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.434458    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ac6cbea-3716-4e90-9c92-08b2c0196193" containerName="payload-pre-processing"
Sep 11 17:42:21.437820 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.437799    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:21.440257 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.440233    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-40f1fc\""
Sep 11 17:42:21.449361 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.449332    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"]
Sep 11 17:42:21.461709 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.461680    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16308997-dee4-41a4-a4e2-fc33bb96a734-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch\" (UID: \"16308997-dee4-41a4-a4e2-fc33bb96a734\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:21.461880 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.461722    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dggvt\" (UniqueName: \"kubernetes.io/projected/16308997-dee4-41a4-a4e2-fc33bb96a734-kube-api-access-dggvt\") pod \"payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch\" (UID: \"16308997-dee4-41a4-a4e2-fc33bb96a734\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:21.486718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.486686    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"]
Sep 11 17:42:21.490187 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.490169    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:21.502005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.501983    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-40f1fc-dockercfg-crb98\""
Sep 11 17:42:21.503239 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.503219    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"]
Sep 11 17:42:21.562695 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.562662    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36fb9d77-65c6-42a9-b776-97a49f431883-plugins-config-volume\") pod \"payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk\" (UID: \"36fb9d77-65c6-42a9-b776-97a49f431883\") " pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:21.562888 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.562734    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16308997-dee4-41a4-a4e2-fc33bb96a734-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch\" (UID: \"16308997-dee4-41a4-a4e2-fc33bb96a734\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:21.562888 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.562798    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dggvt\" (UniqueName: \"kubernetes.io/projected/16308997-dee4-41a4-a4e2-fc33bb96a734-kube-api-access-dggvt\") pod \"payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch\" (UID: \"16308997-dee4-41a4-a4e2-fc33bb96a734\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:21.562888 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.562876    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv7mg\" (UniqueName: \"kubernetes.io/projected/36fb9d77-65c6-42a9-b776-97a49f431883-kube-api-access-qv7mg\") pod \"payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk\" (UID: \"36fb9d77-65c6-42a9-b776-97a49f431883\") " pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:21.563510 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.563492    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16308997-dee4-41a4-a4e2-fc33bb96a734-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch\" (UID: \"16308997-dee4-41a4-a4e2-fc33bb96a734\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:21.573450 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.573258    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dggvt\" (UniqueName: \"kubernetes.io/projected/16308997-dee4-41a4-a4e2-fc33bb96a734-kube-api-access-dggvt\") pod \"payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch\" (UID: \"16308997-dee4-41a4-a4e2-fc33bb96a734\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:21.663568 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.663529    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv7mg\" (UniqueName: \"kubernetes.io/projected/36fb9d77-65c6-42a9-b776-97a49f431883-kube-api-access-qv7mg\") pod \"payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk\" (UID: \"36fb9d77-65c6-42a9-b776-97a49f431883\") " pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:21.663756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.663583    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36fb9d77-65c6-42a9-b776-97a49f431883-plugins-config-volume\") pod \"payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk\" (UID: \"36fb9d77-65c6-42a9-b776-97a49f431883\") " pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:21.664312 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.664293    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36fb9d77-65c6-42a9-b776-97a49f431883-plugins-config-volume\") pod \"payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk\" (UID: \"36fb9d77-65c6-42a9-b776-97a49f431883\") " pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:21.672435 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.672386    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv7mg\" (UniqueName: \"kubernetes.io/projected/36fb9d77-65c6-42a9-b776-97a49f431883-kube-api-access-qv7mg\") pod \"payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk\" (UID: \"36fb9d77-65c6-42a9-b776-97a49f431883\") " pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:21.748916 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.748824    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:21.800725 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:21.800691    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:22.042906 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.040467    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"]
Sep 11 17:42:22.097518 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.097491    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"]
Sep 11 17:42:22.098024 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:42:22.097990    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36fb9d77_65c6_42a9_b776_97a49f431883.slice/crio-19f9040b9b7251cf89528dd4fbc3bd851b59c38da84e1c1fc50ad685dc4d0862 WatchSource:0}: Error finding container 19f9040b9b7251cf89528dd4fbc3bd851b59c38da84e1c1fc50ad685dc4d0862: Status 404 returned error can't find the container with id 19f9040b9b7251cf89528dd4fbc3bd851b59c38da84e1c1fc50ad685dc4d0862
Sep 11 17:42:22.927567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.927532    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch" event={"ID":"16308997-dee4-41a4-a4e2-fc33bb96a734","Type":"ContainerStarted","Data":"fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400"}
Sep 11 17:42:22.928050 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.927590    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch" event={"ID":"16308997-dee4-41a4-a4e2-fc33bb96a734","Type":"ContainerStarted","Data":"4822c85da35b5b3cf9e40bb43f1e985856c37f9876fc69a654eacfc395cdf208"}
Sep 11 17:42:22.928050 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.927627    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:22.929323 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.929295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk" event={"ID":"36fb9d77-65c6-42a9-b776-97a49f431883","Type":"ContainerStarted","Data":"6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f"}
Sep 11 17:42:22.929449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.929345    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk" event={"ID":"36fb9d77-65c6-42a9-b776-97a49f431883","Type":"ContainerStarted","Data":"19f9040b9b7251cf89528dd4fbc3bd851b59c38da84e1c1fc50ad685dc4d0862"}
Sep 11 17:42:22.929449 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.929384    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:22.949200 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.949147    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch" podStartSLOduration=1.9491309060000002 podStartE2EDuration="1.949130906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:42:22.947154252 +0000 UTC m=+1317.901844154" watchObservedRunningTime="2026-09-11 17:42:22.949130906 +0000 UTC m=+1317.903820831"
Sep 11 17:42:22.967669 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:22.967605    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk" podStartSLOduration=1.9675833950000001 podStartE2EDuration="1.967583395s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:42:22.96482241 +0000 UTC m=+1317.919512325" watchObservedRunningTime="2026-09-11 17:42:22.967583395 +0000 UTC m=+1317.922273299"
Sep 11 17:42:33.937291 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:33.937256    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:42:33.937787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:33.937395    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:42:39.744952 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:39.744918    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:42:56.832834 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:56.832756    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"]
Sep 11 17:42:56.836348 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:56.836328    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:56.839827 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:56.839809    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-86db1c-serving-cert\""
Sep 11 17:42:56.862320 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:56.862298    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"]
Sep 11 17:42:56.996204 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:56.996162    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-openshift-service-ca\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:56.996204 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:56.996206    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg8tm\" (UniqueName: \"kubernetes.io/projected/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-kube-api-access-gg8tm\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:56.996524 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:56.996247    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:56.996524 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:56.996334    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-metrics-certs\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.097434 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.097303    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-openshift-service-ca\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.097434 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.097355    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg8tm\" (UniqueName: \"kubernetes.io/projected/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-kube-api-access-gg8tm\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.097434 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.097392    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.097745 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.097454    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-metrics-certs\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.097745 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:42:57.097536    2584 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-serving-cert: secret "maas-api-e2e-api-b-86db1c-serving-cert" not found
Sep 11 17:42:57.097745 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:42:57.097597    2584 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls podName:c05fd0e7-d24e-49a6-8f96-b829b38a6ad5 nodeName:}" failed. No retries permitted until 2026-09-11 17:42:57.5975822 +0000 UTC m=+1352.552272084 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls") pod "maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p" (UID: "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5") : secret "maas-api-e2e-api-b-86db1c-serving-cert" not found
Sep 11 17:42:57.098081 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.098059    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-openshift-service-ca\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.099911 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.099889    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-metrics-certs\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.114890 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.114867    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg8tm\" (UniqueName: \"kubernetes.io/projected/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-kube-api-access-gg8tm\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.602475 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.602441    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.605020 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.604987    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls\") pod \"maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.746148 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.746117    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:57.806753 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.806721    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"]
Sep 11 17:42:57.811019 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.810996    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:57.818268 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.816566    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-b-86db1c\""
Sep 11 17:42:57.818268 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.816876    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-b-86db1c-dockercfg-9gvtw\""
Sep 11 17:42:57.829384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.829337    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"]
Sep 11 17:42:57.906210 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.906179    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4d5r\" (UniqueName: \"kubernetes.io/projected/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-kube-api-access-l4d5r\") pod \"payload-processing-e2e-api-b-86db1c-7b7749577-k9w99\" (UID: \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\") " pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:57.906632 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:57.906221    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-86db1c-7b7749577-k9w99\" (UID: \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\") " pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:58.006879 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:58.006840    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4d5r\" (UniqueName: \"kubernetes.io/projected/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-kube-api-access-l4d5r\") pod \"payload-processing-e2e-api-b-86db1c-7b7749577-k9w99\" (UID: \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\") " pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:58.006879 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:58.006886    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-86db1c-7b7749577-k9w99\" (UID: \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\") " pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:58.007582 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:58.007562    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-plugins-config-volume\") pod \"payload-processing-e2e-api-b-86db1c-7b7749577-k9w99\" (UID: \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\") " pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:58.016370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:58.016336    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4d5r\" (UniqueName: \"kubernetes.io/projected/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-kube-api-access-l4d5r\") pod \"payload-processing-e2e-api-b-86db1c-7b7749577-k9w99\" (UID: \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\") " pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:58.061686 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:58.061665    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"]
Sep 11 17:42:58.063581 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:42:58.063551    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc05fd0e7_d24e_49a6_8f96_b829b38a6ad5.slice/crio-04f1f41556548783b6dbb20519bc6dec8d04baca20a87e98767acfda0c9c08f6 WatchSource:0}: Error finding container 04f1f41556548783b6dbb20519bc6dec8d04baca20a87e98767acfda0c9c08f6: Status 404 returned error can't find the container with id 04f1f41556548783b6dbb20519bc6dec8d04baca20a87e98767acfda0c9c08f6
Sep 11 17:42:58.132707 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:58.132676    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:58.151714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:58.151687    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p" event={"ID":"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5","Type":"ContainerStarted","Data":"04f1f41556548783b6dbb20519bc6dec8d04baca20a87e98767acfda0c9c08f6"}
Sep 11 17:42:58.418701 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:58.418675    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"]
Sep 11 17:42:58.420339 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:42:58.420314    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2bf58c4b_fda0_41cf_a3b8_7e13c9ef802b.slice/crio-992b71d5332e536141fb7488f8c5b083930029f6ad02def9f5112df54c36e5be WatchSource:0}: Error finding container 992b71d5332e536141fb7488f8c5b083930029f6ad02def9f5112df54c36e5be: Status 404 returned error can't find the container with id 992b71d5332e536141fb7488f8c5b083930029f6ad02def9f5112df54c36e5be
Sep 11 17:42:59.160312 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:59.160272    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99" event={"ID":"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b","Type":"ContainerStarted","Data":"09ce21db4eaa5e578b3b47eb08c19176c180128c6d794ac7dd4753a6dc2da5bb"}
Sep 11 17:42:59.160782 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:59.160340    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99" event={"ID":"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b","Type":"ContainerStarted","Data":"992b71d5332e536141fb7488f8c5b083930029f6ad02def9f5112df54c36e5be"}
Sep 11 17:42:59.160782 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:59.160370    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:42:59.161748 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:59.161727    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p" event={"ID":"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5","Type":"ContainerStarted","Data":"14e929d3e92231054608660bacc9235876b169f44395c9e7a081f2e957c51af2"}
Sep 11 17:42:59.161871 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:59.161778    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:42:59.180415 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:59.180363    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99" podStartSLOduration=2.180347986 podStartE2EDuration="2.180347986s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:42:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:42:59.178957295 +0000 UTC m=+1354.133647198" watchObservedRunningTime="2026-09-11 17:42:59.180347986 +0000 UTC m=+1354.135037910"
Sep 11 17:42:59.204426 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:42:59.201938    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p" podStartSLOduration=2.8613262109999997 podStartE2EDuration="3.20191864s" totalImagesPullingTime="340.592429ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:42:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:42:59.197246145 +0000 UTC m=+1354.151936048" watchObservedRunningTime="2026-09-11 17:42:59.20191864 +0000 UTC m=+1354.156608547"
Sep 11 17:43:02.293867 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:02.293826    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:43:05.174454 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:05.174424    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:43:10.170476 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:10.170445    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:43:23.978988 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:23.978949    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:43:41.549467 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:41.549430    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"]
Sep 11 17:43:41.550301 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:41.549645    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk" podUID="36fb9d77-65c6-42a9-b776-97a49f431883" containerName="payload-processing" containerID="cri-o://6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f" gracePeriod=30
Sep 11 17:43:41.576281 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:41.576244    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"]
Sep 11 17:43:41.576531 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:41.576502    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch" podUID="16308997-dee4-41a4-a4e2-fc33bb96a734" containerName="payload-pre-processing" containerID="cri-o://fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400" gracePeriod=30
Sep 11 17:43:41.863855 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:41.863828    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:43:41.867386 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:41.867365    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:43:42.019209 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.019174    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qv7mg\" (UniqueName: \"kubernetes.io/projected/36fb9d77-65c6-42a9-b776-97a49f431883-kube-api-access-qv7mg\") pod \"36fb9d77-65c6-42a9-b776-97a49f431883\" (UID: \"36fb9d77-65c6-42a9-b776-97a49f431883\") "
Sep 11 17:43:42.019438 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.019284    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36fb9d77-65c6-42a9-b776-97a49f431883-plugins-config-volume\") pod \"36fb9d77-65c6-42a9-b776-97a49f431883\" (UID: \"36fb9d77-65c6-42a9-b776-97a49f431883\") "
Sep 11 17:43:42.019438 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.019319    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dggvt\" (UniqueName: \"kubernetes.io/projected/16308997-dee4-41a4-a4e2-fc33bb96a734-kube-api-access-dggvt\") pod \"16308997-dee4-41a4-a4e2-fc33bb96a734\" (UID: \"16308997-dee4-41a4-a4e2-fc33bb96a734\") "
Sep 11 17:43:42.019438 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.019343    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16308997-dee4-41a4-a4e2-fc33bb96a734-plugins-config-volume\") pod \"16308997-dee4-41a4-a4e2-fc33bb96a734\" (UID: \"16308997-dee4-41a4-a4e2-fc33bb96a734\") "
Sep 11 17:43:42.019765 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.019736    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/36fb9d77-65c6-42a9-b776-97a49f431883-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "36fb9d77-65c6-42a9-b776-97a49f431883" (UID: "36fb9d77-65c6-42a9-b776-97a49f431883"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:43:42.019864 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.019823    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/16308997-dee4-41a4-a4e2-fc33bb96a734-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "16308997-dee4-41a4-a4e2-fc33bb96a734" (UID: "16308997-dee4-41a4-a4e2-fc33bb96a734"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:43:42.021615 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.021589    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16308997-dee4-41a4-a4e2-fc33bb96a734-kube-api-access-dggvt" (OuterVolumeSpecName: "kube-api-access-dggvt") pod "16308997-dee4-41a4-a4e2-fc33bb96a734" (UID: "16308997-dee4-41a4-a4e2-fc33bb96a734"). InnerVolumeSpecName "kube-api-access-dggvt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:43:42.021615 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.021605    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36fb9d77-65c6-42a9-b776-97a49f431883-kube-api-access-qv7mg" (OuterVolumeSpecName: "kube-api-access-qv7mg") pod "36fb9d77-65c6-42a9-b776-97a49f431883" (UID: "36fb9d77-65c6-42a9-b776-97a49f431883"). InnerVolumeSpecName "kube-api-access-qv7mg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:43:42.121208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.121123    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/36fb9d77-65c6-42a9-b776-97a49f431883-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:43:42.121208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.121157    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dggvt\" (UniqueName: \"kubernetes.io/projected/16308997-dee4-41a4-a4e2-fc33bb96a734-kube-api-access-dggvt\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:43:42.121208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.121166    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/16308997-dee4-41a4-a4e2-fc33bb96a734-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:43:42.121208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.121174    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qv7mg\" (UniqueName: \"kubernetes.io/projected/36fb9d77-65c6-42a9-b776-97a49f431883-kube-api-access-qv7mg\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:43:42.420181 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.420144    2584 generic.go:356] "Generic (PLEG): container finished" podID="16308997-dee4-41a4-a4e2-fc33bb96a734" containerID="fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400" exitCode=0
Sep 11 17:43:42.420363 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.420189    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"
Sep 11 17:43:42.420363 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.420229    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch" event={"ID":"16308997-dee4-41a4-a4e2-fc33bb96a734","Type":"ContainerDied","Data":"fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400"}
Sep 11 17:43:42.420363 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.420281    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch" event={"ID":"16308997-dee4-41a4-a4e2-fc33bb96a734","Type":"ContainerDied","Data":"4822c85da35b5b3cf9e40bb43f1e985856c37f9876fc69a654eacfc395cdf208"}
Sep 11 17:43:42.420363 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.420308    2584 scope.go:117] "RemoveContainer" containerID="fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400"
Sep 11 17:43:42.421796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.421773    2584 generic.go:356] "Generic (PLEG): container finished" podID="36fb9d77-65c6-42a9-b776-97a49f431883" containerID="6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f" exitCode=0
Sep 11 17:43:42.421898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.421812    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk" event={"ID":"36fb9d77-65c6-42a9-b776-97a49f431883","Type":"ContainerDied","Data":"6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f"}
Sep 11 17:43:42.421898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.421848    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"
Sep 11 17:43:42.421898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.421869    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk" event={"ID":"36fb9d77-65c6-42a9-b776-97a49f431883","Type":"ContainerDied","Data":"19f9040b9b7251cf89528dd4fbc3bd851b59c38da84e1c1fc50ad685dc4d0862"}
Sep 11 17:43:42.429926 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.429907    2584 scope.go:117] "RemoveContainer" containerID="fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400"
Sep 11 17:43:42.430242 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:43:42.430220    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400\": container with ID starting with fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400 not found: ID does not exist" containerID="fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400"
Sep 11 17:43:42.430342 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.430256    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400"} err="failed to get container status \"fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400\": rpc error: code = NotFound desc = could not find container \"fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400\": container with ID starting with fdfea797552b43d88ef5e54b528db10d67ead1804099722c62673ce23835e400 not found: ID does not exist"
Sep 11 17:43:42.430342 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.430281    2584 scope.go:117] "RemoveContainer" containerID="6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f"
Sep 11 17:43:42.438810 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.438791    2584 scope.go:117] "RemoveContainer" containerID="6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f"
Sep 11 17:43:42.439057 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:43:42.439039    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f\": container with ID starting with 6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f not found: ID does not exist" containerID="6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f"
Sep 11 17:43:42.439109 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.439063    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f"} err="failed to get container status \"6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f\": rpc error: code = NotFound desc = could not find container \"6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f\": container with ID starting with 6088dfa6c2c180897f6814d20f2cd6512965f9c3b8ced220d2cadd92527f885f not found: ID does not exist"
Sep 11 17:43:42.472427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.472376    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"]
Sep 11 17:43:42.490968 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.490940    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-40f1fc-6f5dcd859f-9fhlk"]
Sep 11 17:43:42.521250 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.521213    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"]
Sep 11 17:43:42.536286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:42.536252    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-40f1fc-58b88cbb98-s7jch"]
Sep 11 17:43:43.706935 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:43.706896    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16308997-dee4-41a4-a4e2-fc33bb96a734" path="/var/lib/kubelet/pods/16308997-dee4-41a4-a4e2-fc33bb96a734/volumes"
Sep 11 17:43:43.707290 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:43.707252    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36fb9d77-65c6-42a9-b776-97a49f431883" path="/var/lib/kubelet/pods/36fb9d77-65c6-42a9-b776-97a49f431883/volumes"
Sep 11 17:43:45.695924 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:43:45.695890    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:44:04.156302 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:04.156257    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:44:06.312063 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.312029    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"]
Sep 11 17:44:06.312529 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.312274    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p" podUID="c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" containerName="maas-api" containerID="cri-o://14e929d3e92231054608660bacc9235876b169f44395c9e7a081f2e957c51af2" gracePeriod=30
Sep 11 17:44:06.418060 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.418026    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"]
Sep 11 17:44:06.418345 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.418314    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99" podUID="2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b" containerName="payload-processing" containerID="cri-o://09ce21db4eaa5e578b3b47eb08c19176c180128c6d794ac7dd4753a6dc2da5bb" gracePeriod=30
Sep 11 17:44:06.572523 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.572485    2584 generic.go:356] "Generic (PLEG): container finished" podID="c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" containerID="14e929d3e92231054608660bacc9235876b169f44395c9e7a081f2e957c51af2" exitCode=0
Sep 11 17:44:06.572677 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.572601    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p" event={"ID":"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5","Type":"ContainerDied","Data":"14e929d3e92231054608660bacc9235876b169f44395c9e7a081f2e957c51af2"}
Sep 11 17:44:06.572677 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.572672    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p" event={"ID":"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5","Type":"ContainerDied","Data":"04f1f41556548783b6dbb20519bc6dec8d04baca20a87e98767acfda0c9c08f6"}
Sep 11 17:44:06.572795 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.572697    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="04f1f41556548783b6dbb20519bc6dec8d04baca20a87e98767acfda0c9c08f6"
Sep 11 17:44:06.574574 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.574546    2584 generic.go:356] "Generic (PLEG): container finished" podID="2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b" containerID="09ce21db4eaa5e578b3b47eb08c19176c180128c6d794ac7dd4753a6dc2da5bb" exitCode=0
Sep 11 17:44:06.574702 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.574596    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99" event={"ID":"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b","Type":"ContainerDied","Data":"09ce21db4eaa5e578b3b47eb08c19176c180128c6d794ac7dd4753a6dc2da5bb"}
Sep 11 17:44:06.584950 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.584922    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:44:06.632867 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.632829    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls\") pod \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") "
Sep 11 17:44:06.633051 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.632884    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gg8tm\" (UniqueName: \"kubernetes.io/projected/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-kube-api-access-gg8tm\") pod \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") "
Sep 11 17:44:06.633051 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.632987    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-openshift-service-ca\") pod \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") "
Sep 11 17:44:06.633191 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.633076    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-metrics-certs\") pod \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\" (UID: \"c05fd0e7-d24e-49a6-8f96-b829b38a6ad5\") "
Sep 11 17:44:06.633483 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.633395    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" (UID: "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:44:06.637857 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.637765    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-kube-api-access-gg8tm" (OuterVolumeSpecName: "kube-api-access-gg8tm") pod "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" (UID: "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5"). InnerVolumeSpecName "kube-api-access-gg8tm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:44:06.638610 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.638572    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" (UID: "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:44:06.638810 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.638783    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" (UID: "c05fd0e7-d24e-49a6-8f96-b829b38a6ad5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:44:06.679315 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.679290    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:44:06.733804 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.733766    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4d5r\" (UniqueName: \"kubernetes.io/projected/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-kube-api-access-l4d5r\") pod \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\" (UID: \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\") "
Sep 11 17:44:06.733972 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.733896    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-plugins-config-volume\") pod \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\" (UID: \"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b\") "
Sep 11 17:44:06.734175 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.734157    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-openshift-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:06.734243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.734183    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-metrics-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:06.734243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.734195    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-maas-api-tls\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:06.734243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.734209    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gg8tm\" (UniqueName: \"kubernetes.io/projected/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5-kube-api-access-gg8tm\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:06.734391 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.734258    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b" (UID: "2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:44:06.736308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.736274    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-kube-api-access-l4d5r" (OuterVolumeSpecName: "kube-api-access-l4d5r") pod "2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b" (UID: "2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b"). InnerVolumeSpecName "kube-api-access-l4d5r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:44:06.834948 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.834859    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4d5r\" (UniqueName: \"kubernetes.io/projected/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-kube-api-access-l4d5r\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:06.834948 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:06.834887    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:07.582733 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.582653    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"
Sep 11 17:44:07.582733 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.582701    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99" event={"ID":"2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b","Type":"ContainerDied","Data":"992b71d5332e536141fb7488f8c5b083930029f6ad02def9f5112df54c36e5be"}
Sep 11 17:44:07.583267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.582760    2584 scope.go:117] "RemoveContainer" containerID="09ce21db4eaa5e578b3b47eb08c19176c180128c6d794ac7dd4753a6dc2da5bb"
Sep 11 17:44:07.583267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.582860    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"
Sep 11 17:44:07.614947 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.614915    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"]
Sep 11 17:44:07.619752 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.619726    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-86db1c-546d55dbd4-wxj8p"]
Sep 11 17:44:07.639674 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.639651    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"]
Sep 11 17:44:07.656743 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.656718    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-b-86db1c-7b7749577-k9w99"]
Sep 11 17:44:07.706287 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.706254    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b" path="/var/lib/kubelet/pods/2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b/volumes"
Sep 11 17:44:07.706741 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:07.706715    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" path="/var/lib/kubelet/pods/c05fd0e7-d24e-49a6-8f96-b829b38a6ad5/volumes"
Sep 11 17:44:08.531238 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531193    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7729-bbb357"]
Sep 11 17:44:08.531687 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531668    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16308997-dee4-41a4-a4e2-fc33bb96a734" containerName="payload-pre-processing"
Sep 11 17:44:08.531781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531690    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="16308997-dee4-41a4-a4e2-fc33bb96a734" containerName="payload-pre-processing"
Sep 11 17:44:08.531781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531706    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" containerName="maas-api"
Sep 11 17:44:08.531781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531713    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" containerName="maas-api"
Sep 11 17:44:08.531781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531743    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b" containerName="payload-processing"
Sep 11 17:44:08.531781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531752    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b" containerName="payload-processing"
Sep 11 17:44:08.531781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531773    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="36fb9d77-65c6-42a9-b776-97a49f431883" containerName="payload-processing"
Sep 11 17:44:08.531781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531781    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="36fb9d77-65c6-42a9-b776-97a49f431883" containerName="payload-processing"
Sep 11 17:44:08.532121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531869    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="16308997-dee4-41a4-a4e2-fc33bb96a734" containerName="payload-pre-processing"
Sep 11 17:44:08.532121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531884    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="36fb9d77-65c6-42a9-b776-97a49f431883" containerName="payload-processing"
Sep 11 17:44:08.532121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531897    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="c05fd0e7-d24e-49a6-8f96-b829b38a6ad5" containerName="maas-api"
Sep 11 17:44:08.532121 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.531905    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="2bf58c4b-fda0-41cf-a3b8-7e13c9ef802b" containerName="payload-processing"
Sep 11 17:44:08.536385 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.536362    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:08.539237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.539218    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-jtt66\""
Sep 11 17:44:08.546050 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.545733    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7729-bbb357"]
Sep 11 17:44:08.652007 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.651974    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hrhh8\" (UniqueName: \"kubernetes.io/projected/d4555783-5666-4848-b432-257b3b4b0695-kube-api-access-hrhh8\") pod \"test-curl-7729-bbb357\" (UID: \"d4555783-5666-4848-b432-257b3b4b0695\") " pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:08.753561 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.753512    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hrhh8\" (UniqueName: \"kubernetes.io/projected/d4555783-5666-4848-b432-257b3b4b0695-kube-api-access-hrhh8\") pod \"test-curl-7729-bbb357\" (UID: \"d4555783-5666-4848-b432-257b3b4b0695\") " pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:08.762660 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.762625    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hrhh8\" (UniqueName: \"kubernetes.io/projected/d4555783-5666-4848-b432-257b3b4b0695-kube-api-access-hrhh8\") pod \"test-curl-7729-bbb357\" (UID: \"d4555783-5666-4848-b432-257b3b4b0695\") " pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:08.853243 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:08.853154    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:09.128011 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:09.127986    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7729-bbb357"]
Sep 11 17:44:09.129425 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:44:09.129380    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd4555783_5666_4848_b432_257b3b4b0695.slice/crio-a6e3518086262a9968977a4539c2116af0c5307de8b55349acedd46a068e4b56 WatchSource:0}: Error finding container a6e3518086262a9968977a4539c2116af0c5307de8b55349acedd46a068e4b56: Status 404 returned error can't find the container with id a6e3518086262a9968977a4539c2116af0c5307de8b55349acedd46a068e4b56
Sep 11 17:44:09.597333 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:09.597295    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7729-bbb357" event={"ID":"d4555783-5666-4848-b432-257b3b4b0695","Type":"ContainerStarted","Data":"bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1"}
Sep 11 17:44:09.597333 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:09.597339    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7729-bbb357" event={"ID":"d4555783-5666-4848-b432-257b3b4b0695","Type":"ContainerStarted","Data":"a6e3518086262a9968977a4539c2116af0c5307de8b55349acedd46a068e4b56"}
Sep 11 17:44:09.617437 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:09.617372    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-curl-7729-bbb357" podStartSLOduration=1.617356864 podStartE2EDuration="1.617356864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:44:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:44:09.616460441 +0000 UTC m=+1424.571150344" watchObservedRunningTime="2026-09-11 17:44:09.617356864 +0000 UTC m=+1424.572046766"
Sep 11 17:44:10.248636 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:10.248592    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7729-bbb357"]
Sep 11 17:44:10.254524 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:10.254490    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7729-bbb357"]
Sep 11 17:44:10.603178 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:10.603146    2584 kuberuntime_manager.go:649] "Missing actuated resource record" pod="opendatahub/test-curl-7729-bbb357" container="test-curl-7729-bbb357"
Sep 11 17:44:11.608671 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:11.608628    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/test-curl-7729-bbb357" podUID="d4555783-5666-4848-b432-257b3b4b0695" containerName="test-curl-7729-bbb357" containerID="cri-o://bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1" gracePeriod=2
Sep 11 17:44:11.614787 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:11.614753    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7729-bbb357\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="d4555783-5666-4848-b432-257b3b4b0695" pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:13.806995 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:13.806971    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:13.901945 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:13.901916    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hrhh8\" (UniqueName: \"kubernetes.io/projected/d4555783-5666-4848-b432-257b3b4b0695-kube-api-access-hrhh8\") pod \"d4555783-5666-4848-b432-257b3b4b0695\" (UID: \"d4555783-5666-4848-b432-257b3b4b0695\") "
Sep 11 17:44:13.904019 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:13.903989    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4555783-5666-4848-b432-257b3b4b0695-kube-api-access-hrhh8" (OuterVolumeSpecName: "kube-api-access-hrhh8") pod "d4555783-5666-4848-b432-257b3b4b0695" (UID: "d4555783-5666-4848-b432-257b3b4b0695"). InnerVolumeSpecName "kube-api-access-hrhh8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:44:14.002965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:14.002900    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hrhh8\" (UniqueName: \"kubernetes.io/projected/d4555783-5666-4848-b432-257b3b4b0695-kube-api-access-hrhh8\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:14.627641 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:14.627607    2584 generic.go:356] "Generic (PLEG): container finished" podID="d4555783-5666-4848-b432-257b3b4b0695" containerID="bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1" exitCode=137
Sep 11 17:44:14.627831 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:14.627658    2584 scope.go:117] "RemoveContainer" containerID="bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1"
Sep 11 17:44:14.627831 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:14.627654    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:14.636970 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:14.636952    2584 scope.go:117] "RemoveContainer" containerID="bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1"
Sep 11 17:44:14.637195 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:14.637172    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1\": container with ID starting with bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1 not found: ID does not exist" containerID="bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1"
Sep 11 17:44:14.637244 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:14.637204    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1"} err="failed to get container status \"bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1\": rpc error: code = NotFound desc = could not find container \"bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1\": container with ID starting with bfbf9f693c27ba9a007969e2dae84e784e2967f6ee678f3a8d97eb1c2036a0b1 not found: ID does not exist"
Sep 11 17:44:14.637988 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:14.637969    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7729-bbb357\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="d4555783-5666-4848-b432-257b3b4b0695" pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:15.705614 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:15.705576    2584 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7729-bbb357\" is forbidden: User \"system:node:ip-10-0-143-85.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-143-85.ec2.internal' and this object" podUID="d4555783-5666-4848-b432-257b3b4b0695" pod="opendatahub/test-curl-7729-bbb357"
Sep 11 17:44:15.705614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:15.705609    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4555783-5666-4848-b432-257b3b4b0695" path="/var/lib/kubelet/pods/d4555783-5666-4848-b432-257b3b4b0695/volumes"
Sep 11 17:44:19.678441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:19.678393    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:44:29.047281 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:29.047244    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:44:45.287078 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.287045    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"]
Sep 11 17:44:45.287643 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.287239    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh" podUID="8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" containerName="maas-api" containerID="cri-o://245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72" gracePeriod=30
Sep 11 17:44:45.394276 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.394241    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"]
Sep 11 17:44:45.394520 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.394488    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245" podUID="05e74885-444c-4737-8c8a-5fbdaf212dbe" containerName="payload-processing" containerID="cri-o://b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6" gracePeriod=30
Sep 11 17:44:45.557222 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.557158    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:44:45.593772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.593747    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hztl5\" (UniqueName: \"kubernetes.io/projected/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-kube-api-access-hztl5\") pod \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") "
Sep 11 17:44:45.593928 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.593784    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-metrics-certs\") pod \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") "
Sep 11 17:44:45.593928 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.593850    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-openshift-service-ca\") pod \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") "
Sep 11 17:44:45.593928 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.593888    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-maas-api-tls\") pod \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\" (UID: \"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7\") "
Sep 11 17:44:45.594274 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.594241    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" (UID: "8b7de54b-aadc-4dac-aed3-1527aa8aa0e7"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:44:45.596475 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.596446    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" (UID: "8b7de54b-aadc-4dac-aed3-1527aa8aa0e7"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:44:45.596637 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.596476    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" (UID: "8b7de54b-aadc-4dac-aed3-1527aa8aa0e7"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:44:45.596828 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.596794    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-kube-api-access-hztl5" (OuterVolumeSpecName: "kube-api-access-hztl5") pod "8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" (UID: "8b7de54b-aadc-4dac-aed3-1527aa8aa0e7"). InnerVolumeSpecName "kube-api-access-hztl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:44:45.648701 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.648678    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:44:45.695068 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.695040    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e74885-444c-4737-8c8a-5fbdaf212dbe-plugins-config-volume\") pod \"05e74885-444c-4737-8c8a-5fbdaf212dbe\" (UID: \"05e74885-444c-4737-8c8a-5fbdaf212dbe\") "
Sep 11 17:44:45.695219 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.695106    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggs7m\" (UniqueName: \"kubernetes.io/projected/05e74885-444c-4737-8c8a-5fbdaf212dbe-kube-api-access-ggs7m\") pod \"05e74885-444c-4737-8c8a-5fbdaf212dbe\" (UID: \"05e74885-444c-4737-8c8a-5fbdaf212dbe\") "
Sep 11 17:44:45.695374 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.695355    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hztl5\" (UniqueName: \"kubernetes.io/projected/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-kube-api-access-hztl5\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:45.695478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.695379    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-metrics-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:45.695478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.695394    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-openshift-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:45.695478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.695437    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7-maas-api-tls\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:45.695478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.695448    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/05e74885-444c-4737-8c8a-5fbdaf212dbe-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "05e74885-444c-4737-8c8a-5fbdaf212dbe" (UID: "05e74885-444c-4737-8c8a-5fbdaf212dbe"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:44:45.697139 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.697117    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/05e74885-444c-4737-8c8a-5fbdaf212dbe-kube-api-access-ggs7m" (OuterVolumeSpecName: "kube-api-access-ggs7m") pod "05e74885-444c-4737-8c8a-5fbdaf212dbe" (UID: "05e74885-444c-4737-8c8a-5fbdaf212dbe"). InnerVolumeSpecName "kube-api-access-ggs7m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:44:45.796224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.796192    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/05e74885-444c-4737-8c8a-5fbdaf212dbe-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:45.796224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.796219    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggs7m\" (UniqueName: \"kubernetes.io/projected/05e74885-444c-4737-8c8a-5fbdaf212dbe-kube-api-access-ggs7m\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:45.809511 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.809327    2584 generic.go:356] "Generic (PLEG): container finished" podID="05e74885-444c-4737-8c8a-5fbdaf212dbe" containerID="b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6" exitCode=0
Sep 11 17:44:45.809511 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.809372    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"
Sep 11 17:44:45.809511 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.809482    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245" event={"ID":"05e74885-444c-4737-8c8a-5fbdaf212dbe","Type":"ContainerDied","Data":"b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6"}
Sep 11 17:44:45.809753 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.809525    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245" event={"ID":"05e74885-444c-4737-8c8a-5fbdaf212dbe","Type":"ContainerDied","Data":"0b2635c7324633811a083f002c52f767e47c32d908baf8a8cf7d2c62596fce38"}
Sep 11 17:44:45.809753 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.809550    2584 scope.go:117] "RemoveContainer" containerID="b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6"
Sep 11 17:44:45.810998 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.810977    2584 generic.go:356] "Generic (PLEG): container finished" podID="8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" containerID="245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72" exitCode=0
Sep 11 17:44:45.811111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.811029    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"
Sep 11 17:44:45.811111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.811041    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh" event={"ID":"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7","Type":"ContainerDied","Data":"245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72"}
Sep 11 17:44:45.811111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.811082    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh" event={"ID":"8b7de54b-aadc-4dac-aed3-1527aa8aa0e7","Type":"ContainerDied","Data":"ac720bd6cf9937f06cd44d04ea79a397102a2766e7267e3d9fa2e3ff5a368bee"}
Sep 11 17:44:45.818699 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.818672    2584 scope.go:117] "RemoveContainer" containerID="b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6"
Sep 11 17:44:45.818954 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:45.818936    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6\": container with ID starting with b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6 not found: ID does not exist" containerID="b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6"
Sep 11 17:44:45.819030 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.818962    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6"} err="failed to get container status \"b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6\": rpc error: code = NotFound desc = could not find container \"b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6\": container with ID starting with b423326c27f6dc8fee84f1e869ade2e2207aac39d044dc8791cc4147bf6285b6 not found: ID does not exist"
Sep 11 17:44:45.819030 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.818977    2584 scope.go:117] "RemoveContainer" containerID="245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72"
Sep 11 17:44:45.827223 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.827210    2584 scope.go:117] "RemoveContainer" containerID="245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72"
Sep 11 17:44:45.827481 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:45.827463    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72\": container with ID starting with 245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72 not found: ID does not exist" containerID="245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72"
Sep 11 17:44:45.827529 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.827487    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72"} err="failed to get container status \"245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72\": rpc error: code = NotFound desc = could not find container \"245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72\": container with ID starting with 245e2ab11047879248ab8982d9b422617f218a7492dcbf1a5540e74682dc3d72 not found: ID does not exist"
Sep 11 17:44:45.921652 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.921609    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"]
Sep 11 17:44:45.931935 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.931911    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w2-b6b979-7588d874b4-g9zxh"]
Sep 11 17:44:45.975989 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:45.975951    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"]
Sep 11 17:44:46.002943 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:46.002911    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-b-w2-b6b979-645786c845-9w245"]
Sep 11 17:44:47.706247 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:47.706215    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="05e74885-444c-4737-8c8a-5fbdaf212dbe" path="/var/lib/kubelet/pods/05e74885-444c-4737-8c8a-5fbdaf212dbe/volumes"
Sep 11 17:44:47.706651 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:47.706632    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" path="/var/lib/kubelet/pods/8b7de54b-aadc-4dac-aed3-1527aa8aa0e7/volumes"
Sep 11 17:44:48.897625 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:48.897586    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:44:53.598422 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:53.597790    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"]
Sep 11 17:44:53.598422 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:53.598053    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy" containerID="cri-o://305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800" gracePeriod=30
Sep 11 17:44:58.859246 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.859218    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:44:58.892038 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.891996    2584 generic.go:356] "Generic (PLEG): container finished" podID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerID="305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800" exitCode=0
Sep 11 17:44:58.892216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.892047    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"
Sep 11 17:44:58.892216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.892058    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" event={"ID":"1f9f392d-6b38-479c-8a0e-e5328c1236c3","Type":"ContainerDied","Data":"305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800"}
Sep 11 17:44:58.892216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.892125    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4" event={"ID":"1f9f392d-6b38-479c-8a0e-e5328c1236c3","Type":"ContainerDied","Data":"7d0f6cc738539c10206b3ae14ea2f6bde0037e2dd46a46ebd9dc0f32200bf0b8"}
Sep 11 17:44:58.892216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.892157    2584 scope.go:117] "RemoveContainer" containerID="305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800"
Sep 11 17:44:58.902076 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.902052    2584 scope.go:117] "RemoveContainer" containerID="ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf"
Sep 11 17:44:58.912930 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.912905    2584 scope.go:117] "RemoveContainer" containerID="305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800"
Sep 11 17:44:58.913278 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:58.913258    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800\": container with ID starting with 305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800 not found: ID does not exist" containerID="305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800"
Sep 11 17:44:58.913341 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.913289    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800"} err="failed to get container status \"305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800\": rpc error: code = NotFound desc = could not find container \"305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800\": container with ID starting with 305b016a2f8f1ac92e94547466d6668c0da0df5bf91a7a02adf0f2555f4e2800 not found: ID does not exist"
Sep 11 17:44:58.913341 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.913307    2584 scope.go:117] "RemoveContainer" containerID="ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf"
Sep 11 17:44:58.913646 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:44:58.913619    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf\": container with ID starting with ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf not found: ID does not exist" containerID="ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf"
Sep 11 17:44:58.913733 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.913654    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf"} err="failed to get container status \"ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf\": rpc error: code = NotFound desc = could not find container \"ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf\": container with ID starting with ac965d20ad5a19a854ddd927d18321e39c455bebd0f790a8cd203f3482731cdf not found: ID does not exist"
Sep 11 17:44:58.914860 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.914844    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-token\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.914929 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.914875    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rhr7z\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-kube-api-access-rhr7z\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.914929 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.914903    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-certs\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.915036 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.914933    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-socket\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.915036 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.914961    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istiod-ca-cert\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.915036 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.914994    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-envoy\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.915036 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915028    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-data\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.915208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915052    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-podinfo\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.915208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915155    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-credential-socket\") pod \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\" (UID: \"1f9f392d-6b38-479c-8a0e-e5328c1236c3\") "
Sep 11 17:44:58.915308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915270    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:44:58.915367 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915346    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-data" (OuterVolumeSpecName: "istio-data") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:44:58.915511 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915492    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:58.915567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915515    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-data\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:58.915567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915427    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:44:58.915567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915518    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:44:58.915719 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.915681    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:44:58.917189 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.917169    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-token" (OuterVolumeSpecName: "istio-token") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:44:58.917328 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.917303    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:44:58.917461 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.917352    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-kube-api-access-rhr7z" (OuterVolumeSpecName: "kube-api-access-rhr7z") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "kube-api-access-rhr7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:44:58.917461 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:58.917434    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1f9f392d-6b38-479c-8a0e-e5328c1236c3" (UID: "1f9f392d-6b38-479c-8a0e-e5328c1236c3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:44:59.016203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.016165    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:59.016203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.016193    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rhr7z\" (UniqueName: \"kubernetes.io/projected/1f9f392d-6b38-479c-8a0e-e5328c1236c3-kube-api-access-rhr7z\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:59.016203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.016205    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-workload-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:59.016203 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.016215    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istiod-ca-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:59.016622 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.016224    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-envoy\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:59.016622 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.016231    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1f9f392d-6b38-479c-8a0e-e5328c1236c3-istio-podinfo\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:59.016622 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.016239    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1f9f392d-6b38-479c-8a0e-e5328c1236c3-credential-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:44:59.217001 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.216971    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"]
Sep 11 17:44:59.219879 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.219855    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-w2-b6b979-openshift-default-86786d5f5d-mxcl4"]
Sep 11 17:44:59.705236 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:44:59.705198    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" path="/var/lib/kubelet/pods/1f9f392d-6b38-479c-8a0e-e5328c1236c3/volumes"
Sep 11 17:45:00.144844 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.144809    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv"]
Sep 11 17:45:00.145229 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145184    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" containerName="maas-api"
Sep 11 17:45:00.145229 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145195    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" containerName="maas-api"
Sep 11 17:45:00.145229 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145203    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4555783-5666-4848-b432-257b3b4b0695" containerName="test-curl-7729-bbb357"
Sep 11 17:45:00.145229 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145208    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4555783-5666-4848-b432-257b3b4b0695" containerName="test-curl-7729-bbb357"
Sep 11 17:45:00.145229 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145224    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="05e74885-444c-4737-8c8a-5fbdaf212dbe" containerName="payload-processing"
Sep 11 17:45:00.145229 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145230    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="05e74885-444c-4737-8c8a-5fbdaf212dbe" containerName="payload-processing"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145238    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145245    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145251    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145256    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145325    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4555783-5666-4848-b432-257b3b4b0695" containerName="test-curl-7729-bbb357"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145332    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="05e74885-444c-4737-8c8a-5fbdaf212dbe" containerName="payload-processing"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145338    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145344    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f9f392d-6b38-479c-8a0e-e5328c1236c3" containerName="istio-proxy"
Sep 11 17:45:00.145441 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.145350    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="8b7de54b-aadc-4dac-aed3-1527aa8aa0e7" containerName="maas-api"
Sep 11 17:45:00.149537 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.149513    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv"
Sep 11 17:45:00.152205 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.152170    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z84jg\""
Sep 11 17:45:00.159296 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.159266    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv"]
Sep 11 17:45:00.161050 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.161032    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv"
Sep 11 17:45:00.440944 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.440915    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv"]
Sep 11 17:45:00.444765 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:45:00.444727    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23b91172_97b1_49bf_90ba_c9f3aea75ba7.slice/crio-92ca463c46919f6170d597838c402fc2b76156c5d69d86a26c75d3f1612f7e99 WatchSource:0}: Error finding container 92ca463c46919f6170d597838c402fc2b76156c5d69d86a26c75d3f1612f7e99: Status 404 returned error can't find the container with id 92ca463c46919f6170d597838c402fc2b76156c5d69d86a26c75d3f1612f7e99
Sep 11 17:45:00.911218 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.911180    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv" event={"ID":"23b91172-97b1-49bf-90ba-c9f3aea75ba7","Type":"ContainerStarted","Data":"111457b5d8fad1efe64acb310c53e7248270f073b741b5978a91c85e7ebe98a6"}
Sep 11 17:45:00.911431 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.911263    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv" event={"ID":"23b91172-97b1-49bf-90ba-c9f3aea75ba7","Type":"ContainerStarted","Data":"92ca463c46919f6170d597838c402fc2b76156c5d69d86a26c75d3f1612f7e99"}
Sep 11 17:45:00.937373 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:00.937318    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv" podStartSLOduration=0.937303657 podStartE2EDuration="937.303657ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:00.937253141 +0000 UTC m=+1475.891943044" watchObservedRunningTime="2026-09-11 17:45:00.937303657 +0000 UTC m=+1475.891993581"
Sep 11 17:45:01.918912 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:01.918876    2584 generic.go:356] "Generic (PLEG): container finished" podID="23b91172-97b1-49bf-90ba-c9f3aea75ba7" containerID="111457b5d8fad1efe64acb310c53e7248270f073b741b5978a91c85e7ebe98a6" exitCode=0
Sep 11 17:45:01.919331 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:01.918953    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv" event={"ID":"23b91172-97b1-49bf-90ba-c9f3aea75ba7","Type":"ContainerDied","Data":"111457b5d8fad1efe64acb310c53e7248270f073b741b5978a91c85e7ebe98a6"}
Sep 11 17:45:03.045413 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:03.045376    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:45:03.063100 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:03.063077    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv"
Sep 11 17:45:03.931049 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:03.931015    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv"
Sep 11 17:45:03.931225 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:03.931042    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29819145-rxtnv" event={"ID":"23b91172-97b1-49bf-90ba-c9f3aea75ba7","Type":"ContainerDied","Data":"92ca463c46919f6170d597838c402fc2b76156c5d69d86a26c75d3f1612f7e99"}
Sep 11 17:45:03.931225 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:03.931098    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="92ca463c46919f6170d597838c402fc2b76156c5d69d86a26c75d3f1612f7e99"
Sep 11 17:45:10.458591 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:10.458557    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:45:25.645320 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:25.645289    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:45:25.648444 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:25.648423    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:45:26.838103 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:26.838061    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:45:36.925042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:36.925006    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:45:44.753492 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.753458    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"]
Sep 11 17:45:44.753884 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.753843    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23b91172-97b1-49bf-90ba-c9f3aea75ba7" containerName="cleanup"
Sep 11 17:45:44.753884 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.753855    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="23b91172-97b1-49bf-90ba-c9f3aea75ba7" containerName="cleanup"
Sep 11 17:45:44.753967 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.753916    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="23b91172-97b1-49bf-90ba-c9f3aea75ba7" containerName="cleanup"
Sep 11 17:45:44.757154 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.757135    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.761852 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.761831    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-d8a0d0-openshift-default-dockercfg-kkwzx\""
Sep 11 17:45:44.776709 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.776679    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"]
Sep 11 17:45:44.815126 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815092    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-credential-socket\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.815126 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815130    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-certs\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.815354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815152    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-data\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.815354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815212    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrkz\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-kube-api-access-pjrkz\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.815354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815249    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457ff3d-a973-4441-a862-51b389b59745-istiod-ca-cert\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.815354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815271    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-envoy\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.815354 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815291    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-socket\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.815565 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815374    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457ff3d-a973-4441-a862-51b389b59745-istio-podinfo\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.815565 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.815434    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-istio-token\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.916483 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916447    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-credential-socket\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.916483 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916486    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-certs\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.916756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916503    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-data\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.916756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916608    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrkz\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-kube-api-access-pjrkz\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.916756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916636    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457ff3d-a973-4441-a862-51b389b59745-istiod-ca-cert\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.916756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916655    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-envoy\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.916756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916673    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-socket\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.917027 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916794    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457ff3d-a973-4441-a862-51b389b59745-istio-podinfo\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.917027 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916849    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-istio-token\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.917027 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916953    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-credential-socket\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.917027 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.916993    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-socket\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.917212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.917048    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-data\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.917212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.917202    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-certs\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.917374 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.917356    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457ff3d-a973-4441-a862-51b389b59745-istiod-ca-cert\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.919004 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.918983    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-envoy\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.919247 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.919231    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457ff3d-a973-4441-a862-51b389b59745-istio-podinfo\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.925904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.925882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-istio-token\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:44.927971 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:44.927949    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrkz\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-kube-api-access-pjrkz\") pod \"e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") " pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:45.067502 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:45.067375    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:45.347627 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:45:45.347594    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4457ff3d_a973_4441_a862_51b389b59745.slice/crio-0275cbab21abcd93a8ca4b31f505ad96847556d6eaf745a1498cdea85293b8ff WatchSource:0}: Error finding container 0275cbab21abcd93a8ca4b31f505ad96847556d6eaf745a1498cdea85293b8ff: Status 404 returned error can't find the container with id 0275cbab21abcd93a8ca4b31f505ad96847556d6eaf745a1498cdea85293b8ff
Sep 11 17:45:45.347738 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:45.347689    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"]
Sep 11 17:45:45.350108 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:45.350053    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:45:45.350196 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:45.350117    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:45:45.350196 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:45.350164    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:45:46.176191 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:46.176152    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" event={"ID":"4457ff3d-a973-4441-a862-51b389b59745","Type":"ContainerStarted","Data":"af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8"}
Sep 11 17:45:46.176627 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:46.176223    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" event={"ID":"4457ff3d-a973-4441-a862-51b389b59745","Type":"ContainerStarted","Data":"0275cbab21abcd93a8ca4b31f505ad96847556d6eaf745a1498cdea85293b8ff"}
Sep 11 17:45:46.197219 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:46.197171    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" podStartSLOduration=2.197153706 podStartE2EDuration="2.197153706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:46.196042365 +0000 UTC m=+1521.150732266" watchObservedRunningTime="2026-09-11 17:45:46.197153706 +0000 UTC m=+1521.151843607"
Sep 11 17:45:47.067660 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:47.067618    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:47.073479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:47.073446    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:47.182362 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:47.182329    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:47.183269 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:47.183248    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:45:47.333094 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:47.333013    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:45:50.694363 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.694281    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"]
Sep 11 17:45:50.697849 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.697833    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:50.700427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.700387    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-d8a0d0-dockercfg-jp9sd\""
Sep 11 17:45:50.700427 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.700422    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-d8a0d0\""
Sep 11 17:45:50.708755 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.708731    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"]
Sep 11 17:45:50.733088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.733052    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"]
Sep 11 17:45:50.737118 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.737098    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:50.745330 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.745298    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"]
Sep 11 17:45:50.767579 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.767538    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b4pqq\" (UniqueName: \"kubernetes.io/projected/47854f0b-64c4-4f9f-86ef-a330eed16242-kube-api-access-b4pqq\") pod \"payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668\" (UID: \"47854f0b-64c4-4f9f-86ef-a330eed16242\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:50.767773 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.767597    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47854f0b-64c4-4f9f-86ef-a330eed16242-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668\" (UID: \"47854f0b-64c4-4f9f-86ef-a330eed16242\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:50.767773 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.767668    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-kube-api-access-4wvvj\") pod \"payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb\" (UID: \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:50.767773 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.767728    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb\" (UID: \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:50.868841 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.868792    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b4pqq\" (UniqueName: \"kubernetes.io/projected/47854f0b-64c4-4f9f-86ef-a330eed16242-kube-api-access-b4pqq\") pod \"payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668\" (UID: \"47854f0b-64c4-4f9f-86ef-a330eed16242\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:50.868841 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.868841    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47854f0b-64c4-4f9f-86ef-a330eed16242-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668\" (UID: \"47854f0b-64c4-4f9f-86ef-a330eed16242\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:50.869124 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.868906    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-kube-api-access-4wvvj\") pod \"payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb\" (UID: \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:50.869124 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.868964    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb\" (UID: \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:50.869702 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.869680    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47854f0b-64c4-4f9f-86ef-a330eed16242-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668\" (UID: \"47854f0b-64c4-4f9f-86ef-a330eed16242\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:50.869797 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.869708    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb\" (UID: \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:50.881910 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.881882    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-kube-api-access-4wvvj\") pod \"payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb\" (UID: \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:50.883616 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:50.883592    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b4pqq\" (UniqueName: \"kubernetes.io/projected/47854f0b-64c4-4f9f-86ef-a330eed16242-kube-api-access-b4pqq\") pod \"payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668\" (UID: \"47854f0b-64c4-4f9f-86ef-a330eed16242\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:51.009759 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:51.009678    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:51.049134 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:51.049099    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:51.285672 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:51.285643    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"]
Sep 11 17:45:51.285769 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:45:51.285728    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod654cdbda_b7f3_49b0_bd1e_d1972aa4ee01.slice/crio-bfdd2399b7338e4e91ed1535dca2b44459aab55b3cd63bc54903d1bd49ed6f74 WatchSource:0}: Error finding container bfdd2399b7338e4e91ed1535dca2b44459aab55b3cd63bc54903d1bd49ed6f74: Status 404 returned error can't find the container with id bfdd2399b7338e4e91ed1535dca2b44459aab55b3cd63bc54903d1bd49ed6f74
Sep 11 17:45:51.347731 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:51.347700    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"]
Sep 11 17:45:51.348881 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:45:51.348841    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod47854f0b_64c4_4f9f_86ef_a330eed16242.slice/crio-5b47827caf14ce71978eef373145bf84a168fa31ee0dd3f0004de3579d885358 WatchSource:0}: Error finding container 5b47827caf14ce71978eef373145bf84a168fa31ee0dd3f0004de3579d885358: Status 404 returned error can't find the container with id 5b47827caf14ce71978eef373145bf84a168fa31ee0dd3f0004de3579d885358
Sep 11 17:45:52.214032 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:52.213993    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb" event={"ID":"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01","Type":"ContainerStarted","Data":"bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09"}
Sep 11 17:45:52.214548 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:52.214058    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb" event={"ID":"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01","Type":"ContainerStarted","Data":"bfdd2399b7338e4e91ed1535dca2b44459aab55b3cd63bc54903d1bd49ed6f74"}
Sep 11 17:45:52.214548 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:52.214104    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:45:52.215914 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:52.215883    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668" event={"ID":"47854f0b-64c4-4f9f-86ef-a330eed16242","Type":"ContainerStarted","Data":"6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e"}
Sep 11 17:45:52.216039 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:52.215942    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:45:52.216039 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:52.215962    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668" event={"ID":"47854f0b-64c4-4f9f-86ef-a330eed16242","Type":"ContainerStarted","Data":"5b47827caf14ce71978eef373145bf84a168fa31ee0dd3f0004de3579d885358"}
Sep 11 17:45:52.240340 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:52.240285    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb" podStartSLOduration=2.240266437 podStartE2EDuration="2.240266437s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:52.238071193 +0000 UTC m=+1527.192761094" watchObservedRunningTime="2026-09-11 17:45:52.240266437 +0000 UTC m=+1527.194956340"
Sep 11 17:45:52.262881 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:45:52.262819    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668" podStartSLOduration=2.262802822 podStartE2EDuration="2.262802822s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:45:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:45:52.259989926 +0000 UTC m=+1527.214679828" watchObservedRunningTime="2026-09-11 17:45:52.262802822 +0000 UTC m=+1527.217492724"
Sep 11 17:46:02.137000 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:02.136969    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:46:03.223561 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:03.223526    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 11 17:46:03.223986 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:03.223594    2584 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 11 17:46:03.224627 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:03.224595    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:46:03.224734 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:03.224675    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:46:05.294370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:05.294337    2584 generic.go:356] "Generic (PLEG): container finished" podID="4457ff3d-a973-4441-a862-51b389b59745" containerID="af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8" exitCode=0
Sep 11 17:46:05.295162 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:05.294388    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" event={"ID":"4457ff3d-a973-4441-a862-51b389b59745","Type":"ContainerDied","Data":"af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8"}
Sep 11 17:46:05.295162 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:05.294836    2584 scope.go:117] "RemoveContainer" containerID="af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8"
Sep 11 17:46:05.295891 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:05.295863    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:46:05.295943 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:05.295930    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:46:05.295983 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:05.295962    2584 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 11 17:46:06.302028 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:06.301993    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" event={"ID":"4457ff3d-a973-4441-a862-51b389b59745","Type":"ContainerStarted","Data":"3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2"}
Sep 11 17:46:07.067918 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:07.067871    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:46:07.068179 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:07.068135    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 11 17:46:07.068259 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:07.068217    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 11 17:46:08.068537 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:08.068490    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 11 17:46:08.069065 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:08.068564    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 11 17:46:09.068012 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:09.067960    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 11 17:46:09.068234 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:09.068053    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 11 17:46:10.068131 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:10.068090    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 11 17:46:10.068679 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:10.068164    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 11 17:46:11.067778 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:11.067740    2584 patch_prober.go:28] interesting pod/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body=
Sep 11 17:46:11.068059 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:11.068030    2584 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused"
Sep 11 17:46:12.071106 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:12.071071    2584 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:46:12.071492 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:12.071445    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:46:12.072181 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:12.072165    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:46:21.273747 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.273709    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"]
Sep 11 17:46:21.277533 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.277513    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:21.280666 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.280642    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-1d492f-dockercfg-47pvc\""
Sep 11 17:46:21.282685 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.282668    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-1d492f\""
Sep 11 17:46:21.289178 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.289158    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"]
Sep 11 17:46:21.292622 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.292596    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:21.293581 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.293557    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"]
Sep 11 17:46:21.311037 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.311010    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"]
Sep 11 17:46:21.355662 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.355626    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08808d92-4b07-4d0b-bfca-e9a689f609cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt\" (UID: \"08808d92-4b07-4d0b-bfca-e9a689f609cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:21.355662 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.355672    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47rd5\" (UniqueName: \"kubernetes.io/projected/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-kube-api-access-47rd5\") pod \"payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg\" (UID: \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:21.355883 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.355793    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvht4\" (UniqueName: \"kubernetes.io/projected/08808d92-4b07-4d0b-bfca-e9a689f609cc-kube-api-access-kvht4\") pod \"payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt\" (UID: \"08808d92-4b07-4d0b-bfca-e9a689f609cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:21.355883 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.355855    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg\" (UID: \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:21.456648 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.456592    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg\" (UID: \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:21.456831 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.456689    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08808d92-4b07-4d0b-bfca-e9a689f609cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt\" (UID: \"08808d92-4b07-4d0b-bfca-e9a689f609cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:21.456831 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.456706    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47rd5\" (UniqueName: \"kubernetes.io/projected/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-kube-api-access-47rd5\") pod \"payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg\" (UID: \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:21.456831 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.456756    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvht4\" (UniqueName: \"kubernetes.io/projected/08808d92-4b07-4d0b-bfca-e9a689f609cc-kube-api-access-kvht4\") pod \"payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt\" (UID: \"08808d92-4b07-4d0b-bfca-e9a689f609cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:21.457305 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.457284    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg\" (UID: \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:21.457379 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.457364    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08808d92-4b07-4d0b-bfca-e9a689f609cc-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt\" (UID: \"08808d92-4b07-4d0b-bfca-e9a689f609cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:21.470208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.470170    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-47rd5\" (UniqueName: \"kubernetes.io/projected/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-kube-api-access-47rd5\") pod \"payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg\" (UID: \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:21.470419 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.470381    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvht4\" (UniqueName: \"kubernetes.io/projected/08808d92-4b07-4d0b-bfca-e9a689f609cc-kube-api-access-kvht4\") pod \"payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt\" (UID: \"08808d92-4b07-4d0b-bfca-e9a689f609cc\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:21.589654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.589555    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:21.602547 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.602519    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:21.864932 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.864904    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"]
Sep 11 17:46:21.866609 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:46:21.866582    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08808d92_4b07_4d0b_bfca_e9a689f609cc.slice/crio-6d381e4649462548c45a29c61fbffa227dd4cfbb3ca412d2a8f8813cbf3a4da3 WatchSource:0}: Error finding container 6d381e4649462548c45a29c61fbffa227dd4cfbb3ca412d2a8f8813cbf3a4da3: Status 404 returned error can't find the container with id 6d381e4649462548c45a29c61fbffa227dd4cfbb3ca412d2a8f8813cbf3a4da3
Sep 11 17:46:21.886292 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:21.886265    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"]
Sep 11 17:46:21.888075 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:46:21.888050    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda95ba511_1801_4d5f_9f33_7cd0fe5b9f96.slice/crio-5daa1c5ac487de39bca032c94c6aececbb6c0e36a95877d3b0493a203e2a0e35 WatchSource:0}: Error finding container 5daa1c5ac487de39bca032c94c6aececbb6c0e36a95877d3b0493a203e2a0e35: Status 404 returned error can't find the container with id 5daa1c5ac487de39bca032c94c6aececbb6c0e36a95877d3b0493a203e2a0e35
Sep 11 17:46:22.400376 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:22.400331    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg" event={"ID":"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96","Type":"ContainerStarted","Data":"f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0"}
Sep 11 17:46:22.400895 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:22.400476    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg" event={"ID":"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96","Type":"ContainerStarted","Data":"5daa1c5ac487de39bca032c94c6aececbb6c0e36a95877d3b0493a203e2a0e35"}
Sep 11 17:46:22.400895 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:22.400571    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:22.402032 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:22.402006    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt" event={"ID":"08808d92-4b07-4d0b-bfca-e9a689f609cc","Type":"ContainerStarted","Data":"6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d"}
Sep 11 17:46:22.402162 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:22.402044    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt" event={"ID":"08808d92-4b07-4d0b-bfca-e9a689f609cc","Type":"ContainerStarted","Data":"6d381e4649462548c45a29c61fbffa227dd4cfbb3ca412d2a8f8813cbf3a4da3"}
Sep 11 17:46:22.402235 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:22.402173    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:22.421624 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:22.421581    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg" podStartSLOduration=1.421566932 podStartE2EDuration="1.421566932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:22.419839844 +0000 UTC m=+1557.374529748" watchObservedRunningTime="2026-09-11 17:46:22.421566932 +0000 UTC m=+1557.376256863"
Sep 11 17:46:22.439009 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:22.438963    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt" podStartSLOduration=1.438949749 podStartE2EDuration="1.438949749s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:46:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:46:22.437970902 +0000 UTC m=+1557.392660809" watchObservedRunningTime="2026-09-11 17:46:22.438949749 +0000 UTC m=+1557.393639665"
Sep 11 17:46:24.934561 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:24.934521    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:46:33.410587 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:33.410554    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:46:33.411070 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:33.410624    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:46:47.749445 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:47.749393    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg_a95ba511-1801-4d5f-9f33-7cd0fe5b9f96/payload-processing/0.log"
Sep 11 17:46:53.938087 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:46:53.938054    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:47:22.137739 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:22.137704    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:47:28.531478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:28.531445    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb_654cdbda-b7f3-49b0-bd1e-d1972aa4ee01/payload-processing/0.log"
Sep 11 17:47:28.772020 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:28.771989    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg_a95ba511-1801-4d5f-9f33-7cd0fe5b9f96/payload-processing/0.log"
Sep 11 17:47:37.228159 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.228123    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"]
Sep 11 17:47:37.231749 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.231732    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:37.234346 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.234321    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-877b01\""
Sep 11 17:47:37.234536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.234427    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-877b01-dockercfg-vgtww\""
Sep 11 17:47:37.243548 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.243522    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"]
Sep 11 17:47:37.312632 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.312590    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-br5r2\" (UniqueName: \"kubernetes.io/projected/91e87971-c962-4ad1-9378-9102f70d4392-kube-api-access-br5r2\") pod \"payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979\" (UID: \"91e87971-c962-4ad1-9378-9102f70d4392\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:37.312823 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.312677    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e87971-c962-4ad1-9378-9102f70d4392-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979\" (UID: \"91e87971-c962-4ad1-9378-9102f70d4392\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:37.413777 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.413735    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e87971-c962-4ad1-9378-9102f70d4392-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979\" (UID: \"91e87971-c962-4ad1-9378-9102f70d4392\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:37.413963 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.413811    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-br5r2\" (UniqueName: \"kubernetes.io/projected/91e87971-c962-4ad1-9378-9102f70d4392-kube-api-access-br5r2\") pod \"payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979\" (UID: \"91e87971-c962-4ad1-9378-9102f70d4392\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:37.414485 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.414467    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e87971-c962-4ad1-9378-9102f70d4392-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979\" (UID: \"91e87971-c962-4ad1-9378-9102f70d4392\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:37.422746 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.422712    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-br5r2\" (UniqueName: \"kubernetes.io/projected/91e87971-c962-4ad1-9378-9102f70d4392-kube-api-access-br5r2\") pod \"payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979\" (UID: \"91e87971-c962-4ad1-9378-9102f70d4392\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:37.541651 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.541564    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:37.818345 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.818321    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"]
Sep 11 17:47:37.820208 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:47:37.820183    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod91e87971_c962_4ad1_9378_9102f70d4392.slice/crio-21e840c8103ac3c2dcc1a86507993f544ecc7c4ef08fbe99b8140e6030ee14ac WatchSource:0}: Error finding container 21e840c8103ac3c2dcc1a86507993f544ecc7c4ef08fbe99b8140e6030ee14ac: Status 404 returned error can't find the container with id 21e840c8103ac3c2dcc1a86507993f544ecc7c4ef08fbe99b8140e6030ee14ac
Sep 11 17:47:37.867526 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:37.867489    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979" event={"ID":"91e87971-c962-4ad1-9378-9102f70d4392","Type":"ContainerStarted","Data":"21e840c8103ac3c2dcc1a86507993f544ecc7c4ef08fbe99b8140e6030ee14ac"}
Sep 11 17:47:38.877273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:38.877228    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979" event={"ID":"91e87971-c962-4ad1-9378-9102f70d4392","Type":"ContainerStarted","Data":"ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51"}
Sep 11 17:47:38.877683 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:38.877341    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:47:38.904372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:38.904317    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979" podStartSLOduration=1.9042987 podStartE2EDuration="1.9042987s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:47:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:47:38.903878711 +0000 UTC m=+1633.858568616" watchObservedRunningTime="2026-09-11 17:47:38.9042987 +0000 UTC m=+1633.858988602"
Sep 11 17:47:43.446956 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:43.446923    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:47:49.886160 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:47:49.886130    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:48:14.700806 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:14.700769    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"]
Sep 11 17:48:14.701271 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:14.701013    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979" podUID="91e87971-c962-4ad1-9378-9102f70d4392" containerName="payload-processing" containerID="cri-o://ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51" gracePeriod=30
Sep 11 17:48:14.955043 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:14.954961    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:48:15.069870 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.069831    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e87971-c962-4ad1-9378-9102f70d4392-plugins-config-volume\") pod \"91e87971-c962-4ad1-9378-9102f70d4392\" (UID: \"91e87971-c962-4ad1-9378-9102f70d4392\") "
Sep 11 17:48:15.070054 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.069885    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-br5r2\" (UniqueName: \"kubernetes.io/projected/91e87971-c962-4ad1-9378-9102f70d4392-kube-api-access-br5r2\") pod \"91e87971-c962-4ad1-9378-9102f70d4392\" (UID: \"91e87971-c962-4ad1-9378-9102f70d4392\") "
Sep 11 17:48:15.070318 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.070292    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/91e87971-c962-4ad1-9378-9102f70d4392-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "91e87971-c962-4ad1-9378-9102f70d4392" (UID: "91e87971-c962-4ad1-9378-9102f70d4392"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:48:15.072104 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.072078    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/91e87971-c962-4ad1-9378-9102f70d4392-kube-api-access-br5r2" (OuterVolumeSpecName: "kube-api-access-br5r2") pod "91e87971-c962-4ad1-9378-9102f70d4392" (UID: "91e87971-c962-4ad1-9378-9102f70d4392"). InnerVolumeSpecName "kube-api-access-br5r2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:48:15.089272 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.089245    2584 generic.go:356] "Generic (PLEG): container finished" podID="91e87971-c962-4ad1-9378-9102f70d4392" containerID="ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51" exitCode=0
Sep 11 17:48:15.089431 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.089285    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979" event={"ID":"91e87971-c962-4ad1-9378-9102f70d4392","Type":"ContainerDied","Data":"ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51"}
Sep 11 17:48:15.089431 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.089288    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"
Sep 11 17:48:15.089431 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.089327    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979" event={"ID":"91e87971-c962-4ad1-9378-9102f70d4392","Type":"ContainerDied","Data":"21e840c8103ac3c2dcc1a86507993f544ecc7c4ef08fbe99b8140e6030ee14ac"}
Sep 11 17:48:15.089431 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.089348    2584 scope.go:117] "RemoveContainer" containerID="ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51"
Sep 11 17:48:15.098741 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.098722    2584 scope.go:117] "RemoveContainer" containerID="ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51"
Sep 11 17:48:15.099024 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:48:15.099003    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51\": container with ID starting with ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51 not found: ID does not exist" containerID="ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51"
Sep 11 17:48:15.099083 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.099038    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51"} err="failed to get container status \"ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51\": rpc error: code = NotFound desc = could not find container \"ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51\": container with ID starting with ece75117bf5e5368f6d0ccafb1aa61d1cf9cce612ff9cec1f3cefe500992eb51 not found: ID does not exist"
Sep 11 17:48:15.115648 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.115620    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"]
Sep 11 17:48:15.119852 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.119822    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-877b01-695b94f4c7-vv979"]
Sep 11 17:48:15.171290 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.171261    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/91e87971-c962-4ad1-9378-9102f70d4392-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:48:15.171290 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.171286    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-br5r2\" (UniqueName: \"kubernetes.io/projected/91e87971-c962-4ad1-9378-9102f70d4392-kube-api-access-br5r2\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:48:15.705815 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:15.705780    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="91e87971-c962-4ad1-9378-9102f70d4392" path="/var/lib/kubelet/pods/91e87971-c962-4ad1-9378-9102f70d4392/volumes"
Sep 11 17:48:18.936201 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:18.936170    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:48:38.640026 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:38.639992    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:48:41.345646 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.345604    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"]
Sep 11 17:48:41.346091 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.345867    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb" podUID="654cdbda-b7f3-49b0-bd1e-d1972aa4ee01" containerName="payload-processing" containerID="cri-o://bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09" gracePeriod=30
Sep 11 17:48:41.350488 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.350461    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"]
Sep 11 17:48:41.350690 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.350664    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668" podUID="47854f0b-64c4-4f9f-86ef-a330eed16242" containerName="payload-pre-processing" containerID="cri-o://6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e" gracePeriod=30
Sep 11 17:48:41.630943 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.630918    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:48:41.633579 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.633560    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:48:41.710371 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.710337    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47854f0b-64c4-4f9f-86ef-a330eed16242-plugins-config-volume\") pod \"47854f0b-64c4-4f9f-86ef-a330eed16242\" (UID: \"47854f0b-64c4-4f9f-86ef-a330eed16242\") "
Sep 11 17:48:41.710577 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.710552    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-kube-api-access-4wvvj\") pod \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\" (UID: \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\") "
Sep 11 17:48:41.710659 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.710630    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-plugins-config-volume\") pod \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\" (UID: \"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01\") "
Sep 11 17:48:41.710721 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.710662    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b4pqq\" (UniqueName: \"kubernetes.io/projected/47854f0b-64c4-4f9f-86ef-a330eed16242-kube-api-access-b4pqq\") pod \"47854f0b-64c4-4f9f-86ef-a330eed16242\" (UID: \"47854f0b-64c4-4f9f-86ef-a330eed16242\") "
Sep 11 17:48:41.710984 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.710949    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/47854f0b-64c4-4f9f-86ef-a330eed16242-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "47854f0b-64c4-4f9f-86ef-a330eed16242" (UID: "47854f0b-64c4-4f9f-86ef-a330eed16242"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:48:41.711102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.711041    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "654cdbda-b7f3-49b0-bd1e-d1972aa4ee01" (UID: "654cdbda-b7f3-49b0-bd1e-d1972aa4ee01"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:48:41.712887 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.712861    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/47854f0b-64c4-4f9f-86ef-a330eed16242-kube-api-access-b4pqq" (OuterVolumeSpecName: "kube-api-access-b4pqq") pod "47854f0b-64c4-4f9f-86ef-a330eed16242" (UID: "47854f0b-64c4-4f9f-86ef-a330eed16242"). InnerVolumeSpecName "kube-api-access-b4pqq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:48:41.713146 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.713126    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-kube-api-access-4wvvj" (OuterVolumeSpecName: "kube-api-access-4wvvj") pod "654cdbda-b7f3-49b0-bd1e-d1972aa4ee01" (UID: "654cdbda-b7f3-49b0-bd1e-d1972aa4ee01"). InnerVolumeSpecName "kube-api-access-4wvvj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:48:41.811901 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.811865    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4wvvj\" (UniqueName: \"kubernetes.io/projected/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-kube-api-access-4wvvj\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:48:41.811901 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.811896    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:48:41.811901 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.811905    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b4pqq\" (UniqueName: \"kubernetes.io/projected/47854f0b-64c4-4f9f-86ef-a330eed16242-kube-api-access-b4pqq\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:48:41.812143 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:41.811916    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/47854f0b-64c4-4f9f-86ef-a330eed16242-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:48:42.250919 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.250883    2584 generic.go:356] "Generic (PLEG): container finished" podID="47854f0b-64c4-4f9f-86ef-a330eed16242" containerID="6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e" exitCode=0
Sep 11 17:48:42.251120 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.250927    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"
Sep 11 17:48:42.251120 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.250964    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668" event={"ID":"47854f0b-64c4-4f9f-86ef-a330eed16242","Type":"ContainerDied","Data":"6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e"}
Sep 11 17:48:42.251120 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.251023    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668" event={"ID":"47854f0b-64c4-4f9f-86ef-a330eed16242","Type":"ContainerDied","Data":"5b47827caf14ce71978eef373145bf84a168fa31ee0dd3f0004de3579d885358"}
Sep 11 17:48:42.251120 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.251052    2584 scope.go:117] "RemoveContainer" containerID="6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e"
Sep 11 17:48:42.252392 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.252369    2584 generic.go:356] "Generic (PLEG): container finished" podID="654cdbda-b7f3-49b0-bd1e-d1972aa4ee01" containerID="bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09" exitCode=0
Sep 11 17:48:42.252485 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.252426    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"
Sep 11 17:48:42.252485 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.252454    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb" event={"ID":"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01","Type":"ContainerDied","Data":"bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09"}
Sep 11 17:48:42.252589 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.252504    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb" event={"ID":"654cdbda-b7f3-49b0-bd1e-d1972aa4ee01","Type":"ContainerDied","Data":"bfdd2399b7338e4e91ed1535dca2b44459aab55b3cd63bc54903d1bd49ed6f74"}
Sep 11 17:48:42.260852 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.260835    2584 scope.go:117] "RemoveContainer" containerID="6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e"
Sep 11 17:48:42.261151 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:48:42.261124    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e\": container with ID starting with 6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e not found: ID does not exist" containerID="6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e"
Sep 11 17:48:42.261260 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.261159    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e"} err="failed to get container status \"6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e\": rpc error: code = NotFound desc = could not find container \"6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e\": container with ID starting with 6365ff5488cdc583132d9edcd345ab13a502335401b773516a0432056562e62e not found: ID does not exist"
Sep 11 17:48:42.261260 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.261176    2584 scope.go:117] "RemoveContainer" containerID="bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09"
Sep 11 17:48:42.270255 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.270237    2584 scope.go:117] "RemoveContainer" containerID="bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09"
Sep 11 17:48:42.270619 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:48:42.270599    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09\": container with ID starting with bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09 not found: ID does not exist" containerID="bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09"
Sep 11 17:48:42.270697 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.270626    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09"} err="failed to get container status \"bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09\": rpc error: code = NotFound desc = could not find container \"bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09\": container with ID starting with bb31a739909c364f272b463c99d113dbdbfa16a271912d2d1dd4012383b5ef09 not found: ID does not exist"
Sep 11 17:48:42.298847 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.298814    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"]
Sep 11 17:48:42.314204 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.314169    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-d8a0d0-974c68d9d-5l668"]
Sep 11 17:48:42.337834 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.337798    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"]
Sep 11 17:48:42.352906 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:42.352876    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-d8a0d0-57949b5ff5-t4gqb"]
Sep 11 17:48:43.705532 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:43.705501    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="47854f0b-64c4-4f9f-86ef-a330eed16242" path="/var/lib/kubelet/pods/47854f0b-64c4-4f9f-86ef-a330eed16242/volumes"
Sep 11 17:48:43.705905 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:43.705854    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="654cdbda-b7f3-49b0-bd1e-d1972aa4ee01" path="/var/lib/kubelet/pods/654cdbda-b7f3-49b0-bd1e-d1972aa4ee01/volumes"
Sep 11 17:48:52.241573 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:48:52.241494    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:49:25.816379 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:25.816348    2584 scope.go:117] "RemoveContainer" containerID="14e929d3e92231054608660bacc9235876b169f44395c9e7a081f2e957c51af2"
Sep 11 17:49:30.543898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:30.543864    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"]
Sep 11 17:49:30.544388 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:30.544064    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy" containerID="cri-o://3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2" gracePeriod=30
Sep 11 17:49:35.800803 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.800779    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:49:35.897864 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.897837    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-envoy\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.897881    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-istio-token\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.897917    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pjrkz\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-kube-api-access-pjrkz\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.897934    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-socket\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.897953    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-credential-socket\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.897980    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-data\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898010    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457ff3d-a973-4441-a862-51b389b59745-istio-podinfo\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898039    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-certs\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898067    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457ff3d-a973-4441-a862-51b389b59745-istiod-ca-cert\") pod \"4457ff3d-a973-4441-a862-51b389b59745\" (UID: \"4457ff3d-a973-4441-a862-51b389b59745\") "
Sep 11 17:49:35.898355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898265    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:49:35.898355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898281    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:49:35.898355 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898305    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-data" (OuterVolumeSpecName: "istio-data") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:49:35.898614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898466    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:35.898614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898491    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-credential-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:35.898614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898506    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-data\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:35.898614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898511    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:49:35.898777 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.898728    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4457ff3d-a973-4441-a862-51b389b59745-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:49:35.900233 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.900210    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-kube-api-access-pjrkz" (OuterVolumeSpecName: "kube-api-access-pjrkz") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "kube-api-access-pjrkz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:49:35.900341 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.900324    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4457ff3d-a973-4441-a862-51b389b59745-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:49:35.900532 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.900513    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:49:35.900617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.900526    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-istio-token" (OuterVolumeSpecName: "istio-token") pod "4457ff3d-a973-4441-a862-51b389b59745" (UID: "4457ff3d-a973-4441-a862-51b389b59745"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:49:35.999540 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.999501    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-istio-envoy\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:35.999540 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.999535    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:35.999540 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.999545    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pjrkz\" (UniqueName: \"kubernetes.io/projected/4457ff3d-a973-4441-a862-51b389b59745-kube-api-access-pjrkz\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:35.999785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.999555    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4457ff3d-a973-4441-a862-51b389b59745-istio-podinfo\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:35.999785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.999564    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4457ff3d-a973-4441-a862-51b389b59745-workload-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:35.999785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:35.999572    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4457ff3d-a973-4441-a862-51b389b59745-istiod-ca-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:36.571046 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.571008    2584 generic.go:356] "Generic (PLEG): container finished" podID="4457ff3d-a973-4441-a862-51b389b59745" containerID="3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2" exitCode=0
Sep 11 17:49:36.571224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.571060    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"
Sep 11 17:49:36.571224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.571102    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" event={"ID":"4457ff3d-a973-4441-a862-51b389b59745","Type":"ContainerDied","Data":"3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2"}
Sep 11 17:49:36.571224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.571159    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm" event={"ID":"4457ff3d-a973-4441-a862-51b389b59745","Type":"ContainerDied","Data":"0275cbab21abcd93a8ca4b31f505ad96847556d6eaf745a1498cdea85293b8ff"}
Sep 11 17:49:36.571224 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.571189    2584 scope.go:117] "RemoveContainer" containerID="3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2"
Sep 11 17:49:36.580987 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.580970    2584 scope.go:117] "RemoveContainer" containerID="af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8"
Sep 11 17:49:36.589241 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.589218    2584 scope.go:117] "RemoveContainer" containerID="3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2"
Sep 11 17:49:36.589574 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:49:36.589549    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2\": container with ID starting with 3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2 not found: ID does not exist" containerID="3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2"
Sep 11 17:49:36.589668 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.589585    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2"} err="failed to get container status \"3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2\": rpc error: code = NotFound desc = could not find container \"3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2\": container with ID starting with 3e036971e56795b6c37c6c53286268ef35ed367d5224a522975a18a912bb5ff2 not found: ID does not exist"
Sep 11 17:49:36.589668 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.589603    2584 scope.go:117] "RemoveContainer" containerID="af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8"
Sep 11 17:49:36.589843 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:49:36.589823    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8\": container with ID starting with af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8 not found: ID does not exist" containerID="af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8"
Sep 11 17:49:36.589898 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.589852    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8"} err="failed to get container status \"af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8\": rpc error: code = NotFound desc = could not find container \"af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8\": container with ID starting with af7dc0e78985e2cca6161e52cf0835dce06c283bead95389da9af8df450c9bc8 not found: ID does not exist"
Sep 11 17:49:36.594891 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.594869    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"]
Sep 11 17:49:36.599019 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:36.598999    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-d8a0d0-openshift-default-7c4d57f7cb-82tfm"]
Sep 11 17:49:37.705801 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:37.705765    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4457ff3d-a973-4441-a862-51b389b59745" path="/var/lib/kubelet/pods/4457ff3d-a973-4441-a862-51b389b59745/volumes"
Sep 11 17:49:41.785369 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:41.785334    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"]
Sep 11 17:49:41.785979 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:41.785576    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg" podUID="a95ba511-1801-4d5f-9f33-7cd0fe5b9f96" containerName="payload-processing" containerID="cri-o://f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0" gracePeriod=30
Sep 11 17:49:41.796010 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:41.795980    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"]
Sep 11 17:49:41.796525 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:41.796471    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt" podUID="08808d92-4b07-4d0b-bfca-e9a689f609cc" containerName="payload-pre-processing" containerID="cri-o://6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d" gracePeriod=30
Sep 11 17:49:42.050337 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.050261    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:49:42.079094 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.079067    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:49:42.152975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.152938    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-plugins-config-volume\") pod \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\" (UID: \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\") "
Sep 11 17:49:42.153173 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.152986    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-47rd5\" (UniqueName: \"kubernetes.io/projected/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-kube-api-access-47rd5\") pod \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\" (UID: \"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96\") "
Sep 11 17:49:42.153173 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.153024    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08808d92-4b07-4d0b-bfca-e9a689f609cc-plugins-config-volume\") pod \"08808d92-4b07-4d0b-bfca-e9a689f609cc\" (UID: \"08808d92-4b07-4d0b-bfca-e9a689f609cc\") "
Sep 11 17:49:42.153173 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.153047    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kvht4\" (UniqueName: \"kubernetes.io/projected/08808d92-4b07-4d0b-bfca-e9a689f609cc-kube-api-access-kvht4\") pod \"08808d92-4b07-4d0b-bfca-e9a689f609cc\" (UID: \"08808d92-4b07-4d0b-bfca-e9a689f609cc\") "
Sep 11 17:49:42.153372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.153350    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "a95ba511-1801-4d5f-9f33-7cd0fe5b9f96" (UID: "a95ba511-1801-4d5f-9f33-7cd0fe5b9f96"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:49:42.153680 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.153658    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/08808d92-4b07-4d0b-bfca-e9a689f609cc-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "08808d92-4b07-4d0b-bfca-e9a689f609cc" (UID: "08808d92-4b07-4d0b-bfca-e9a689f609cc"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:49:42.155050 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.155030    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-kube-api-access-47rd5" (OuterVolumeSpecName: "kube-api-access-47rd5") pod "a95ba511-1801-4d5f-9f33-7cd0fe5b9f96" (UID: "a95ba511-1801-4d5f-9f33-7cd0fe5b9f96"). InnerVolumeSpecName "kube-api-access-47rd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:49:42.155153 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.155130    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/08808d92-4b07-4d0b-bfca-e9a689f609cc-kube-api-access-kvht4" (OuterVolumeSpecName: "kube-api-access-kvht4") pod "08808d92-4b07-4d0b-bfca-e9a689f609cc" (UID: "08808d92-4b07-4d0b-bfca-e9a689f609cc"). InnerVolumeSpecName "kube-api-access-kvht4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:49:42.253975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.253935    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:42.253975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.253968    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-47rd5\" (UniqueName: \"kubernetes.io/projected/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96-kube-api-access-47rd5\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:42.253975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.253978    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/08808d92-4b07-4d0b-bfca-e9a689f609cc-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:42.253975 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.253987    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kvht4\" (UniqueName: \"kubernetes.io/projected/08808d92-4b07-4d0b-bfca-e9a689f609cc-kube-api-access-kvht4\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:49:42.606878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.606839    2584 generic.go:356] "Generic (PLEG): container finished" podID="a95ba511-1801-4d5f-9f33-7cd0fe5b9f96" containerID="f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0" exitCode=0
Sep 11 17:49:42.607088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.606891    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"
Sep 11 17:49:42.607088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.606930    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg" event={"ID":"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96","Type":"ContainerDied","Data":"f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0"}
Sep 11 17:49:42.607088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.606992    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg" event={"ID":"a95ba511-1801-4d5f-9f33-7cd0fe5b9f96","Type":"ContainerDied","Data":"5daa1c5ac487de39bca032c94c6aececbb6c0e36a95877d3b0493a203e2a0e35"}
Sep 11 17:49:42.607088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.607023    2584 scope.go:117] "RemoveContainer" containerID="f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0"
Sep 11 17:49:42.608300 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.608268    2584 generic.go:356] "Generic (PLEG): container finished" podID="08808d92-4b07-4d0b-bfca-e9a689f609cc" containerID="6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d" exitCode=0
Sep 11 17:49:42.608425 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.608298    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt" event={"ID":"08808d92-4b07-4d0b-bfca-e9a689f609cc","Type":"ContainerDied","Data":"6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d"}
Sep 11 17:49:42.608425 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.608328    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"
Sep 11 17:49:42.608425 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.608350    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt" event={"ID":"08808d92-4b07-4d0b-bfca-e9a689f609cc","Type":"ContainerDied","Data":"6d381e4649462548c45a29c61fbffa227dd4cfbb3ca412d2a8f8813cbf3a4da3"}
Sep 11 17:49:42.617635 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.617617    2584 scope.go:117] "RemoveContainer" containerID="f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0"
Sep 11 17:49:42.618002 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:49:42.617978    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0\": container with ID starting with f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0 not found: ID does not exist" containerID="f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0"
Sep 11 17:49:42.618096 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.618011    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0"} err="failed to get container status \"f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0\": rpc error: code = NotFound desc = could not find container \"f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0\": container with ID starting with f43afe3c27c837ed5b685ebc73209ef9e8b1e477d02bb09bff233d51a8a10fd0 not found: ID does not exist"
Sep 11 17:49:42.618096 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.618038    2584 scope.go:117] "RemoveContainer" containerID="6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d"
Sep 11 17:49:42.626247 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.626227    2584 scope.go:117] "RemoveContainer" containerID="6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d"
Sep 11 17:49:42.626535 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:49:42.626515    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d\": container with ID starting with 6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d not found: ID does not exist" containerID="6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d"
Sep 11 17:49:42.626596 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.626542    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d"} err="failed to get container status \"6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d\": rpc error: code = NotFound desc = could not find container \"6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d\": container with ID starting with 6a128e661189015c94de05512bed0d9608563902423ad11fa25a6e1643d21a0d not found: ID does not exist"
Sep 11 17:49:42.660785 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.660752    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"]
Sep 11 17:49:42.668492 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.668465    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-1d492f-764d8449b7-6qzvg"]
Sep 11 17:49:42.684049 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.684020    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"]
Sep 11 17:49:42.689700 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:42.689672    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-1d492f-b987d894-pmhwt"]
Sep 11 17:49:43.705686 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:43.705652    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="08808d92-4b07-4d0b-bfca-e9a689f609cc" path="/var/lib/kubelet/pods/08808d92-4b07-4d0b-bfca-e9a689f609cc/volumes"
Sep 11 17:49:43.706061 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:43.706008    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a95ba511-1801-4d5f-9f33-7cd0fe5b9f96" path="/var/lib/kubelet/pods/a95ba511-1801-4d5f-9f33-7cd0fe5b9f96/volumes"
Sep 11 17:49:45.050251 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:45.050216    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:49:59.859288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:59.859246    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"]
Sep 11 17:49:59.859722 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:49:59.859495    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc" podUID="412b8606-7b9a-429e-b258-bf382c2306c5" containerName="maas-api" containerID="cri-o://95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af" gracePeriod=30
Sep 11 17:50:00.112273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.112201    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:50:00.204123 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.204085    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rvrdg\" (UniqueName: \"kubernetes.io/projected/412b8606-7b9a-429e-b258-bf382c2306c5-kube-api-access-rvrdg\") pod \"412b8606-7b9a-429e-b258-bf382c2306c5\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") "
Sep 11 17:50:00.204321 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.204144    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-metrics-certs\") pod \"412b8606-7b9a-429e-b258-bf382c2306c5\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") "
Sep 11 17:50:00.204321 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.204214    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412b8606-7b9a-429e-b258-bf382c2306c5-openshift-service-ca\") pod \"412b8606-7b9a-429e-b258-bf382c2306c5\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") "
Sep 11 17:50:00.204321 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.204259    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls\") pod \"412b8606-7b9a-429e-b258-bf382c2306c5\" (UID: \"412b8606-7b9a-429e-b258-bf382c2306c5\") "
Sep 11 17:50:00.204632 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.204601    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/412b8606-7b9a-429e-b258-bf382c2306c5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "412b8606-7b9a-429e-b258-bf382c2306c5" (UID: "412b8606-7b9a-429e-b258-bf382c2306c5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:50:00.206275 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.206251    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "412b8606-7b9a-429e-b258-bf382c2306c5" (UID: "412b8606-7b9a-429e-b258-bf382c2306c5"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:50:00.206381 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.206287    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "412b8606-7b9a-429e-b258-bf382c2306c5" (UID: "412b8606-7b9a-429e-b258-bf382c2306c5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:50:00.206381 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.206306    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/412b8606-7b9a-429e-b258-bf382c2306c5-kube-api-access-rvrdg" (OuterVolumeSpecName: "kube-api-access-rvrdg") pod "412b8606-7b9a-429e-b258-bf382c2306c5" (UID: "412b8606-7b9a-429e-b258-bf382c2306c5"). InnerVolumeSpecName "kube-api-access-rvrdg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:50:00.305122 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.305085    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-metrics-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:00.305122 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.305119    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/412b8606-7b9a-429e-b258-bf382c2306c5-openshift-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:00.305337 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.305133    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/412b8606-7b9a-429e-b258-bf382c2306c5-maas-api-tls\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:00.305337 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.305144    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rvrdg\" (UniqueName: \"kubernetes.io/projected/412b8606-7b9a-429e-b258-bf382c2306c5-kube-api-access-rvrdg\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:00.713475 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.713441    2584 generic.go:356] "Generic (PLEG): container finished" podID="412b8606-7b9a-429e-b258-bf382c2306c5" containerID="95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af" exitCode=0
Sep 11 17:50:00.713654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.713497    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"
Sep 11 17:50:00.713654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.713527    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc" event={"ID":"412b8606-7b9a-429e-b258-bf382c2306c5","Type":"ContainerDied","Data":"95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af"}
Sep 11 17:50:00.713654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.713586    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc" event={"ID":"412b8606-7b9a-429e-b258-bf382c2306c5","Type":"ContainerDied","Data":"7ba5d8d7d393a294f1019b6a6c4c3edced19f679a94dfdf0ecc5f4ec87bfb5e3"}
Sep 11 17:50:00.713654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.713608    2584 scope.go:117] "RemoveContainer" containerID="95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af"
Sep 11 17:50:00.723212 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.723193    2584 scope.go:117] "RemoveContainer" containerID="95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af"
Sep 11 17:50:00.723544 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:50:00.723522    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af\": container with ID starting with 95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af not found: ID does not exist" containerID="95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af"
Sep 11 17:50:00.723623 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.723553    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af"} err="failed to get container status \"95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af\": rpc error: code = NotFound desc = could not find container \"95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af\": container with ID starting with 95e986eadc5d4719392cb8bc6ff20b2d2321f8b98ed06c17ebc2a889045d75af not found: ID does not exist"
Sep 11 17:50:00.736545 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.736494    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"]
Sep 11 17:50:00.738663 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:00.738637    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-4c36f4-69775d856f-r7jkc"]
Sep 11 17:50:01.707035 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:01.707002    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="412b8606-7b9a-429e-b258-bf382c2306c5" path="/var/lib/kubelet/pods/412b8606-7b9a-429e-b258-bf382c2306c5/volumes"
Sep 11 17:50:02.737417 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:02.737363    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:50:06.999595 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:06.999559    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"]
Sep 11 17:50:07.000072 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:06.999825    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy" containerID="cri-o://4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576" gracePeriod=30
Sep 11 17:50:07.337370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337278    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"]
Sep 11 17:50:07.337684 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337670    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="47854f0b-64c4-4f9f-86ef-a330eed16242" containerName="payload-pre-processing"
Sep 11 17:50:07.337742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337688    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="47854f0b-64c4-4f9f-86ef-a330eed16242" containerName="payload-pre-processing"
Sep 11 17:50:07.337742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337701    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="08808d92-4b07-4d0b-bfca-e9a689f609cc" containerName="payload-pre-processing"
Sep 11 17:50:07.337742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337707    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="08808d92-4b07-4d0b-bfca-e9a689f609cc" containerName="payload-pre-processing"
Sep 11 17:50:07.337742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337719    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="654cdbda-b7f3-49b0-bd1e-d1972aa4ee01" containerName="payload-processing"
Sep 11 17:50:07.337742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337725    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="654cdbda-b7f3-49b0-bd1e-d1972aa4ee01" containerName="payload-processing"
Sep 11 17:50:07.337742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337735    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="91e87971-c962-4ad1-9378-9102f70d4392" containerName="payload-processing"
Sep 11 17:50:07.337742 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337740    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="91e87971-c962-4ad1-9378-9102f70d4392" containerName="payload-processing"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337748    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="412b8606-7b9a-429e-b258-bf382c2306c5" containerName="maas-api"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337753    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="412b8606-7b9a-429e-b258-bf382c2306c5" containerName="maas-api"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337762    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a95ba511-1801-4d5f-9f33-7cd0fe5b9f96" containerName="payload-processing"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337770    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="a95ba511-1801-4d5f-9f33-7cd0fe5b9f96" containerName="payload-processing"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337779    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337784    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337793    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337798    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337857    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="47854f0b-64c4-4f9f-86ef-a330eed16242" containerName="payload-pre-processing"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337865    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="08808d92-4b07-4d0b-bfca-e9a689f609cc" containerName="payload-pre-processing"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337873    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="91e87971-c962-4ad1-9378-9102f70d4392" containerName="payload-processing"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337879    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="654cdbda-b7f3-49b0-bd1e-d1972aa4ee01" containerName="payload-processing"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337885    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="a95ba511-1801-4d5f-9f33-7cd0fe5b9f96" containerName="payload-processing"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337890    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337894    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="4457ff3d-a973-4441-a862-51b389b59745" containerName="istio-proxy"
Sep 11 17:50:07.337965 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.337900    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="412b8606-7b9a-429e-b258-bf382c2306c5" containerName="maas-api"
Sep 11 17:50:07.341787 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.341767    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"
Sep 11 17:50:07.344368 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.344346    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:50:07.344536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.344346    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-z84jg\""
Sep 11 17:50:07.349293 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.349265    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"]
Sep 11 17:50:07.357622 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.357581    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de563cf2-751c-4dc3-a791-7f8fd5cfc68b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5\" (UID: \"de563cf2-751c-4dc3-a791-7f8fd5cfc68b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"
Sep 11 17:50:07.458372 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.458337    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de563cf2-751c-4dc3-a791-7f8fd5cfc68b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5\" (UID: \"de563cf2-751c-4dc3-a791-7f8fd5cfc68b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"
Sep 11 17:50:07.458960 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.458940    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de563cf2-751c-4dc3-a791-7f8fd5cfc68b-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5\" (UID: \"de563cf2-751c-4dc3-a791-7f8fd5cfc68b\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"
Sep 11 17:50:07.653781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.653751    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"
Sep 11 17:50:07.926943 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:07.926910    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"]
Sep 11 17:50:07.929768 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:50:07.929736    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde563cf2_751c_4dc3_a791_7f8fd5cfc68b.slice/crio-2ec9fcd0bc90e66545804490d9b62752775076d8f90366584880964f7901984a WatchSource:0}: Error finding container 2ec9fcd0bc90e66545804490d9b62752775076d8f90366584880964f7901984a: Status 404 returned error can't find the container with id 2ec9fcd0bc90e66545804490d9b62752775076d8f90366584880964f7901984a
Sep 11 17:50:08.760604 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:08.760504    2584 generic.go:356] "Generic (PLEG): container finished" podID="de563cf2-751c-4dc3-a791-7f8fd5cfc68b" containerID="b7497def88341a7aa27b59bea657db653bd2f6c08c52331d905e515413e6f147" exitCode=0
Sep 11 17:50:08.760604 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:08.760582    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5" event={"ID":"de563cf2-751c-4dc3-a791-7f8fd5cfc68b","Type":"ContainerDied","Data":"b7497def88341a7aa27b59bea657db653bd2f6c08c52331d905e515413e6f147"}
Sep 11 17:50:08.761005 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:08.760638    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5" event={"ID":"de563cf2-751c-4dc3-a791-7f8fd5cfc68b","Type":"ContainerStarted","Data":"2ec9fcd0bc90e66545804490d9b62752775076d8f90366584880964f7901984a"}
Sep 11 17:50:09.905222 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:09.905189    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"
Sep 11 17:50:09.979364 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:09.979325    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de563cf2-751c-4dc3-a791-7f8fd5cfc68b-maas-api-service-ca\") pod \"de563cf2-751c-4dc3-a791-7f8fd5cfc68b\" (UID: \"de563cf2-751c-4dc3-a791-7f8fd5cfc68b\") "
Sep 11 17:50:09.979708 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:09.979684    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/de563cf2-751c-4dc3-a791-7f8fd5cfc68b-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "de563cf2-751c-4dc3-a791-7f8fd5cfc68b" (UID: "de563cf2-751c-4dc3-a791-7f8fd5cfc68b"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:50:10.080447 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:10.080337    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/de563cf2-751c-4dc3-a791-7f8fd5cfc68b-maas-api-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:10.773905 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:10.773872    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"
Sep 11 17:50:10.773905 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:10.773888    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5" event={"ID":"de563cf2-751c-4dc3-a791-7f8fd5cfc68b","Type":"ContainerDied","Data":"2ec9fcd0bc90e66545804490d9b62752775076d8f90366584880964f7901984a"}
Sep 11 17:50:10.774131 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:10.773943    2584 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ec9fcd0bc90e66545804490d9b62752775076d8f90366584880964f7901984a"
Sep 11 17:50:12.259162 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.259135    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:50:12.298822 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298727    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-socket\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.298822 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298780    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/068056b7-93e4-4dcb-bda0-16f27236340d-istio-podinfo\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.298822 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298811    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-envoy\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.299115 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298834    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-certs\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.299115 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298859    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qx7wn\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-kube-api-access-qx7wn\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.299115 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298890    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/068056b7-93e4-4dcb-bda0-16f27236340d-istiod-ca-cert\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.299115 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298916    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-istio-token\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.299115 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298942    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-credential-socket\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.299115 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.298982    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-data\") pod \"068056b7-93e4-4dcb-bda0-16f27236340d\" (UID: \"068056b7-93e4-4dcb-bda0-16f27236340d\") "
Sep 11 17:50:12.299115 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.299071    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:50:12.299536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.299240    2584 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.299536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.299246    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:50:12.299536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.299380    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-data" (OuterVolumeSpecName: "istio-data") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:50:12.299536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.299418    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/068056b7-93e4-4dcb-bda0-16f27236340d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:50:12.299536 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.299426    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:50:12.301310 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.301284    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-istio-token" (OuterVolumeSpecName: "istio-token") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:50:12.301479 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.301443    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:50:12.301537 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.301493    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/068056b7-93e4-4dcb-bda0-16f27236340d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 11 17:50:12.301622 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.301599    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-kube-api-access-qx7wn" (OuterVolumeSpecName: "kube-api-access-qx7wn") pod "068056b7-93e4-4dcb-bda0-16f27236340d" (UID: "068056b7-93e4-4dcb-bda0-16f27236340d"). InnerVolumeSpecName "kube-api-access-qx7wn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:50:12.400055 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.400019    2584 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/068056b7-93e4-4dcb-bda0-16f27236340d-istio-podinfo\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.400055 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.400048    2584 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-envoy\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.400055 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.400058    2584 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-workload-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.400286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.400066    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qx7wn\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-kube-api-access-qx7wn\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.400286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.400076    2584 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/068056b7-93e4-4dcb-bda0-16f27236340d-istiod-ca-cert\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.400286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.400085    2584 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/068056b7-93e4-4dcb-bda0-16f27236340d-istio-token\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.400286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.400092    2584 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-credential-socket\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.400286 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.400100    2584 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/068056b7-93e4-4dcb-bda0-16f27236340d-istio-data\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:12.787083 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.787052    2584 generic.go:356] "Generic (PLEG): container finished" podID="068056b7-93e4-4dcb-bda0-16f27236340d" containerID="4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576" exitCode=0
Sep 11 17:50:12.787267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.787096    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"
Sep 11 17:50:12.787267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.787115    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" event={"ID":"068056b7-93e4-4dcb-bda0-16f27236340d","Type":"ContainerDied","Data":"4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576"}
Sep 11 17:50:12.787267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.787161    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t" event={"ID":"068056b7-93e4-4dcb-bda0-16f27236340d","Type":"ContainerDied","Data":"b92667180d9b59558d0fcc5b16b58ed7a24babcf15a7c109df31a6093e425b65"}
Sep 11 17:50:12.787267 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.787185    2584 scope.go:117] "RemoveContainer" containerID="4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576"
Sep 11 17:50:12.796839 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.796821    2584 scope.go:117] "RemoveContainer" containerID="a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5"
Sep 11 17:50:12.805088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.805069    2584 scope.go:117] "RemoveContainer" containerID="4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576"
Sep 11 17:50:12.805342 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:50:12.805324    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576\": container with ID starting with 4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576 not found: ID does not exist" containerID="4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576"
Sep 11 17:50:12.805430 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.805350    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576"} err="failed to get container status \"4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576\": rpc error: code = NotFound desc = could not find container \"4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576\": container with ID starting with 4e4096f987a2fbf0f4b4630df48e7fe1141dc6c84a0ac9a2ead05a2b89f9e576 not found: ID does not exist"
Sep 11 17:50:12.805430 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.805367    2584 scope.go:117] "RemoveContainer" containerID="a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5"
Sep 11 17:50:12.805635 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:50:12.805616    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5\": container with ID starting with a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5 not found: ID does not exist" containerID="a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5"
Sep 11 17:50:12.805677 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.805641    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5"} err="failed to get container status \"a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5\": rpc error: code = NotFound desc = could not find container \"a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5\": container with ID starting with a638d1266c2aed190f8e46b4d413a234db94858352e45e85ae4348156e889ea5 not found: ID does not exist"
Sep 11 17:50:12.810343 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.810323    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"]
Sep 11 17:50:12.814210 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:12.814189    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-w3-4c36f4-openshift-default-5cd558c444-rb46t"]
Sep 11 17:50:13.705261 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:13.705226    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" path="/var/lib/kubelet/pods/068056b7-93e4-4dcb-bda0-16f27236340d/volumes"
Sep 11 17:50:18.071271 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.071183    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"]
Sep 11 17:50:18.071741 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.071446    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z" podUID="00bc0f8a-bd2b-4c38-80dd-957798fbaa06" containerName="payload-pre-processing" containerID="cri-o://d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31" gracePeriod=30
Sep 11 17:50:18.323756 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.323699    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:50:18.345723 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.345696    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hqnst\" (UniqueName: \"kubernetes.io/projected/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-kube-api-access-hqnst\") pod \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\" (UID: \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\") "
Sep 11 17:50:18.345858 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.345777    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-plugins-config-volume\") pod \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\" (UID: \"00bc0f8a-bd2b-4c38-80dd-957798fbaa06\") "
Sep 11 17:50:18.346151 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.346126    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "00bc0f8a-bd2b-4c38-80dd-957798fbaa06" (UID: "00bc0f8a-bd2b-4c38-80dd-957798fbaa06"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:50:18.347751 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.347729    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-kube-api-access-hqnst" (OuterVolumeSpecName: "kube-api-access-hqnst") pod "00bc0f8a-bd2b-4c38-80dd-957798fbaa06" (UID: "00bc0f8a-bd2b-4c38-80dd-957798fbaa06"). InnerVolumeSpecName "kube-api-access-hqnst". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:50:18.393744 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.393702    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"]
Sep 11 17:50:18.400622 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.400601    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-w3-db95fd-fftq5"]
Sep 11 17:50:18.447327 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.447296    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hqnst\" (UniqueName: \"kubernetes.io/projected/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-kube-api-access-hqnst\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:18.447327 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.447325    2584 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/00bc0f8a-bd2b-4c38-80dd-957798fbaa06-plugins-config-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:50:18.821335 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.821299    2584 generic.go:356] "Generic (PLEG): container finished" podID="00bc0f8a-bd2b-4c38-80dd-957798fbaa06" containerID="d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31" exitCode=0
Sep 11 17:50:18.821558 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.821341    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z" event={"ID":"00bc0f8a-bd2b-4c38-80dd-957798fbaa06","Type":"ContainerDied","Data":"d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31"}
Sep 11 17:50:18.821558 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.821388    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z" event={"ID":"00bc0f8a-bd2b-4c38-80dd-957798fbaa06","Type":"ContainerDied","Data":"9df29deb0df219c7ac4932ddc30d7eae234cf50470127190a34898c37ca00b3d"}
Sep 11 17:50:18.821558 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.821344    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"
Sep 11 17:50:18.821558 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.821445    2584 scope.go:117] "RemoveContainer" containerID="d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31"
Sep 11 17:50:18.830308 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.830283    2584 scope.go:117] "RemoveContainer" containerID="d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31"
Sep 11 17:50:18.830611 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:50:18.830589    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31\": container with ID starting with d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31 not found: ID does not exist" containerID="d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31"
Sep 11 17:50:18.830670 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.830620    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31"} err="failed to get container status \"d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31\": rpc error: code = NotFound desc = could not find container \"d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31\": container with ID starting with d5e2340ed027bf24572f154042890e9780db7b01133c125a5ac976f0c8ad4a31 not found: ID does not exist"
Sep 11 17:50:18.852086 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.852061    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"]
Sep 11 17:50:18.859130 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:18.859103    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-b-w3-db95fd-74b9cfb98-w5f2z"]
Sep 11 17:50:19.705790 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:19.705756    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00bc0f8a-bd2b-4c38-80dd-957798fbaa06" path="/var/lib/kubelet/pods/00bc0f8a-bd2b-4c38-80dd-957798fbaa06/volumes"
Sep 11 17:50:19.706174 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:19.706064    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="de563cf2-751c-4dc3-a791-7f8fd5cfc68b" path="/var/lib/kubelet/pods/de563cf2-751c-4dc3-a791-7f8fd5cfc68b/volumes"
Sep 11 17:50:20.812943 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:20.812905    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:50:25.686069 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:25.686041    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:50:25.688478 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:25.688454    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:50:30.254723 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:50:30.254686    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:51:52.451972 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:51:52.451881    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:52:19.152696 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:52:19.152654    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:52:27.037911 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:52:27.037874    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:52:34.031872 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:52:34.031833    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:52:41.625784 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:52:41.625748    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:52:56.037690 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:52:56.037655    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:53:06.027525 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:06.027485    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:53:13.172367 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.172328    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"]
Sep 11 17:53:13.172915 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.172633    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s" podUID="7a980db8-020c-4dd9-8ce3-73d8ac67f1f4" containerName="manager" containerID="cri-o://342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72" gracePeriod=10
Sep 11 17:53:13.423049 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.422991    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:53:13.532020 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.531985    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bwtj8\" (UniqueName: \"kubernetes.io/projected/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-kube-api-access-bwtj8\") pod \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\" (UID: \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\") "
Sep 11 17:53:13.532208 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.532089    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-extensions-socket-volume\") pod \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\" (UID: \"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4\") "
Sep 11 17:53:13.532474 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.532447    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7a980db8-020c-4dd9-8ce3-73d8ac67f1f4" (UID: "7a980db8-020c-4dd9-8ce3-73d8ac67f1f4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 11 17:53:13.533870 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.533848    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-kube-api-access-bwtj8" (OuterVolumeSpecName: "kube-api-access-bwtj8") pod "7a980db8-020c-4dd9-8ce3-73d8ac67f1f4" (UID: "7a980db8-020c-4dd9-8ce3-73d8ac67f1f4"). InnerVolumeSpecName "kube-api-access-bwtj8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:53:13.632703 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.632661    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bwtj8\" (UniqueName: \"kubernetes.io/projected/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-kube-api-access-bwtj8\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:53:13.632703 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.632697    2584 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4-extensions-socket-volume\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:53:13.764876 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.764845    2584 generic.go:356] "Generic (PLEG): container finished" podID="7a980db8-020c-4dd9-8ce3-73d8ac67f1f4" containerID="342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72" exitCode=0
Sep 11 17:53:13.765031 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.764888    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"
Sep 11 17:53:13.765031 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.764916    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s" event={"ID":"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4","Type":"ContainerDied","Data":"342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72"}
Sep 11 17:53:13.765031 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.764964    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s" event={"ID":"7a980db8-020c-4dd9-8ce3-73d8ac67f1f4","Type":"ContainerDied","Data":"cb011e6967a90746cd4371aafff35e284f814b849b8a578393883742a7d1dfaf"}
Sep 11 17:53:13.765031 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.764994    2584 scope.go:117] "RemoveContainer" containerID="342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72"
Sep 11 17:53:13.774617 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.774602    2584 scope.go:117] "RemoveContainer" containerID="342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72"
Sep 11 17:53:13.774866 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:53:13.774847    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72\": container with ID starting with 342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72 not found: ID does not exist" containerID="342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72"
Sep 11 17:53:13.774929 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.774872    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72"} err="failed to get container status \"342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72\": rpc error: code = NotFound desc = could not find container \"342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72\": container with ID starting with 342b2f72288128f5530b72375d7a396731887cffdf4f5b916ffe4af4e072ce72 not found: ID does not exist"
Sep 11 17:53:13.792088 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.792062    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"]
Sep 11 17:53:13.794048 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:13.794029    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-fvr5s"]
Sep 11 17:53:15.706335 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:53:15.706299    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a980db8-020c-4dd9-8ce3-73d8ac67f1f4" path="/var/lib/kubelet/pods/7a980db8-020c-4dd9-8ce3-73d8ac67f1f4/volumes"
Sep 11 17:54:13.953689 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.953654    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"]
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954003    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a980db8-020c-4dd9-8ce3-73d8ac67f1f4" containerName="manager"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954014    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a980db8-020c-4dd9-8ce3-73d8ac67f1f4" containerName="manager"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954023    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00bc0f8a-bd2b-4c38-80dd-957798fbaa06" containerName="payload-pre-processing"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954028    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="00bc0f8a-bd2b-4c38-80dd-957798fbaa06" containerName="payload-pre-processing"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954041    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954047    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954055    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954061    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954077    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="de563cf2-751c-4dc3-a791-7f8fd5cfc68b" containerName="revoke-keys"
Sep 11 17:54:13.954117 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954082    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="de563cf2-751c-4dc3-a791-7f8fd5cfc68b" containerName="revoke-keys"
Sep 11 17:54:13.954458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954128    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="00bc0f8a-bd2b-4c38-80dd-957798fbaa06" containerName="payload-pre-processing"
Sep 11 17:54:13.954458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954136    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="de563cf2-751c-4dc3-a791-7f8fd5cfc68b" containerName="revoke-keys"
Sep 11 17:54:13.954458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954143    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a980db8-020c-4dd9-8ce3-73d8ac67f1f4" containerName="manager"
Sep 11 17:54:13.954458 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.954149    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy"
Sep 11 17:54:13.957110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.957089    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:13.960904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.960882    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-xg8wc\""
Sep 11 17:54:13.981619 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:13.981581    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"]
Sep 11 17:54:14.030675 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:14.030640    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cde60d62-41f2-40b8-a6dc-4e3aa991a3f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gh7kf\" (UID: \"cde60d62-41f2-40b8-a6dc-4e3aa991a3f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:14.030851 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:14.030681    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkfqm\" (UniqueName: \"kubernetes.io/projected/cde60d62-41f2-40b8-a6dc-4e3aa991a3f1-kube-api-access-xkfqm\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gh7kf\" (UID: \"cde60d62-41f2-40b8-a6dc-4e3aa991a3f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:14.131783 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:14.131737    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cde60d62-41f2-40b8-a6dc-4e3aa991a3f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gh7kf\" (UID: \"cde60d62-41f2-40b8-a6dc-4e3aa991a3f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:14.131953 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:14.131820    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkfqm\" (UniqueName: \"kubernetes.io/projected/cde60d62-41f2-40b8-a6dc-4e3aa991a3f1-kube-api-access-xkfqm\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gh7kf\" (UID: \"cde60d62-41f2-40b8-a6dc-4e3aa991a3f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:14.132034 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:14.132018    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/cde60d62-41f2-40b8-a6dc-4e3aa991a3f1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gh7kf\" (UID: \"cde60d62-41f2-40b8-a6dc-4e3aa991a3f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:14.141692 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:14.141666    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkfqm\" (UniqueName: \"kubernetes.io/projected/cde60d62-41f2-40b8-a6dc-4e3aa991a3f1-kube-api-access-xkfqm\") pod \"kuadrant-operator-controller-manager-5769f99d9f-gh7kf\" (UID: \"cde60d62-41f2-40b8-a6dc-4e3aa991a3f1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:14.267277 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:14.267166    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:14.560681 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:14.560657    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"]
Sep 11 17:54:14.562410 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:54:14.562363    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcde60d62_41f2_40b8_a6dc_4e3aa991a3f1.slice/crio-399862f8dc1fef208d3d4a1081ccd465f4f76477a6fffd681906ba9dbc8f6152 WatchSource:0}: Error finding container 399862f8dc1fef208d3d4a1081ccd465f4f76477a6fffd681906ba9dbc8f6152: Status 404 returned error can't find the container with id 399862f8dc1fef208d3d4a1081ccd465f4f76477a6fffd681906ba9dbc8f6152
Sep 11 17:54:15.097718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:15.097677    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf" event={"ID":"cde60d62-41f2-40b8-a6dc-4e3aa991a3f1","Type":"ContainerStarted","Data":"7485bd269ffa00c73e4ae8654b02968c55866b27487253059fff0c03ba22c2f4"}
Sep 11 17:54:15.098122 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:15.097730    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf" event={"ID":"cde60d62-41f2-40b8-a6dc-4e3aa991a3f1","Type":"ContainerStarted","Data":"399862f8dc1fef208d3d4a1081ccd465f4f76477a6fffd681906ba9dbc8f6152"}
Sep 11 17:54:15.098122 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:15.097808    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:15.156958 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:15.156904    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf" podStartSLOduration=2.156888323 podStartE2EDuration="2.156888323s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:54:15.153388082 +0000 UTC m=+2030.108077985" watchObservedRunningTime="2026-09-11 17:54:15.156888323 +0000 UTC m=+2030.111578225"
Sep 11 17:54:26.105207 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:26.105176    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5769f99d9f-gh7kf"
Sep 11 17:54:34.547828 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:34.547789    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:54:39.644634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:39.644591    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:54:58.045799 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:54:58.045715    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:55:16.831764 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:16.831727    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:55:25.724941 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:25.724909    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:55:25.726537 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:25.726514    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fdflt_39e2442f-4119-4111-91ee-3deb60db2897/ovn-acl-logging/0.log"
Sep 11 17:55:37.228860 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:37.228822    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:55:46.143237 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:46.143206    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:55:55.832288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:55.832253    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:55:56.026589 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.026559    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"]
Sep 11 17:55:56.026961 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.026949    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="068056b7-93e4-4dcb-bda0-16f27236340d" containerName="istio-proxy"
Sep 11 17:55:56.030106 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.030088    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.033291 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.033263    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 11 17:55:56.033541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.033294    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 11 17:55:56.033541 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.033298    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 11 17:55:56.033726 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.033331    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 11 17:55:56.033726 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.033340    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-nwfbn\""
Sep 11 17:55:56.042488 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.042465    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"]
Sep 11 17:55:56.187916 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.187874    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-maas-api-tls\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.188105 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.187948    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-metrics-certs\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.188105 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.187975    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mgsj\" (UniqueName: \"kubernetes.io/projected/60d23803-a724-4836-aa3e-bcffe9f8dc11-kube-api-access-5mgsj\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.188105 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.188010    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d23803-a724-4836-aa3e-bcffe9f8dc11-openshift-service-ca\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.288878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.288846    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d23803-a724-4836-aa3e-bcffe9f8dc11-openshift-service-ca\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.288878 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.288884    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-maas-api-tls\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.289145 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.288932    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-metrics-certs\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.289145 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.288953    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mgsj\" (UniqueName: \"kubernetes.io/projected/60d23803-a724-4836-aa3e-bcffe9f8dc11-kube-api-access-5mgsj\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.289641 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.289616    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d23803-a724-4836-aa3e-bcffe9f8dc11-openshift-service-ca\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.291430 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.291388    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-maas-api-tls\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.291515 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.291494    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-metrics-certs\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.298594 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.298573    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mgsj\" (UniqueName: \"kubernetes.io/projected/60d23803-a724-4836-aa3e-bcffe9f8dc11-kube-api-access-5mgsj\") pod \"maas-api-7bf4f9b548-cm985\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") " pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.340792 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.340755    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:56.623277 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.623229    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"]
Sep 11 17:55:56.625759 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:55:56.625731    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60d23803_a724_4836_aa3e_bcffe9f8dc11.slice/crio-a2c380511188f18a94a50a8ecaf5af6790d5c4f2ffa8f6c5476ef9984086a660 WatchSource:0}: Error finding container a2c380511188f18a94a50a8ecaf5af6790d5c4f2ffa8f6c5476ef9984086a660: Status 404 returned error can't find the container with id a2c380511188f18a94a50a8ecaf5af6790d5c4f2ffa8f6c5476ef9984086a660
Sep 11 17:55:56.627580 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.627561    2584 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 11 17:55:56.649391 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:56.649359    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985" event={"ID":"60d23803-a724-4836-aa3e-bcffe9f8dc11","Type":"ContainerStarted","Data":"a2c380511188f18a94a50a8ecaf5af6790d5c4f2ffa8f6c5476ef9984086a660"}
Sep 11 17:55:57.656445 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:57.656393    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985" event={"ID":"60d23803-a724-4836-aa3e-bcffe9f8dc11","Type":"ContainerStarted","Data":"dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a"}
Sep 11 17:55:57.656902 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:57.656547    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:55:57.689013 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:55:57.688952    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985" podStartSLOduration=1.219946737 podStartE2EDuration="1.688936772s" totalImagesPullingTime="468.990035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:55:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:55:57.687573098 +0000 UTC m=+2132.642263000" watchObservedRunningTime="2026-09-11 17:55:57.688936772 +0000 UTC m=+2132.643626674"
Sep 11 17:56:03.440095 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.440051    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"]
Sep 11 17:56:03.440663 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.440298    2584 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985" podUID="60d23803-a724-4836-aa3e-bcffe9f8dc11" containerName="maas-api" containerID="cri-o://dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a" gracePeriod=30
Sep 11 17:56:03.445216 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.445189    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:56:03.481081 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.481043    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"]
Sep 11 17:56:03.484384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.484367    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.496335 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.496307    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"]
Sep 11 17:56:03.546338 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.546302    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-metrics-certs\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.546500 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.546368    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-maas-api-tls\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.546500 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.546420    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-openshift-service-ca\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.546500 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.546442    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7vx2\" (UniqueName: \"kubernetes.io/projected/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-kube-api-access-p7vx2\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.639288 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.639251    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:56:03.647102 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.647075    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-openshift-service-ca\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.647254 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.647112    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7vx2\" (UniqueName: \"kubernetes.io/projected/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-kube-api-access-p7vx2\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.647254 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.647180    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-metrics-certs\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.647254 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.647242    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-maas-api-tls\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.647874 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.647845    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-openshift-service-ca\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.649928 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.649902    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-maas-api-tls\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.650044 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.649995    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-metrics-certs\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.655416 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.655374    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7vx2\" (UniqueName: \"kubernetes.io/projected/2abf2a61-93ad-4035-b104-e1ef7bcc61b7-kube-api-access-p7vx2\") pod \"maas-api-858bf7b9cb-vhd6p\" (UID: \"2abf2a61-93ad-4035-b104-e1ef7bcc61b7\") " pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.688614 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.688586    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:56:03.690002 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.689977    2584 generic.go:356] "Generic (PLEG): container finished" podID="60d23803-a724-4836-aa3e-bcffe9f8dc11" containerID="dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a" exitCode=0
Sep 11 17:56:03.690110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.690012    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985" event={"ID":"60d23803-a724-4836-aa3e-bcffe9f8dc11","Type":"ContainerDied","Data":"dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a"}
Sep 11 17:56:03.690110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.690052    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985" event={"ID":"60d23803-a724-4836-aa3e-bcffe9f8dc11","Type":"ContainerDied","Data":"a2c380511188f18a94a50a8ecaf5af6790d5c4f2ffa8f6c5476ef9984086a660"}
Sep 11 17:56:03.690110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.690072    2584 scope.go:117] "RemoveContainer" containerID="dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a"
Sep 11 17:56:03.699149 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.699121    2584 scope.go:117] "RemoveContainer" containerID="dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a"
Sep 11 17:56:03.699522 ip-10-0-143-85 kubenswrapper[2584]: E0911 17:56:03.699494    2584 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a\": container with ID starting with dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a not found: ID does not exist" containerID="dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a"
Sep 11 17:56:03.699624 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.699535    2584 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a"} err="failed to get container status \"dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a\": rpc error: code = NotFound desc = could not find container \"dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a\": container with ID starting with dd210765f5f76f7c73dde41fad1f21f3bc175207a8f65c8cff0c030306ca151a not found: ID does not exist"
Sep 11 17:56:03.747779 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.747741    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d23803-a724-4836-aa3e-bcffe9f8dc11-openshift-service-ca\") pod \"60d23803-a724-4836-aa3e-bcffe9f8dc11\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") "
Sep 11 17:56:03.747779 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.747785    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-maas-api-tls\") pod \"60d23803-a724-4836-aa3e-bcffe9f8dc11\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") "
Sep 11 17:56:03.748042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.747821    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mgsj\" (UniqueName: \"kubernetes.io/projected/60d23803-a724-4836-aa3e-bcffe9f8dc11-kube-api-access-5mgsj\") pod \"60d23803-a724-4836-aa3e-bcffe9f8dc11\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") "
Sep 11 17:56:03.748042 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.747845    2584 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-metrics-certs\") pod \"60d23803-a724-4836-aa3e-bcffe9f8dc11\" (UID: \"60d23803-a724-4836-aa3e-bcffe9f8dc11\") "
Sep 11 17:56:03.748213 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.748179    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60d23803-a724-4836-aa3e-bcffe9f8dc11-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "60d23803-a724-4836-aa3e-bcffe9f8dc11" (UID: "60d23803-a724-4836-aa3e-bcffe9f8dc11"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 11 17:56:03.750008 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.749983    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "60d23803-a724-4836-aa3e-bcffe9f8dc11" (UID: "60d23803-a724-4836-aa3e-bcffe9f8dc11"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:56:03.750008 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.749985    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60d23803-a724-4836-aa3e-bcffe9f8dc11-kube-api-access-5mgsj" (OuterVolumeSpecName: "kube-api-access-5mgsj") pod "60d23803-a724-4836-aa3e-bcffe9f8dc11" (UID: "60d23803-a724-4836-aa3e-bcffe9f8dc11"). InnerVolumeSpecName "kube-api-access-5mgsj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 11 17:56:03.750150 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.750019    2584 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "60d23803-a724-4836-aa3e-bcffe9f8dc11" (UID: "60d23803-a724-4836-aa3e-bcffe9f8dc11"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 11 17:56:03.828111 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.828073    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:03.848714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.848681    2584 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/60d23803-a724-4836-aa3e-bcffe9f8dc11-openshift-service-ca\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:56:03.848714 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.848713    2584 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-maas-api-tls\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:56:03.848902 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.848725    2584 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mgsj\" (UniqueName: \"kubernetes.io/projected/60d23803-a724-4836-aa3e-bcffe9f8dc11-kube-api-access-5mgsj\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:56:03.848902 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:03.848734    2584 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/60d23803-a724-4836-aa3e-bcffe9f8dc11-metrics-certs\") on node \"ip-10-0-143-85.ec2.internal\" DevicePath \"\""
Sep 11 17:56:04.103936 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:04.103907    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"]
Sep 11 17:56:04.105822 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:56:04.105795    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2abf2a61_93ad_4035_b104_e1ef7bcc61b7.slice/crio-f7ee75de839b5627812702254ddd40485764ead2b396567bfbfa8df18b31b5ea WatchSource:0}: Error finding container f7ee75de839b5627812702254ddd40485764ead2b396567bfbfa8df18b31b5ea: Status 404 returned error can't find the container with id f7ee75de839b5627812702254ddd40485764ead2b396567bfbfa8df18b31b5ea
Sep 11 17:56:04.696780 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:04.696747    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p" event={"ID":"2abf2a61-93ad-4035-b104-e1ef7bcc61b7","Type":"ContainerStarted","Data":"f7ee75de839b5627812702254ddd40485764ead2b396567bfbfa8df18b31b5ea"}
Sep 11 17:56:04.697796 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:04.697779    2584 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"
Sep 11 17:56:04.718746 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:04.718681    2584 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"]
Sep 11 17:56:04.723654 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:04.723624    2584 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-7bf4f9b548-cm985"]
Sep 11 17:56:05.705538 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:05.705508    2584 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60d23803-a724-4836-aa3e-bcffe9f8dc11" path="/var/lib/kubelet/pods/60d23803-a724-4836-aa3e-bcffe9f8dc11/volumes"
Sep 11 17:56:05.705976 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:05.705830    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p" event={"ID":"2abf2a61-93ad-4035-b104-e1ef7bcc61b7","Type":"ContainerStarted","Data":"3bae28749559ca4544ea1a6d53b81d1bf69622ae16f0d47df91543797b3f291e"}
Sep 11 17:56:05.706050 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:05.706039    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:05.723032 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:05.722981    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p" podStartSLOduration=1.919029804 podStartE2EDuration="2.722965926s" totalImagesPullingTime="803.936122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:56:05.722015355 +0000 UTC m=+2140.676705256" watchObservedRunningTime="2026-09-11 17:56:05.722965926 +0000 UTC m=+2140.677655827"
Sep 11 17:56:10.238434 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:10.238387    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:56:11.716919 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:11.716891    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-858bf7b9cb-vhd6p"
Sep 11 17:56:15.833814 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:15.833769    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:56:22.661705 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:22.661665    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-2dpmv"]
Sep 11 17:56:25.922420 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:25.922369    2584 scope.go:117] "RemoveContainer" containerID="b7497def88341a7aa27b59bea657db653bd2f6c08c52331d905e515413e6f147"
Sep 11 17:56:31.878539 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:31.878509    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zw4gp_00a3cf78-ed52-453e-a0a4-b6f41862e4af/manager/0.log"
Sep 11 17:56:32.003119 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:32.003085    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-n7vtq_c3154c84-43fc-4b4c-b143-addf184d064e/manager/0.log"
Sep 11 17:56:32.296272 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:32.296179    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vq8bj_a9ecad63-6265-446d-9a3f-713400475fc2/server/0.log"
Sep 11 17:56:32.809273 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:32.809243    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f9c58fc78-vf255_462df59f-dcd2-4740-aab4-e16db497bdeb/copy-manifests/0.log"
Sep 11 17:56:32.815904 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:32.815879    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f9c58fc78-vf255_462df59f-dcd2-4740-aab4-e16db497bdeb/manager/0.log"
Sep 11 17:56:33.302416 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:33.302376    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-858bf7b9cb-vhd6p_2abf2a61-93ad-4035-b104-e1ef7bcc61b7/maas-api/0.log"
Sep 11 17:56:33.415373 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:33.415343    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819130-58xpk_cc8cff11-feba-42d8-a43b-44e096fd1115/cleanup/0.log"
Sep 11 17:56:33.531886 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:33.531859    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29819145-rxtnv_23b91172-97b1-49bf-90ba-c9f3aea75ba7/cleanup/0.log"
Sep 11 17:56:34.601686 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:34.601653    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-p2dq4_086d2faa-7067-4e22-9e53-b2031a12df2d/manager/0.log"
Sep 11 17:56:34.721114 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:34.721086    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rn6n6_234f1e0f-eddc-4554-96d5-89d24ba134f4/manager/0.log"
Sep 11 17:56:34.829936 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:34.829908    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6t8md_5c2813db-27e4-46df-960b-99f9799e58ad/kuadrant-console-plugin/0.log"
Sep 11 17:56:34.953296 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:34.953261    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-gh7kf_cde60d62-41f2-40b8-a6dc-4e3aa991a3f1/manager/0.log"
Sep 11 17:56:35.069986 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:35.069956    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-2dpmv_a1e2873c-1206-4802-a765-20258f974215/limitador/0.log"
Sep 11 17:56:35.187242 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:35.187210    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-45fj8_0e83afb1-b0b9-4545-a4cb-b3e7356acbdf/manager/0.log"
Sep 11 17:56:35.804858 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:35.804829    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5897fcd6c7-pglzr_ca9f7417-fbc4-4fc3-97b1-f8159203e894/kube-auth-proxy/0.log"
Sep 11 17:56:36.755022 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:36.754993    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-vr6pb_c03c8a72-692d-40eb-bd99-872a9b62b53a/main/0.log"
Sep 11 17:56:37.220801 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:37.220766    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f9g9mk_dd358574-a67f-4a0b-bf24-df99565bf090/main/0.log"
Sep 11 17:56:43.330545 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.330505    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rbzkp/must-gather-gdlhg"]
Sep 11 17:56:43.331036 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.331014    2584 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60d23803-a724-4836-aa3e-bcffe9f8dc11" containerName="maas-api"
Sep 11 17:56:43.331110 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.331041    2584 state_mem.go:107] "Deleted CPUSet assignment" podUID="60d23803-a724-4836-aa3e-bcffe9f8dc11" containerName="maas-api"
Sep 11 17:56:43.331166 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.331157    2584 memory_manager.go:368] "RemoveStaleState removing state" podUID="60d23803-a724-4836-aa3e-bcffe9f8dc11" containerName="maas-api"
Sep 11 17:56:43.334464 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.334442    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbzkp/must-gather-gdlhg"
Sep 11 17:56:43.337015 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.336991    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rbzkp\"/\"kube-root-ca.crt\""
Sep 11 17:56:43.337753 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.337734    2584 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rbzkp\"/\"default-dockercfg-h9zpw\""
Sep 11 17:56:43.339184 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.339167    2584 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rbzkp\"/\"openshift-service-ca.crt\""
Sep 11 17:56:43.356248 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.356214    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbzkp/must-gather-gdlhg"]
Sep 11 17:56:43.489068 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.489029    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3e35e274-72ab-455a-b10e-142ef898039a-must-gather-output\") pod \"must-gather-gdlhg\" (UID: \"3e35e274-72ab-455a-b10e-142ef898039a\") " pod="openshift-must-gather-rbzkp/must-gather-gdlhg"
Sep 11 17:56:43.489068 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.489077    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hhj7f\" (UniqueName: \"kubernetes.io/projected/3e35e274-72ab-455a-b10e-142ef898039a-kube-api-access-hhj7f\") pod \"must-gather-gdlhg\" (UID: \"3e35e274-72ab-455a-b10e-142ef898039a\") " pod="openshift-must-gather-rbzkp/must-gather-gdlhg"
Sep 11 17:56:43.589710 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.589610    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3e35e274-72ab-455a-b10e-142ef898039a-must-gather-output\") pod \"must-gather-gdlhg\" (UID: \"3e35e274-72ab-455a-b10e-142ef898039a\") " pod="openshift-must-gather-rbzkp/must-gather-gdlhg"
Sep 11 17:56:43.589710 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.589671    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hhj7f\" (UniqueName: \"kubernetes.io/projected/3e35e274-72ab-455a-b10e-142ef898039a-kube-api-access-hhj7f\") pod \"must-gather-gdlhg\" (UID: \"3e35e274-72ab-455a-b10e-142ef898039a\") " pod="openshift-must-gather-rbzkp/must-gather-gdlhg"
Sep 11 17:56:43.589967 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.589945    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/3e35e274-72ab-455a-b10e-142ef898039a-must-gather-output\") pod \"must-gather-gdlhg\" (UID: \"3e35e274-72ab-455a-b10e-142ef898039a\") " pod="openshift-must-gather-rbzkp/must-gather-gdlhg"
Sep 11 17:56:43.600189 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.600163    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hhj7f\" (UniqueName: \"kubernetes.io/projected/3e35e274-72ab-455a-b10e-142ef898039a-kube-api-access-hhj7f\") pod \"must-gather-gdlhg\" (UID: \"3e35e274-72ab-455a-b10e-142ef898039a\") " pod="openshift-must-gather-rbzkp/must-gather-gdlhg"
Sep 11 17:56:43.644285 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.644249    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbzkp/must-gather-gdlhg"
Sep 11 17:56:43.921941 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:43.921919    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbzkp/must-gather-gdlhg"]
Sep 11 17:56:43.923381 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:56:43.923353    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3e35e274_72ab_455a_b10e_142ef898039a.slice/crio-f85e1b9f2c820b573238565b2d96e396d0acb363beecaf2e048d0175a55b43a6 WatchSource:0}: Error finding container f85e1b9f2c820b573238565b2d96e396d0acb363beecaf2e048d0175a55b43a6: Status 404 returned error can't find the container with id f85e1b9f2c820b573238565b2d96e396d0acb363beecaf2e048d0175a55b43a6
Sep 11 17:56:44.919054 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:44.919020    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbzkp/must-gather-gdlhg" event={"ID":"3e35e274-72ab-455a-b10e-142ef898039a","Type":"ContainerStarted","Data":"f85e1b9f2c820b573238565b2d96e396d0acb363beecaf2e048d0175a55b43a6"}
Sep 11 17:56:45.930644 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:45.930604    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbzkp/must-gather-gdlhg" event={"ID":"3e35e274-72ab-455a-b10e-142ef898039a","Type":"ContainerStarted","Data":"68f645fa8a2b2d382675c1a396bb9ed4270f1ada6a6ad9868273a3c306b39168"}
Sep 11 17:56:45.931186 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:45.931152    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbzkp/must-gather-gdlhg" event={"ID":"3e35e274-72ab-455a-b10e-142ef898039a","Type":"ContainerStarted","Data":"7dda533167d5b352fec34ef745bb4704d069e47e8364aa0ab6ab259e98f14766"}
Sep 11 17:56:45.955594 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:45.955527    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rbzkp/must-gather-gdlhg" podStartSLOduration=2.05138974 podStartE2EDuration="2.955503901s" totalImagesPullingTime="904.114161ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-11 17:56:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:56:45.952137063 +0000 UTC m=+2180.906827031" watchObservedRunningTime="2026-09-11 17:56:45.955503901 +0000 UTC m=+2180.910193804"
Sep 11 17:56:46.562772 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:46.562740    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xxpwt_c18b7034-c197-4dd5-aa98-85db5ff80828/global-pull-secret-syncer/0.log"
Sep 11 17:56:46.661826 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:46.661794    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-l4mw7_9d2ee351-3a92-4965-9297-d51915b67a78/konnectivity-agent/0.log"
Sep 11 17:56:46.777781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:46.777748    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-85.ec2.internal_d8fd76400f9433d06743f51faa0c5dcb/haproxy/0.log"
Sep 11 17:56:51.797225 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:51.797195    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-p2dq4_086d2faa-7067-4e22-9e53-b2031a12df2d/manager/0.log"
Sep 11 17:56:51.826825 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:51.826783    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-rn6n6_234f1e0f-eddc-4554-96d5-89d24ba134f4/manager/0.log"
Sep 11 17:56:51.859995 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:51.859967    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-6t8md_5c2813db-27e4-46df-960b-99f9799e58ad/kuadrant-console-plugin/0.log"
Sep 11 17:56:51.906752 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:51.906719    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-5769f99d9f-gh7kf_cde60d62-41f2-40b8-a6dc-4e3aa991a3f1/manager/0.log"
Sep 11 17:56:51.941324 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:51.941291    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-2dpmv_a1e2873c-1206-4802-a765-20258f974215/limitador/0.log"
Sep 11 17:56:52.017781 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:52.017747    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-74495c69f8-45fj8_0e83afb1-b0b9-4545-a4cb-b3e7356acbdf/manager/0.log"
Sep 11 17:56:53.976395 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:53.976354    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45d6p_f0ff9e64-134b-4a0b-8781-d2f25769c1dd/node-exporter/0.log"
Sep 11 17:56:54.004657 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:54.004624    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45d6p_f0ff9e64-134b-4a0b-8781-d2f25769c1dd/kube-rbac-proxy/0.log"
Sep 11 17:56:54.032275 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:54.032246    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-45d6p_f0ff9e64-134b-4a0b-8781-d2f25769c1dd/init-textfile/0.log"
Sep 11 17:56:56.263156 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.263098    2584 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"]
Sep 11 17:56:56.269251 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.269214    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.278296 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.278266    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"]
Sep 11 17:56:56.321634 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.321597    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-podres\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.321917 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.321891    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5xld\" (UniqueName: \"kubernetes.io/projected/9ba79361-51e4-42f4-9170-b7920946c256-kube-api-access-z5xld\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.322094 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.322075    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-lib-modules\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.322279 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.322255    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-proc\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.322494 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.322478    2584 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-sys\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.423701 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.423662    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-sys\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.423908 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.423729    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-podres\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.423908 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.423777    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5xld\" (UniqueName: \"kubernetes.io/projected/9ba79361-51e4-42f4-9170-b7920946c256-kube-api-access-z5xld\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.423908 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.423842    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-lib-modules\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.424091 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.423911    2584 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-proc\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.424091 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.424025    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-proc\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.424201 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.424090    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-sys\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.424261 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.424198    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-podres\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.424509 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.424483    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/9ba79361-51e4-42f4-9170-b7920946c256-lib-modules\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.433239 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.433212    2584 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5xld\" (UniqueName: \"kubernetes.io/projected/9ba79361-51e4-42f4-9170-b7920946c256-kube-api-access-z5xld\") pod \"perf-node-gather-daemonset-2rslg\" (UID: \"9ba79361-51e4-42f4-9170-b7920946c256\") " pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.584384 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.584296    2584 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:56.895658 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:56.895626    2584 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"]
Sep 11 17:56:56.896241 ip-10-0-143-85 kubenswrapper[2584]: W0911 17:56:56.896209    2584 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod9ba79361_51e4_42f4_9170_b7920946c256.slice/crio-f5739ebc0da57c90f52d84598ce5647c05b6ac7e9fff9856b3acf8956da70383 WatchSource:0}: Error finding container f5739ebc0da57c90f52d84598ce5647c05b6ac7e9fff9856b3acf8956da70383: Status 404 returned error can't find the container with id f5739ebc0da57c90f52d84598ce5647c05b6ac7e9fff9856b3acf8956da70383
Sep 11 17:56:57.023336 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:57.022804    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg" event={"ID":"9ba79361-51e4-42f4-9170-b7920946c256","Type":"ContainerStarted","Data":"b615679d731f6ad3897e74bde25c36ffc02680092f3afce4c84cf350bfa95211"}
Sep 11 17:56:57.023567 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:57.023344    2584 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg" event={"ID":"9ba79361-51e4-42f4-9170-b7920946c256","Type":"ContainerStarted","Data":"f5739ebc0da57c90f52d84598ce5647c05b6ac7e9fff9856b3acf8956da70383"}
Sep 11 17:56:57.028425 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:57.024068    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:56:57.043575 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:57.043510    2584 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg" podStartSLOduration=1.043488545 podStartE2EDuration="1.043488545s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-11 17:56:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-11 17:56:57.042036703 +0000 UTC m=+2191.996726605" watchObservedRunningTime="2026-09-11 17:56:57.043488545 +0000 UTC m=+2191.998178453"
Sep 11 17:56:57.217485 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:57.217349    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-767b65ffb5-2qzr9_775f1921-cf63-4690-9dc7-bfa1cd31d21d/console/0.log"
Sep 11 17:56:59.233550 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:59.233517    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xdswl_b072962d-d307-4d17-8b94-89ff1b2f0ec7/dns/0.log"
Sep 11 17:56:59.259621 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:59.259592    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xdswl_b072962d-d307-4d17-8b94-89ff1b2f0ec7/kube-rbac-proxy/0.log"
Sep 11 17:56:59.362370 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:59.362334    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-rhwpb_d8160bb7-c5a4-450d-bc41-a9e43eab4147/dns-node-resolver/0.log"
Sep 11 17:56:59.949129 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:56:59.949105    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-8dgdw_ffdf1588-47ee-4828-a7e0-c3c45afe2e01/node-ca/0.log"
Sep 11 17:57:01.305178 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:01.305150    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5897fcd6c7-pglzr_ca9f7417-fbc4-4fc3-97b1-f8159203e894/kube-auth-proxy/0.log"
Sep 11 17:57:02.387697 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:02.387660    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-wtwfn_49c3980f-2355-4a62-8c25-07d8f7cd520b/serve-healthcheck-canary/0.log"
Sep 11 17:57:03.097810 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:03.097778    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gj5n4_c0a62a7e-25f6-4fdc-8c65-a5720cad3745/kube-rbac-proxy/0.log"
Sep 11 17:57:03.122331 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:03.122305    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gj5n4_c0a62a7e-25f6-4fdc-8c65-a5720cad3745/exporter/0.log"
Sep 11 17:57:03.147967 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:03.147933    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-gj5n4_c0a62a7e-25f6-4fdc-8c65-a5720cad3745/extractor/0.log"
Sep 11 17:57:04.050588 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:04.050558    2584 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rbzkp/perf-node-gather-daemonset-2rslg"
Sep 11 17:57:05.452925 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:05.452889    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-zw4gp_00a3cf78-ed52-453e-a0a4-b6f41862e4af/manager/0.log"
Sep 11 17:57:05.693381 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:05.693055    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-n7vtq_c3154c84-43fc-4b4c-b143-addf184d064e/manager/0.log"
Sep 11 17:57:05.763644 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:05.763613    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-vq8bj_a9ecad63-6265-446d-9a3f-713400475fc2/server/0.log"
Sep 11 17:57:06.117317 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:06.117287    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f9c58fc78-vf255_462df59f-dcd2-4740-aab4-e16db497bdeb/manager/0.log"
Sep 11 17:57:06.141256 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:06.141227    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f9c58fc78-vf255_462df59f-dcd2-4740-aab4-e16db497bdeb/copy-manifests/0.log"
Sep 11 17:57:07.591584 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:07.591550    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5897fcd6c7-pglzr_ca9f7417-fbc4-4fc3-97b1-f8159203e894/kube-auth-proxy/0.log"
Sep 11 17:57:09.439768 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:09.439737    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5897fcd6c7-pglzr_ca9f7417-fbc4-4fc3-97b1-f8159203e894/kube-auth-proxy/0.log"
Sep 11 17:57:12.588718 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:12.588689    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-mq9pk_d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7/migrator/0.log"
Sep 11 17:57:12.632205 ip-10-0-143-85 kubenswrapper[2584]: I0911 17:57:12.632166    2584 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-8b4d697c5-mq9pk_d6a34c77-9b0a-4bee-a23a-2ba89dcf52c7/graceful-termination/0.log"