Sep 08 15:32:19.531262 ip-10-0-134-78 systemd[1]: Starting Kubernetes Kubelet...
Sep 08 15:32:19.902452 ip-10-0-134-78 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:32:19.902452 ip-10-0-134-78 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Sep 08 15:32:19.902452 ip-10-0-134-78 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:32:19.902452 ip-10-0-134-78 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Sep 08 15:32:19.902452 ip-10-0-134-78 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Sep 08 15:32:19.904168 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.904079    2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Sep 08 15:32:19.907738 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907721    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:32:19.907738 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907738    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907741    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907747    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907751    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907754    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907757    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907760    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907763    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907766    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907769    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907772    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907775    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907778    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907782    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907785    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907788    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907791    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907794    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907797    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:32:19.907801 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907799    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907802    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907805    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907807    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907811    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907813    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907816    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907819    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907821    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907825    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907827    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907831    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907833    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907836    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907839    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907841    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907844    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907846    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907869    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907873    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:32:19.908271 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907876    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907879    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907881    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907884    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907886    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907889    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907892    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907894    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907897    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907899    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907903    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907907    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907909    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907912    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907915    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907918    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907921    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907924    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907926    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907929    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:32:19.908762 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907932    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907936    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907938    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907941    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907944    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907946    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907949    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907952    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907954    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907967    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907971    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907973    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907976    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907978    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907981    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907984    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907986    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907989    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907991    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907994    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:32:19.909275 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907996    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.907999    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908002    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908004    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908007    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908011    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908014    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908017    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908019    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908022    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908025    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908027    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908030    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908033    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908036    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908045    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908047    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908050    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908053    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908783    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:32:19.909751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908789    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908794    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908798    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908801    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908803    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908806    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908808    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908811    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908813    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908816    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908818    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908821    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908823    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908826    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908828    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908831    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908833    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908837    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908840    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:32:19.910244 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908843    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908845    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908848    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908851    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908853    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908856    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908858    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908861    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908864    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908867    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908870    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908873    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908875    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908878    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908880    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908883    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908885    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908888    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908890    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908893    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:32:19.910711 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908895    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908898    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908900    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908903    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908905    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908908    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908910    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908913    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908915    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908918    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908921    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908925    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908929    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908931    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908934    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908937    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908939    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908942    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908945    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908947    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:32:19.911205 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908949    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908952    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908955    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908972    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908977    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908979    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908982    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908986    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908990    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908993    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908996    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.908999    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909002    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909004    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909008    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909010    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909013    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909016    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909019    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909021    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:32:19.911696 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909024    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909026    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909029    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909032    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909034    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909037    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909040    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909042    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909045    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909047    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909053    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909056    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909059    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909061    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909064    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909067    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909070    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909073    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909076    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909457    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:32:19.912207 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909461    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909464    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909467    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909470    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909472    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909476    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909478    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909481    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909484    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909486    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909489    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909491    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909494    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909497    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909500    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909502    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909505    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909508    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909510    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909513    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:32:19.912697 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909515    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909518    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909523    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909526    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909528    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909530    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909533    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909536    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909539    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909542    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909544    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909546    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909549    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909551    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909554    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909556    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909558    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909561    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909563    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909566    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:32:19.913190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909569    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909571    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909574    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909578    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909582    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909585    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909589    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909592    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909595    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909598    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909600    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909603    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909606    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909609    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909613    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909616    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909619    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909622    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909624    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:32:19.913709 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909627    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909630    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909632    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909635    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909637    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909639    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909642    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909645    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909647    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909649    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909652    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909655    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909657    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909660    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909662    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909667    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909671    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909673    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909676    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:32:19.914190 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909679    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909682    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909684    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909687    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909690    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909693    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909696    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909698    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909702    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909705    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909707    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909710    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909712    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909715    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909718    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909721    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909724    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909726    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909728    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.909731    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:32:19.914682 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909817    2579 flags.go:64] FLAG: --address="0.0.0.0"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909862    2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909870    2579 flags.go:64] FLAG: --anonymous-auth="true"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909875    2579 flags.go:64] FLAG: --application-metrics-count-limit="100"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909879    2579 flags.go:64] FLAG: --authentication-token-webhook="false"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909882    2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909886    2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909890    2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909894    2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909897    2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909901    2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909904    2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909908    2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909911    2579 flags.go:64] FLAG: --cgroup-root=""
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909914    2579 flags.go:64] FLAG: --cgroups-per-qos="true"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909917    2579 flags.go:64] FLAG: --client-ca-file=""
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909920    2579 flags.go:64] FLAG: --cloud-provider="external"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909923    2579 flags.go:64] FLAG: --cluster-dns="[]"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909927    2579 flags.go:64] FLAG: --cluster-domain=""
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909930    2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909934    2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909937    2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909941    2579 flags.go:64] FLAG: --container-log-max-files="5"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909944    2579 flags.go:64] FLAG: --container-log-max-size="10Mi"
Sep 08 15:32:19.915181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909948    2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909951    2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909954    2579 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909969    2579 flags.go:64] FLAG: --contention-profiling="false"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909973    2579 flags.go:64] FLAG: --cpu-cfs-quota="true"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909976    2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909979    2579 flags.go:64] FLAG: --cpu-manager-policy="none"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909982    2579 flags.go:64] FLAG: --cpu-manager-policy-options=""
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909988    2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909991    2579 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909994    2579 flags.go:64] FLAG: --enable-debugging-handlers="true"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.909997    2579 flags.go:64] FLAG: --enable-load-reader="false"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910000    2579 flags.go:64] FLAG: --enable-server="true"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910003    2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910008    2579 flags.go:64] FLAG: --event-burst="100"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910011    2579 flags.go:64] FLAG: --event-qps="50"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910014    2579 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910017    2579 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910020    2579 flags.go:64] FLAG: --eviction-hard=""
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910023    2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910026    2579 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910029    2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910033    2579 flags.go:64] FLAG: --eviction-soft=""
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910035    2579 flags.go:64] FLAG: --eviction-soft-grace-period=""
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910038    2579 flags.go:64] FLAG: --exit-on-lock-contention="false"
Sep 08 15:32:19.915757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910041    2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910044    2579 flags.go:64] FLAG: --experimental-mounter-path=""
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910047    2579 flags.go:64] FLAG: --fail-cgroupv1="false"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910051    2579 flags.go:64] FLAG: --fail-swap-on="true"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910054    2579 flags.go:64] FLAG: --feature-gates=""
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910058    2579 flags.go:64] FLAG: --file-check-frequency="20s"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910061    2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910064    2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910067    2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910070    2579 flags.go:64] FLAG: --healthz-port="10248"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910073    2579 flags.go:64] FLAG: --help="false"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910076    2579 flags.go:64] FLAG: --hostname-override="ip-10-0-134-78.ec2.internal"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910080    2579 flags.go:64] FLAG: --housekeeping-interval="10s"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910083    2579 flags.go:64] FLAG: --http-check-frequency="20s"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910086    2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910092    2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910096    2579 flags.go:64] FLAG: --image-gc-high-threshold="85"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910099    2579 flags.go:64] FLAG: --image-gc-low-threshold="80"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910102    2579 flags.go:64] FLAG: --image-service-endpoint=""
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910104    2579 flags.go:64] FLAG: --kernel-memcg-notification="false"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910108    2579 flags.go:64] FLAG: --kube-api-burst="100"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910111    2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910114    2579 flags.go:64] FLAG: --kube-api-qps="50"
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910117    2579 flags.go:64] FLAG: --kube-reserved=""
Sep 08 15:32:19.916392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910119    2579 flags.go:64] FLAG: --kube-reserved-cgroup=""
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910122    2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910125    2579 flags.go:64] FLAG: --kubelet-cgroups=""
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910128    2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910131    2579 flags.go:64] FLAG: --lock-file=""
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910134    2579 flags.go:64] FLAG: --log-cadvisor-usage="false"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910137    2579 flags.go:64] FLAG: --log-flush-frequency="5s"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910140    2579 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910146    2579 flags.go:64] FLAG: --log-json-split-stream="false"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910149    2579 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910152    2579 flags.go:64] FLAG: --log-text-split-stream="false"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910158    2579 flags.go:64] FLAG: --logging-format="text"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910161    2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910164    2579 flags.go:64] FLAG: --make-iptables-util-chains="true"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910167    2579 flags.go:64] FLAG: --manifest-url=""
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910170    2579 flags.go:64] FLAG: --manifest-url-header=""
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910177    2579 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910180    2579 flags.go:64] FLAG: --max-open-files="1000000"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910184    2579 flags.go:64] FLAG: --max-pods="110"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910188    2579 flags.go:64] FLAG: --maximum-dead-containers="-1"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910191    2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910194    2579 flags.go:64] FLAG: --memory-manager-policy="None"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910197    2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910201    2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910205    2579 flags.go:64] FLAG: --node-ip="0.0.0.0"
Sep 08 15:32:19.917100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910208    2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910214    2579 flags.go:64] FLAG: --node-status-max-images="50"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910217    2579 flags.go:64] FLAG: --node-status-update-frequency="10s"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910220    2579 flags.go:64] FLAG: --oom-score-adj="-999"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910223    2579 flags.go:64] FLAG: --pod-cidr=""
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910226    2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910234    2579 flags.go:64] FLAG: --pod-manifest-path=""
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910237    2579 flags.go:64] FLAG: --pod-max-pids="-1"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910241    2579 flags.go:64] FLAG: --pods-per-core="0"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910244    2579 flags.go:64] FLAG: --port="10250"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910247    2579 flags.go:64] FLAG: --protect-kernel-defaults="false"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910250    2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-042a2db8d8a8e3c42"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910254    2579 flags.go:64] FLAG: --qos-reserved=""
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910257    2579 flags.go:64] FLAG: --read-only-port="10255"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910260    2579 flags.go:64] FLAG: --register-node="true"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910262    2579 flags.go:64] FLAG: --register-with-taints=""
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910266    2579 flags.go:64] FLAG: --registry-burst="10"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910269    2579 flags.go:64] FLAG: --registry-qps="5"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910273    2579 flags.go:64] FLAG: --reserved-cpus=""
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910276    2579 flags.go:64] FLAG: --reserved-memory=""
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910279    2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910282    2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910285    2579 flags.go:64] FLAG: --rotate-certificates="false"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910288    2579 flags.go:64] FLAG: --rotate-server-certificates="false"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910291    2579 flags.go:64] FLAG: --runonce="false"
Sep 08 15:32:19.918270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910294    2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910297    2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910300    2579 flags.go:64] FLAG: --seccomp-default="false"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910303    2579 flags.go:64] FLAG: --serialize-image-pulls="true"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910307    2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910310    2579 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910315    2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910318    2579 flags.go:64] FLAG: --storage-driver-password="root"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910321    2579 flags.go:64] FLAG: --storage-driver-secure="false"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910324    2579 flags.go:64] FLAG: --storage-driver-table="stats"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910327    2579 flags.go:64] FLAG: --storage-driver-user="root"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910330    2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910333    2579 flags.go:64] FLAG: --sync-frequency="1m0s"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910336    2579 flags.go:64] FLAG: --system-cgroups=""
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910339    2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910344    2579 flags.go:64] FLAG: --system-reserved-cgroup=""
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910347    2579 flags.go:64] FLAG: --tls-cert-file=""
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910350    2579 flags.go:64] FLAG: --tls-cipher-suites="[]"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910354    2579 flags.go:64] FLAG: --tls-min-version=""
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910357    2579 flags.go:64] FLAG: --tls-private-key-file=""
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910359    2579 flags.go:64] FLAG: --topology-manager-policy="none"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910362    2579 flags.go:64] FLAG: --topology-manager-policy-options=""
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910365    2579 flags.go:64] FLAG: --topology-manager-scope="container"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910368    2579 flags.go:64] FLAG: --v="2"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910372    2579 flags.go:64] FLAG: --version="false"
Sep 08 15:32:19.919347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910376    2579 flags.go:64] FLAG: --vmodule=""
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910380    2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.910383    2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910501    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910504    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910507    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910511    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910515    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910519    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910523    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910527    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910530    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910533    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910537    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910540    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910542    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910545    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910547    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910550    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:32:19.920242 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910553    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910555    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910559    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910563    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910566    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910569    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910573    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910576    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910578    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910581    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910584    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910586    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910589    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910592    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910594    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910597    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910600    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910602    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910605    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:32:19.920723 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910607    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910610    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910612    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910615    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910617    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910620    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910622    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910626    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910629    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910631    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910634    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910637    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910639    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910642    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910645    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910647    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910650    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910652    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910655    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910657    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:32:19.921228 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910660    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910662    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910665    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910667    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910670    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910672    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910675    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910678    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910680    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910683    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910686    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910688    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910691    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910693    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910696    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910699    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910702    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910704    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910706    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910710    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:32:19.921722 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910713    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910716    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910719    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910721    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910724    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910728    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910731    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910734    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910737    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910740    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910743    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910746    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910749    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910753    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910756    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910759    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910762    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910766    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910769    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:32:19.922237 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910771    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910774    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910777    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910779    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.910782    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.911335    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.920315    2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.920332    2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.921048    2579 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.921059    2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921119    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921125    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921129    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921132    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921135    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:32:19.922716 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921138    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921140    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921143    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921146    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921149    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921152    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921156    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921160    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921164    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921168    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921172    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921175    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921178    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921181    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921183    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921186    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921189    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921192    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921194    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:32:19.923277 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921197    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921199    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921202    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921205    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921208    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921212    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921214    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921217    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921220    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921222    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921225    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921228    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921230    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921233    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921236    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921238    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921241    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921244    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921246    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921249    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921252    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:32:19.923751 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921254    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921258    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921260    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921263    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921266    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921268    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921273    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921276    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921279    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921282    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921285    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921288    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921291    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921293    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921296    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921299    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921302    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921305    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921308    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:32:19.924326 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921311    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921314    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921317    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921320    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921322    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921325    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921328    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921331    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921334    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921337    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921339    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921342    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921345    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921347    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921350    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921354    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921357    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921359    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921362    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921364    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:32:19.924810 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921367    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921369    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921372    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921375    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921377    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921380    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921382    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921385    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921388    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921391    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921393    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921396    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921399    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921401    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921404    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:32:19.925359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.921409    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921522    2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921527    2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921531    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921533    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921537    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921539    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921542    2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921545    2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921547    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921550    2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921553    2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921556    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921559    2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921562    2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921565    2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921568    2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921571    2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921574    2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Sep 08 15:32:19.925812 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921576    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921579    2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921581    2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921584    2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921587    2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921590    2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921594    2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921597    2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921599    2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921602    2579 feature_gate.go:328] unrecognized feature gate: SignatureStores
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921605    2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921607    2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921610    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921613    2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921615    2579 feature_gate.go:328] unrecognized feature gate: NewOLM
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921618    2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921620    2579 feature_gate.go:328] unrecognized feature gate: DualReplica
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921624    2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921628    2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Sep 08 15:32:19.926283 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921631    2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921634    2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921636    2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921639    2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921642    2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921645    2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921648    2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921651    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921654    2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921657    2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921660    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921662    2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921666    2579 feature_gate.go:328] unrecognized feature gate: Example2
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921668    2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921671    2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921674    2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921677    2579 feature_gate.go:328] unrecognized feature gate: OSStreams
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921679    2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921682    2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921685    2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Sep 08 15:32:19.926790 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921688    2579 feature_gate.go:328] unrecognized feature gate: PinnedImages
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921691    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921693    2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921696    2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921698    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921701    2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921704    2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921706    2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921709    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921711    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921714    2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921716    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921719    2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921721    2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921724    2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921727    2579 feature_gate.go:328] unrecognized feature gate: Example
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921729    2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921732    2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921735    2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921737    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Sep 08 15:32:19.927323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921740    2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921743    2579 feature_gate.go:328] unrecognized feature gate: EventTTL
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921745    2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921748    2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921750    2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921753    2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921755    2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921757    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921760    2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921763    2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921765    2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921767    2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921772    2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921775    2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921778    2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921780    2579 feature_gate.go:328] unrecognized feature gate: OVNObservability
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921783    2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921786    2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921789    2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921792    2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Sep 08 15:32:19.927976 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921797    2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:19.921800    2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.921805    2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.921914    2579 server.go:962] "Client rotation is on, will bootstrap in background"
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.923874    2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.924798    2579 server.go:1019] "Starting client certificate rotation"
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.924919    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.925661    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.927363    2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:32:19.928820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.928513    2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Sep 08 15:32:19.937443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.937423    2579 log.go:25] "Validated CRI v1 runtime API"
Sep 08 15:32:19.939948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.939931    2579 log.go:25] "Validated CRI v1 image API"
Sep 08 15:32:19.940817 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.940794    2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Sep 08 15:32:19.943775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.943751    2579 fs.go:135] Filesystem UUIDs: map[3a7227ad-cf71-49a2-ade6-59c9671fc9b7:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7ce9e876-5040-43e1-8cb1-837dd289cfb1:/dev/nvme0n1p4]
Sep 08 15:32:19.943822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.943775    2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Sep 08 15:32:19.949047 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.948929    2579 manager.go:216] Machine: {Timestamp:2026-09-08 15:32:19.948456852 +0000 UTC m=+0.308999627 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102554 MemoryCapacity:33164472320 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2cdbec192da79bc072a7b35c83f28e SystemUUID:ec2cdbec-192d-a79b-c072-a7b35c83f28e BootID:2252db07-1aad-4f59-96ec-82a43b2cd73a Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582234112 Type:vfs Inodes:4048397 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632894464 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582238208 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:37:f3:4a:80:39 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:37:f3:4a:80:39 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:b9:fe:66:df:bd Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164472320 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Sep 08 15:32:19.949047 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.949047    2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Sep 08 15:32:19.949175 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.949164    2579 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Sep 08 15:32:19.950636 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.950613    2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Sep 08 15:32:19.950777 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.950641    2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-78.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Sep 08 15:32:19.951636 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.951624    2579 topology_manager.go:138] "Creating topology manager with none policy"
Sep 08 15:32:19.951669 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.951640    2579 container_manager_linux.go:309] "Creating device plugin manager"
Sep 08 15:32:19.951669 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.951649    2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:32:19.952231 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.952217    2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Sep 08 15:32:19.953314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.953303    2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Sep 08 15:32:19.956665 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.956649    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:32:19.956710 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.956689    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:32:19.956835 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.956825    2579 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Sep 08 15:32:19.956867 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.956858    2579 kubelet.go:486] "Attempting to sync node with API server"
Sep 08 15:32:19.956897 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.956869    2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Sep 08 15:32:19.956897 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.956884    2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Sep 08 15:32:19.956897 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.956894    2579 kubelet.go:398] "Adding apiserver pod source"
Sep 08 15:32:19.956982 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.956903    2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Sep 08 15:32:19.957976 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.957940    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:32:19.958082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.957988    2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Sep 08 15:32:19.960185 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.960168    2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1"
Sep 08 15:32:19.962158 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962141    2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Sep 08 15:32:19.962234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962180    2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Sep 08 15:32:19.962365 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962353    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Sep 08 15:32:19.962431 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962373    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Sep 08 15:32:19.962431 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962382    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Sep 08 15:32:19.962431 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962391    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Sep 08 15:32:19.962431 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962403    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Sep 08 15:32:19.962431 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962411    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Sep 08 15:32:19.962912 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962902    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Sep 08 15:32:19.962984 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962914    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Sep 08 15:32:19.962984 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962926    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Sep 08 15:32:19.962984 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962935    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Sep 08 15:32:19.962984 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962947    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Sep 08 15:32:19.962984 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.962975    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Sep 08 15:32:19.963770 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.963758    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Sep 08 15:32:19.963834 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.963772    2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Sep 08 15:32:19.967687 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.967667    2579 server.go:1268] "Started kubelet"
Sep 08 15:32:19.967831 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.967774    2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Sep 08 15:32:19.967891 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.967856    2579 server_v1.go:49] "podresources" method="list" useActivePods=true
Sep 08 15:32:19.968093 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.968017    2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Sep 08 15:32:19.968670 ip-10-0-134-78 systemd[1]: Started Kubernetes Kubelet.
Sep 08 15:32:19.968877 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.968737    2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Sep 08 15:32:19.968877 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:19.968741    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Sep 08 15:32:19.968877 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:19.968735    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Sep 08 15:32:19.968877 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.968805    2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-134-78.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Sep 08 15:32:19.970736 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.970724    2579 server.go:310] "Adding debug handlers to kubelet server"
Sep 08 15:32:19.972109 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:19.972085    2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Sep 08 15:32:19.973358 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.973340    2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Sep 08 15:32:19.973417 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.973388    2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Sep 08 15:32:19.974022 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:19.973518    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:19.974022 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.973890    2579 volume_manager.go:311] "The desired_state_of_world populator starts"
Sep 08 15:32:19.974022 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.973952    2579 volume_manager.go:313] "Starting Kubelet Volume Manager"
Sep 08 15:32:19.974228 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.974213    2579 reconstruct.go:97] "Volume reconstruction finished"
Sep 08 15:32:19.974228 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.974228    2579 reconciler.go:29] "Reconciler: start to sync state"
Sep 08 15:32:19.974315 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.974275    2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Sep 08 15:32:19.974479 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:19.973545    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-78.ec2.internal.18d362485f065b19  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-78.ec2.internal,UID:ip-10-0-134-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-134-78.ec2.internal,},FirstTimestamp:2026-09-08 15:32:19.967638297 +0000 UTC m=+0.328181053,LastTimestamp:2026-09-08 15:32:19.967638297 +0000 UTC m=+0.328181053,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-78.ec2.internal,}"
Sep 08 15:32:19.974813 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.974794    2579 factory.go:55] Registering systemd factory
Sep 08 15:32:19.974912 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.974818    2579 factory.go:223] Registration of the systemd container factory successfully
Sep 08 15:32:19.975107 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.975060    2579 factory.go:153] Registering CRI-O factory
Sep 08 15:32:19.975107 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.975076    2579 factory.go:223] Registration of the crio container factory successfully
Sep 08 15:32:19.975212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.975125    2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Sep 08 15:32:19.975212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.975142    2579 factory.go:103] Registering Raw factory
Sep 08 15:32:19.975212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.975157    2579 manager.go:1196] Started watching for new ooms in manager
Sep 08 15:32:19.975598 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.975582    2579 manager.go:349] Starting recovery of all containers
Sep 08 15:32:19.981338 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:19.981310    2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Sep 08 15:32:19.981471 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:19.981435    2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-134-78.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Sep 08 15:32:19.987046 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.987026    2579 manager.go:354] Recovery completed
Sep 08 15:32:19.991669 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.991654    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:32:19.993496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.993477    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:32:19.993578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.993513    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:32:19.993578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.993523    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:32:19.994119 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.994104    2579 cpu_manager.go:222] "Starting CPU manager" policy="none"
Sep 08 15:32:19.994186 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.994120    2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Sep 08 15:32:19.994186 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.994139    2579 state_mem.go:36] "Initialized new in-memory state store"
Sep 08 15:32:19.994186 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.994153    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:32:19.995235 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.995217    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:32:19.995312 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.995251    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:32:19.995312 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.995268    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:32:19.995735 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:19.995666    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-78.ec2.internal.18d362486090ed56  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-78.ec2.internal,UID:ip-10-0-134-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-78.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-78.ec2.internal,},FirstTimestamp:2026-09-08 15:32:19.993496918 +0000 UTC m=+0.354039674,LastTimestamp:2026-09-08 15:32:19.993496918 +0000 UTC m=+0.354039674,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-78.ec2.internal,}"
Sep 08 15:32:19.996393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.996382    2579 policy_none.go:49] "None policy: Start"
Sep 08 15:32:19.996437 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.996399    2579 memory_manager.go:187] "Starting memorymanager" policy="None"
Sep 08 15:32:19.996437 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.996409    2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Sep 08 15:32:19.999013 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:19.998998    2579 policy_none.go:47] "Start"
Sep 08 15:32:20.006121 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.006046    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-78.ec2.internal.18d3624860913dd9  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-78.ec2.internal,UID:ip-10-0-134-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-134-78.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-134-78.ec2.internal,},FirstTimestamp:2026-09-08 15:32:19.993517529 +0000 UTC m=+0.354060284,LastTimestamp:2026-09-08 15:32:19.993517529 +0000 UTC m=+0.354060284,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-78.ec2.internal,}"
Sep 08 15:32:20.012991 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.012957    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h2rsc"
Sep 08 15:32:20.015020 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.014916    2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-78.ec2.internal.18d36248609163a3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-78.ec2.internal,UID:ip-10-0-134-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-134-78.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-134-78.ec2.internal,},FirstTimestamp:2026-09-08 15:32:19.993527203 +0000 UTC m=+0.354069959,LastTimestamp:2026-09-08 15:32:19.993527203 +0000 UTC m=+0.354069959,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-78.ec2.internal,}"
Sep 08 15:32:20.021542 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.021520    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-h2rsc"
Sep 08 15:32:20.025623 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.025533    2579 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-134-78.ec2.internal.18d362486090ed56\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-134-78.ec2.internal.18d362486090ed56  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-134-78.ec2.internal,UID:ip-10-0-134-78.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-134-78.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-134-78.ec2.internal,},FirstTimestamp:2026-09-08 15:32:19.993496918 +0000 UTC m=+0.354039674,LastTimestamp:2026-09-08 15:32:19.995234451 +0000 UTC m=+0.355777213,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-134-78.ec2.internal,}"
Sep 08 15:32:20.041657 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.041634    2579 manager.go:337] "Starting Device Plugin manager"
Sep 08 15:32:20.041781 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.041679    2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Sep 08 15:32:20.041781 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.041689    2579 server.go:87] "Starting device plugin registration server"
Sep 08 15:32:20.042009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.041997    2579 eviction_manager.go:189] "Eviction manager: starting control loop"
Sep 08 15:32:20.042076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.042013    2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Sep 08 15:32:20.042163 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.042147    2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Sep 08 15:32:20.042259 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.042242    2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Sep 08 15:32:20.042259 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.042255    2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Sep 08 15:32:20.042811 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.042782    2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Sep 08 15:32:20.042878 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.042840    2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.105793 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.105739    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Sep 08 15:32:20.107082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.107063    2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Sep 08 15:32:20.107163 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.107131    2579 status_manager.go:244] "Starting to sync pod status with apiserver"
Sep 08 15:32:20.107163 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.107160    2579 kubelet.go:2448] "Starting kubelet main sync loop"
Sep 08 15:32:20.107245 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.107209    2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Sep 08 15:32:20.109927 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.109908    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:32:20.142264 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.142228    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:32:20.143298 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.143281    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:32:20.143369 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.143310    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:32:20.143369 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.143321    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:32:20.143369 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.143351    2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.153152 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.153099    2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.153152 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.153127    2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-78.ec2.internal\": node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.187265 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.187236    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.207916 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.207877    2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal"]
Sep 08 15:32:20.208035 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.207976    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:32:20.209540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.209518    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:32:20.209622 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.209544    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:32:20.209622 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.209553    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:32:20.211801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.211788    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:32:20.211907 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.211893    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.211953 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.211921    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:32:20.212538 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.212523    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:32:20.212598 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.212544    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:32:20.212598 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.212554    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:32:20.212695 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.212599    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:32:20.212695 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.212625    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:32:20.212695 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.212641    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:32:20.214855 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.214838    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.214941 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.214871    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:32:20.215627 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.215609    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:32:20.215696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.215637    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:32:20.215696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.215646    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:32:20.228594 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.228574    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-78.ec2.internal\" not found" node="ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.232038 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.232023    2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-78.ec2.internal\" not found" node="ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.277043 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.277003    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/818533e6f13755cf38d319bb95c21d55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal\" (UID: \"818533e6f13755cf38d319bb95c21d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.277043 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.277041    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/818533e6f13755cf38d319bb95c21d55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal\" (UID: \"818533e6f13755cf38d319bb95c21d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.277258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.277057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d44a152144865d9e36334453185dfa67-config\") pod \"kube-apiserver-proxy-ip-10-0-134-78.ec2.internal\" (UID: \"d44a152144865d9e36334453185dfa67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.287693 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.287673    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.378086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.378050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/818533e6f13755cf38d319bb95c21d55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal\" (UID: \"818533e6f13755cf38d319bb95c21d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.378229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.378091    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/818533e6f13755cf38d319bb95c21d55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal\" (UID: \"818533e6f13755cf38d319bb95c21d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.378229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.378118    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d44a152144865d9e36334453185dfa67-config\") pod \"kube-apiserver-proxy-ip-10-0-134-78.ec2.internal\" (UID: \"d44a152144865d9e36334453185dfa67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.378229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.378190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/818533e6f13755cf38d319bb95c21d55-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal\" (UID: \"818533e6f13755cf38d319bb95c21d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.378348 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.378201    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/d44a152144865d9e36334453185dfa67-config\") pod \"kube-apiserver-proxy-ip-10-0-134-78.ec2.internal\" (UID: \"d44a152144865d9e36334453185dfa67\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.378348 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.378190    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/818533e6f13755cf38d319bb95c21d55-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal\" (UID: \"818533e6f13755cf38d319bb95c21d55\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.388133 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.388098    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.489056 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.488938    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.532101 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.532065    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.534138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.534116    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:20.590162 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.589993    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.690456 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.690428    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.790871 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.790814    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.819070 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.819053    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:32:20.891343 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.891317    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:20.924477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.924450    2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Sep 08 15:32:20.924836 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.924586    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 15:32:20.924836 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:20.924621    2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Sep 08 15:32:20.991596 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:20.991569    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:21.024980 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.024933    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-07 15:27:19 +0000 UTC" deadline="2028-04-15 10:49:29.167232203 +0000 UTC"
Sep 08 15:32:21.025099 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.024981    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14035h17m8.142255243s"
Sep 08 15:32:21.092499 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:21.092436    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:21.093514 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.093499    2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Sep 08 15:32:21.094734 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.094712    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientMemory"
Sep 08 15:32:21.094852 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.094748    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasNoDiskPressure"
Sep 08 15:32:21.094852 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.094762    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeHasSufficientPID"
Sep 08 15:32:21.170375 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:21.170345    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44a152144865d9e36334453185dfa67.slice/crio-a4d7cd63aff8616e6cdf197a3c4f89c12c36a71055dd8007e2bf2f7048b0092b WatchSource:0}: Error finding container a4d7cd63aff8616e6cdf197a3c4f89c12c36a71055dd8007e2bf2f7048b0092b: Status 404 returned error can't find the container with id a4d7cd63aff8616e6cdf197a3c4f89c12c36a71055dd8007e2bf2f7048b0092b
Sep 08 15:32:21.170892 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:21.170870    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod818533e6f13755cf38d319bb95c21d55.slice/crio-3e1866e5eea2ebaab5e7d02c15da39c48b6bc3eaec4dd266639d5bad4b34aa65 WatchSource:0}: Error finding container 3e1866e5eea2ebaab5e7d02c15da39c48b6bc3eaec4dd266639d5bad4b34aa65: Status 404 returned error can't find the container with id 3e1866e5eea2ebaab5e7d02c15da39c48b6bc3eaec4dd266639d5bad4b34aa65
Sep 08 15:32:21.175289 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.175268    2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:32:21.176529 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.176516    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:32:21.193545 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:21.193527    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:21.294016 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:21.293975    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:21.394514 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:21.394445    2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-134-78.ec2.internal\" not found"
Sep 08 15:32:21.488914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.488887    2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:32:21.573927 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.573891    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:21.585756 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.585728    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:32:21.586985 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.586917    2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal"
Sep 08 15:32:21.594930 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.594902    2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Sep 08 15:32:21.873778 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.873692    2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:32:21.959078 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.959048    2579 apiserver.go:52] "Watching apiserver"
Sep 08 15:32:21.966383 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.966361    2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Sep 08 15:32:21.966725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.966704    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-sg86p","openshift-multus/multus-g79rb","openshift-ovn-kubernetes/ovnkube-node-78wt9","kube-system/global-pull-secret-syncer-sms54","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg","openshift-cluster-node-tuning-operator/tuned-rk9np","openshift-dns/node-resolver-h28rz","openshift-multus/network-metrics-daemon-7ctjw","openshift-network-diagnostics/network-check-target-8bsws","openshift-network-operator/iptables-alerter-cwsdd","kube-system/konnectivity-agent-2bl57","kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal","openshift-image-registry/node-ca-snrjc","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal"]
Sep 08 15:32:21.969158 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.969138    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:21.971599 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.971581    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Sep 08 15:32:21.971689 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.971604    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Sep 08 15:32:21.971689 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.971679    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-89p88\""
Sep 08 15:32:21.978116 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.977696    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:21.978332 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.978303    2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Sep 08 15:32:21.979625 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.979604    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.980167 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.980149    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Sep 08 15:32:21.980366 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.980353    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7476w\""
Sep 08 15:32:21.980605 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.980589    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Sep 08 15:32:21.980704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.980689    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Sep 08 15:32:21.981772 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.981755    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:21.981850 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:21.981829    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:21.982496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.982479    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2fdcv\""
Sep 08 15:32:21.982746 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.982728    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Sep 08 15:32:21.982746 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.982742    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Sep 08 15:32:21.982880 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.982764    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Sep 08 15:32:21.982880 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.982851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Sep 08 15:32:21.982880 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.982873    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Sep 08 15:32:21.983022 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.982897    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Sep 08 15:32:21.984097 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.984055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:21.986337 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.986319    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Sep 08 15:32:21.986874 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.986857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:21.987237 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.987220    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Sep 08 15:32:21.987461 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.987405    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Sep 08 15:32:21.987594 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.987581    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-fjjbn\""
Sep 08 15:32:21.988171 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-systemd\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988231 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988184    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988231 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988208    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-env-overrides\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-kubelet\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988248    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-log-socket\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8stm5\" (UniqueName: \"kubernetes.io/projected/157b136a-9d8d-4374-aa00-9e2e945e12e9-kube-api-access-8stm5\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:21.988327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-systemd-units\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988297    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-slash\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-etc-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988357    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988413    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-host\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:21.988547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988436    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd87z\" (UniqueName: \"kubernetes.io/projected/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-kube-api-access-kd87z\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:21.988547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988467    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-node-log\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988498    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-run-ovn-kubernetes\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988529    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovnkube-config\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988561    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovnkube-script-lib\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988585    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pq49g\" (UniqueName: \"kubernetes.io/projected/143e1968-53a1-4a02-b0c3-a841ecaa2afd-kube-api-access-pq49g\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-cni-bin\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-run-netns\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-var-lib-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988705    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-ovn\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988730    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/157b136a-9d8d-4374-aa00-9e2e945e12e9-tmp-dir\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-serviceca\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988779    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-cni-netd\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988810    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovn-node-metrics-cert\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:21.988854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.988848    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/157b136a-9d8d-4374-aa00-9e2e945e12e9-hosts-file\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:21.989500 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.989481    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:21.989563 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:21.989549    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:21.989881 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.989863    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Sep 08 15:32:21.990908 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.990085    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-rfmfd\""
Sep 08 15:32:21.990908 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.990606    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:32:21.991241 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.991220    2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Sep 08 15:32:21.991593 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.991575    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:21.993398 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.993378    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g79rb"
Sep 08 15:32:21.994186 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.994095    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-smvfq\""
Sep 08 15:32:21.994186 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.994098    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Sep 08 15:32:21.994450 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.994402    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Sep 08 15:32:21.994644 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.994561    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Sep 08 15:32:21.994717 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.994637    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Sep 08 15:32:21.994921 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.994891    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Sep 08 15:32:21.996768 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.995642    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Sep 08 15:32:21.996768 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.995847    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:21.996768 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.996478    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-vzwmq\""
Sep 08 15:32:21.997513 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.997494    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:21.998149 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.998131    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Sep 08 15:32:21.998250 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.998214    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:32:21.998749 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.998731    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Sep 08 15:32:21.998878 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.998843    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-g45lg\""
Sep 08 15:32:21.999481 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.999300    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:21.999481 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:21.999378    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:21.999862 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.999837    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Sep 08 15:32:21.999862 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:21.999849    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Sep 08 15:32:22.000161 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.000146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sb9v8\""
Sep 08 15:32:22.043486 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.043449    2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-f2z74"
Sep 08 15:32:22.049438 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.049418    2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-f2z74"
Sep 08 15:32:22.076112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.076091    2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Sep 08 15:32:22.090019 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.089988    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-sys\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.090019 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-lib-modules\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.090233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090043    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:22.090233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090062    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-conf-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.090233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090084    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-multus-certs\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.090233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090104    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cqxpb\" (UniqueName: \"kubernetes.io/projected/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-kube-api-access-cqxpb\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.090233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090168    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/157b136a-9d8d-4374-aa00-9e2e945e12e9-hosts-file\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:22.090233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-systemd\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/157b136a-9d8d-4374-aa00-9e2e945e12e9-hosts-file\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:22.090233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090234    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-env-overrides\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090248    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-systemd\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090272    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxcqq\" (UniqueName: \"kubernetes.io/projected/3781875d-6d59-49ac-a0c6-f98fc520af7d-kube-api-access-bxcqq\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090296    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-socket-dir-parent\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090328    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-netns\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-hostroot\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090435    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-log-socket\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64661b07-5e5d-4f6c-bcf3-d77316769cfd-kubelet-config\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090499    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-log-socket\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-cni-bin\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.090561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090560    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8stm5\" (UniqueName: \"kubernetes.io/projected/157b136a-9d8d-4374-aa00-9e2e945e12e9-kube-api-access-8stm5\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090584    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090655    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-host\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090679    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd87z\" (UniqueName: \"kubernetes.io/projected/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-kube-api-access-kd87z\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-run-ovn-kubernetes\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovnkube-script-lib\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pq49g\" (UniqueName: \"kubernetes.io/projected/143e1968-53a1-4a02-b0c3-a841ecaa2afd-kube-api-access-pq49g\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9f914ab-e624-4504-9680-436b9c127d8e-agent-certs\") pod \"konnectivity-agent-2bl57\" (UID: \"a9f914ab-e624-4504-9680-436b9c127d8e\") " pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-env-overrides\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090799    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-systemd\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-cni-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-host\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:22.090876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090885    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-run-ovn-kubernetes\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.090971    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-cni-bin\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-run\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-cni-bin\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091088    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-cni-binary-copy\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-cni-multus\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091146    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-kubelet\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091171    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-run-netns\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmcv8\" (UniqueName: \"kubernetes.io/projected/e57501c8-ac9f-4925-9bd7-065567aaecb9-kube-api-access-lmcv8\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-daemon-config\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/157b136a-9d8d-4374-aa00-9e2e945e12e9-tmp-dir\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091245    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-run-netns\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091263    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-serviceca\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091305    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysconfig\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091321    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovnkube-script-lib\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091325    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-system-cni-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.091370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-etc-kubernetes\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091387    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9f914ab-e624-4504-9680-436b9c127d8e-konnectivity-ca\") pod \"konnectivity-agent-2bl57\" (UID: \"a9f914ab-e624-4504-9680-436b9c127d8e\") " pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091409    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091430    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-modprobe-d\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091466    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysctl-d\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091497    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/157b136a-9d8d-4374-aa00-9e2e945e12e9-tmp-dir\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091505    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64661b07-5e5d-4f6c-bcf3-d77316769cfd-dbus\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091536    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s5z54\" (UniqueName: \"kubernetes.io/projected/11eccf64-cc14-4b74-bec1-2095cb7e6862-kube-api-access-s5z54\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091609    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-serviceca\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091696    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-kubelet\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091718    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55lgm\" (UniqueName: \"kubernetes.io/projected/979e19fc-7472-443b-90b7-e00a65490417-kube-api-access-55lgm\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091736    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-device-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.092082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091756    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysctl-conf\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091777    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-kubelet\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-cnibin\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091822    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-systemd-units\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091839    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-slash\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-etc-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-systemd-units\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-etc-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-slash\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091921    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/979e19fc-7472-443b-90b7-e00a65490417-host-slash\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-socket-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091981    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.091996    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-tuned\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092028    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-node-log\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092061    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-node-log\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092077    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovnkube-config\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092097    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-var-lib-kubelet\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.092679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-kubernetes\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092162    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11eccf64-cc14-4b74-bec1-2095cb7e6862-tmp\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092204    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092228    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-cnibin\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092254    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-var-lib-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092270    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-ovn\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092296    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-run-ovn\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092303    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-var-lib-openvswitch\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092310    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxnqp\" (UniqueName: \"kubernetes.io/projected/1545a607-e922-4781-af5d-4e80d497ffc1-kube-api-access-dxnqp\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092338    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-sys-fs\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092371    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-system-cni-dir\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-cni-netd\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092443    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/143e1968-53a1-4a02-b0c3-a841ecaa2afd-host-cni-netd\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovn-node-metrics-cert\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.093328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092478    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/979e19fc-7472-443b-90b7-e00a65490417-iptables-alerter-script\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.093985 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092504    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-registration-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.093985 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-host\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.093985 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092544    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-k8s-cni-cncf-io\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.093985 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovnkube-config\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.093985 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.092856    2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Sep 08 15:32:22.096234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.096216    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/143e1968-53a1-4a02-b0c3-a841ecaa2afd-ovn-node-metrics-cert\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.102471 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.102449    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd87z\" (UniqueName: \"kubernetes.io/projected/e7b3c4b8-fdd1-4e92-b20b-3690484981ae-kube-api-access-kd87z\") pod \"node-ca-snrjc\" (UID: \"e7b3c4b8-fdd1-4e92-b20b-3690484981ae\") " pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:22.102715 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.102691    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pq49g\" (UniqueName: \"kubernetes.io/projected/143e1968-53a1-4a02-b0c3-a841ecaa2afd-kube-api-access-pq49g\") pod \"ovnkube-node-78wt9\" (UID: \"143e1968-53a1-4a02-b0c3-a841ecaa2afd\") " pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.102823 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.102757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8stm5\" (UniqueName: \"kubernetes.io/projected/157b136a-9d8d-4374-aa00-9e2e945e12e9-kube-api-access-8stm5\") pod \"node-resolver-h28rz\" (UID: \"157b136a-9d8d-4374-aa00-9e2e945e12e9\") " pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:22.111350 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.111301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal" event={"ID":"818533e6f13755cf38d319bb95c21d55","Type":"ContainerStarted","Data":"3e1866e5eea2ebaab5e7d02c15da39c48b6bc3eaec4dd266639d5bad4b34aa65"}
Sep 08 15:32:22.112585 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.112563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal" event={"ID":"d44a152144865d9e36334453185dfa67","Type":"ContainerStarted","Data":"a4d7cd63aff8616e6cdf197a3c4f89c12c36a71055dd8007e2bf2f7048b0092b"}
Sep 08 15:32:22.193060 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.192969    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxnqp\" (UniqueName: \"kubernetes.io/projected/1545a607-e922-4781-af5d-4e80d497ffc1-kube-api-access-dxnqp\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:22.193060 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193009    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-sys-fs\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.193060 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-system-cni-dir\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.193060 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/979e19fc-7472-443b-90b7-e00a65490417-iptables-alerter-script\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193072    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-registration-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-host\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193116    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-k8s-cni-cncf-io\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193136    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-sys\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193157    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-lib-modules\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193164    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-system-cni-dir\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193179    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-registration-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193189    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-host\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193181    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193223    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-k8s-cni-cncf-io\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-conf-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193244    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-sys-fs\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193251    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-sys\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193268    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-multus-certs\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193293    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cqxpb\" (UniqueName: \"kubernetes.io/projected/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-kube-api-access-cqxpb\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193321    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxcqq\" (UniqueName: \"kubernetes.io/projected/3781875d-6d59-49ac-a0c6-f98fc520af7d-kube-api-access-bxcqq\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.193394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-conf-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-socket-dir-parent\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193362    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-lib-modules\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193323    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-multus-certs\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193400    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-netns\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193368    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-run-netns\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193458    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-hostroot\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64661b07-5e5d-4f6c-bcf3-d77316769cfd-kubelet-config\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193525    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-cni-bin\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193531    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-socket-dir-parent\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193564    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/64661b07-5e5d-4f6c-bcf3-d77316769cfd-kubelet-config\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193571    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-cni-bin\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193574    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9f914ab-e624-4504-9680-436b9c127d8e-agent-certs\") pod \"konnectivity-agent-2bl57\" (UID: \"a9f914ab-e624-4504-9680-436b9c127d8e\") " pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193488    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-hostroot\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193603    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-systemd\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193632    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-cni-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193662    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-run\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-systemd\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.194188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193688    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-cni-binary-copy\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193714    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-cni-multus\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193740    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-kubelet\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193747    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/979e19fc-7472-443b-90b7-e00a65490417-iptables-alerter-script\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193767    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-cni-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193768    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmcv8\" (UniqueName: \"kubernetes.io/projected/e57501c8-ac9f-4925-9bd7-065567aaecb9-kube-api-access-lmcv8\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-run\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-daemon-config\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193838    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysconfig\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193853    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-system-cni-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-etc-kubernetes\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9f914ab-e624-4504-9680-436b9c127d8e-konnectivity-ca\") pod \"konnectivity-agent-2bl57\" (UID: \"a9f914ab-e624-4504-9680-436b9c127d8e\") " pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193903    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysconfig\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193926    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-kubelet\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193951    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-host-var-lib-cni-multus\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193952    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-modprobe-d\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194002    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysctl-d\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194027    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64661b07-5e5d-4f6c-bcf3-d77316769cfd-dbus\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-system-cni-dir\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.193924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194055    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s5z54\" (UniqueName: \"kubernetes.io/projected/11eccf64-cc14-4b74-bec1-2095cb7e6862-kube-api-access-s5z54\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194147    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.194166    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194177    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55lgm\" (UniqueName: \"kubernetes.io/projected/979e19fc-7472-443b-90b7-e00a65490417-kube-api-access-55lgm\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-device-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysctl-conf\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-modprobe-d\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.194246    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs podName:1545a607-e922-4781-af5d-4e80d497ffc1 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:22.694223222 +0000 UTC m=+3.054765989 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs") pod "network-metrics-daemon-7ctjw" (UID: "1545a607-e922-4781-af5d-4e80d497ffc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-cni-binary-copy\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-etc-kubernetes\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysctl-conf\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194358    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-multus-daemon-config\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.195854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194390    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/64661b07-5e5d-4f6c-bcf3-d77316769cfd-dbus\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194419    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.194428    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194447    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-cnibin\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.194487    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret podName:64661b07-5e5d-4f6c-bcf3-d77316769cfd nodeName:}" failed. No retries permitted until 2026-09-08 15:32:22.694469874 +0000 UTC m=+3.055012631 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret") pod "global-pull-secret-syncer-sms54" (UID: "64661b07-5e5d-4f6c-bcf3-d77316769cfd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194523    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/979e19fc-7472-443b-90b7-e00a65490417-host-slash\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-sysctl-d\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194550    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-socket-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194559    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/979e19fc-7472-443b-90b7-e00a65490417-host-slash\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194521    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/a9f914ab-e624-4504-9680-436b9c127d8e-konnectivity-ca\") pod \"konnectivity-agent-2bl57\" (UID: \"a9f914ab-e624-4504-9680-436b9c127d8e\") " pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194574    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3781875d-6d59-49ac-a0c6-f98fc520af7d-cnibin\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194576    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194667    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-etc-selinux\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194676    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-tuned\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-socket-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194710    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-var-lib-kubelet\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194737    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.196453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-kubernetes\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194771    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-var-lib-kubelet\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194711    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e57501c8-ac9f-4925-9bd7-065567aaecb9-device-dir\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194841    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-kubernetes\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11eccf64-cc14-4b74-bec1-2095cb7e6862-tmp\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194934    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.194981    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-cnibin\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.195062    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-cnibin\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.195338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-cni-binary-copy\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.195553    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.195817    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3781875d-6d59-49ac-a0c6-f98fc520af7d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.196369    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/a9f914ab-e624-4504-9680-436b9c127d8e-agent-certs\") pod \"konnectivity-agent-2bl57\" (UID: \"a9f914ab-e624-4504-9680-436b9c127d8e\") " pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.196928    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/11eccf64-cc14-4b74-bec1-2095cb7e6862-tmp\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.197145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.197019    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/11eccf64-cc14-4b74-bec1-2095cb7e6862-etc-tuned\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.201222 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.201202    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:32:22.201341 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.201224    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:32:22.201341 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.201240    2579 projected.go:196] Error preparing data for projected volume kube-api-access-6x4jj for pod openshift-network-diagnostics/network-check-target-8bsws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:22.201341 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.201308    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj podName:61a9a956-b2e6-4566-aa72-6f24280f2717 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:22.701289626 +0000 UTC m=+3.061832371 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6x4jj" (UniqueName: "kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj") pod "network-check-target-8bsws" (UID: "61a9a956-b2e6-4566-aa72-6f24280f2717") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:22.202393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.202371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxnqp\" (UniqueName: \"kubernetes.io/projected/1545a607-e922-4781-af5d-4e80d497ffc1-kube-api-access-dxnqp\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:22.203869 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.203734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55lgm\" (UniqueName: \"kubernetes.io/projected/979e19fc-7472-443b-90b7-e00a65490417-kube-api-access-55lgm\") pod \"iptables-alerter-cwsdd\" (UID: \"979e19fc-7472-443b-90b7-e00a65490417\") " pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.206172 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.206145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s5z54\" (UniqueName: \"kubernetes.io/projected/11eccf64-cc14-4b74-bec1-2095cb7e6862-kube-api-access-s5z54\") pod \"tuned-rk9np\" (UID: \"11eccf64-cc14-4b74-bec1-2095cb7e6862\") " pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.206452 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.206432    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cqxpb\" (UniqueName: \"kubernetes.io/projected/8dea2c94-a3f2-4dbe-b27f-8eb8745980ae-kube-api-access-cqxpb\") pod \"multus-g79rb\" (UID: \"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae\") " pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.206524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.206450    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmcv8\" (UniqueName: \"kubernetes.io/projected/e57501c8-ac9f-4925-9bd7-065567aaecb9-kube-api-access-lmcv8\") pod \"aws-ebs-csi-driver-node-gz8jg\" (UID: \"e57501c8-ac9f-4925-9bd7-065567aaecb9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.206524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.206454    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxcqq\" (UniqueName: \"kubernetes.io/projected/3781875d-6d59-49ac-a0c6-f98fc520af7d-kube-api-access-bxcqq\") pod \"multus-additional-cni-plugins-sg86p\" (UID: \"3781875d-6d59-49ac-a0c6-f98fc520af7d\") " pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.281633 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.281595    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-h28rz"
Sep 08 15:32:22.291575 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.291548    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-snrjc"
Sep 08 15:32:22.302494 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.302468    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:22.308323 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.308299    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg"
Sep 08 15:32:22.318067 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.318041    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rk9np"
Sep 08 15:32:22.323725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.323705    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-sg86p"
Sep 08 15:32:22.330451 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.330428    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-g79rb"
Sep 08 15:32:22.339067 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.339045    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-cwsdd"
Sep 08 15:32:22.344674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.344651    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:22.698680 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.698645    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:22.698864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.698691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:22.698864 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.698807    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:22.698998 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.698876    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs podName:1545a607-e922-4781-af5d-4e80d497ffc1 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:23.69886039 +0000 UTC m=+4.059403132 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs") pod "network-metrics-daemon-7ctjw" (UID: "1545a607-e922-4781-af5d-4e80d497ffc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:22.698998 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.698808    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:22.698998 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.698988    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret podName:64661b07-5e5d-4f6c-bcf3-d77316769cfd nodeName:}" failed. No retries permitted until 2026-09-08 15:32:23.698952503 +0000 UTC m=+4.059495250 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret") pod "global-pull-secret-syncer-sms54" (UID: "64661b07-5e5d-4f6c-bcf3-d77316769cfd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:22.799146 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:22.799109    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:22.799355 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.799299    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:32:22.799355 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.799323    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:32:22.799355 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.799337    2579 projected.go:196] Error preparing data for projected volume kube-api-access-6x4jj for pod openshift-network-diagnostics/network-check-target-8bsws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:22.799482 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:22.799396    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj podName:61a9a956-b2e6-4566-aa72-6f24280f2717 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:23.799381902 +0000 UTC m=+4.159924656 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x4jj" (UniqueName: "kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj") pod "network-check-target-8bsws" (UID: "61a9a956-b2e6-4566-aa72-6f24280f2717") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:22.947516 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.947476    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode57501c8_ac9f_4925_9bd7_065567aaecb9.slice/crio-022dd1d05c3b6287bd19b208f54f5bff4fa2d3611d2fefadb4f1898f89134d07 WatchSource:0}: Error finding container 022dd1d05c3b6287bd19b208f54f5bff4fa2d3611d2fefadb4f1898f89134d07: Status 404 returned error can't find the container with id 022dd1d05c3b6287bd19b208f54f5bff4fa2d3611d2fefadb4f1898f89134d07
Sep 08 15:32:22.948654 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.948627    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7b3c4b8_fdd1_4e92_b20b_3690484981ae.slice/crio-706a1e400594f81e72a7040159e4aa3bc322fbc397cdc04981629e2f9d5cc9bb WatchSource:0}: Error finding container 706a1e400594f81e72a7040159e4aa3bc322fbc397cdc04981629e2f9d5cc9bb: Status 404 returned error can't find the container with id 706a1e400594f81e72a7040159e4aa3bc322fbc397cdc04981629e2f9d5cc9bb
Sep 08 15:32:22.949572 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.949352    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3781875d_6d59_49ac_a0c6_f98fc520af7d.slice/crio-5791254ef033618676278aa05bd488bfbaa6615c4944273a9027f608b7e14f43 WatchSource:0}: Error finding container 5791254ef033618676278aa05bd488bfbaa6615c4944273a9027f608b7e14f43: Status 404 returned error can't find the container with id 5791254ef033618676278aa05bd488bfbaa6615c4944273a9027f608b7e14f43
Sep 08 15:32:22.952260 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.952206    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dea2c94_a3f2_4dbe_b27f_8eb8745980ae.slice/crio-666d4e5fca9bcaf359d5ec18543acff41783f1ff841eb77be070d7d30a7e38fd WatchSource:0}: Error finding container 666d4e5fca9bcaf359d5ec18543acff41783f1ff841eb77be070d7d30a7e38fd: Status 404 returned error can't find the container with id 666d4e5fca9bcaf359d5ec18543acff41783f1ff841eb77be070d7d30a7e38fd
Sep 08 15:32:22.973714 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.973682    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod979e19fc_7472_443b_90b7_e00a65490417.slice/crio-19e69ea1412188b78c8ad312d3e6baafe96ea42a56e74e06677f8c906881d1aa WatchSource:0}: Error finding container 19e69ea1412188b78c8ad312d3e6baafe96ea42a56e74e06677f8c906881d1aa: Status 404 returned error can't find the container with id 19e69ea1412188b78c8ad312d3e6baafe96ea42a56e74e06677f8c906881d1aa
Sep 08 15:32:22.974562 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.974493    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11eccf64_cc14_4b74_bec1_2095cb7e6862.slice/crio-e28fad2c2c1017aa53fa02c0d146323546b19d4a1da00550b9b1158e8835e6f9 WatchSource:0}: Error finding container e28fad2c2c1017aa53fa02c0d146323546b19d4a1da00550b9b1158e8835e6f9: Status 404 returned error can't find the container with id e28fad2c2c1017aa53fa02c0d146323546b19d4a1da00550b9b1158e8835e6f9
Sep 08 15:32:22.975666 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.975644    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod143e1968_53a1_4a02_b0c3_a841ecaa2afd.slice/crio-336de97ffc8887fee786711c85ea70ec83eae8cef24eb844aca9b0d40117b9b0 WatchSource:0}: Error finding container 336de97ffc8887fee786711c85ea70ec83eae8cef24eb844aca9b0d40117b9b0: Status 404 returned error can't find the container with id 336de97ffc8887fee786711c85ea70ec83eae8cef24eb844aca9b0d40117b9b0
Sep 08 15:32:22.976436 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.976285    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f914ab_e624_4504_9680_436b9c127d8e.slice/crio-723a8d705741e214d96996823b47ae8170703d1b6f297deaaf454136683f1252 WatchSource:0}: Error finding container 723a8d705741e214d96996823b47ae8170703d1b6f297deaaf454136683f1252: Status 404 returned error can't find the container with id 723a8d705741e214d96996823b47ae8170703d1b6f297deaaf454136683f1252
Sep 08 15:32:22.978496 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:22.978137    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod157b136a_9d8d_4374_aa00_9e2e945e12e9.slice/crio-e6505af24c407143b8ac89bebd03c8f98d65703c3150b9ac0ca567fc5794ab25 WatchSource:0}: Error finding container e6505af24c407143b8ac89bebd03c8f98d65703c3150b9ac0ca567fc5794ab25: Status 404 returned error can't find the container with id e6505af24c407143b8ac89bebd03c8f98d65703c3150b9ac0ca567fc5794ab25
Sep 08 15:32:23.051533 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.051503    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:27:22 +0000 UTC" deadline="2028-04-21 20:37:22.252807425 +0000 UTC"
Sep 08 15:32:23.051533 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.051531    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14189h4m59.201279317s"
Sep 08 15:32:23.115769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.115732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h28rz" event={"ID":"157b136a-9d8d-4374-aa00-9e2e945e12e9","Type":"ContainerStarted","Data":"e6505af24c407143b8ac89bebd03c8f98d65703c3150b9ac0ca567fc5794ab25"}
Sep 08 15:32:23.116866 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.116837    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2bl57" event={"ID":"a9f914ab-e624-4504-9680-436b9c127d8e","Type":"ContainerStarted","Data":"723a8d705741e214d96996823b47ae8170703d1b6f297deaaf454136683f1252"}
Sep 08 15:32:23.117951 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.117930    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"336de97ffc8887fee786711c85ea70ec83eae8cef24eb844aca9b0d40117b9b0"}
Sep 08 15:32:23.119003 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.118952    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g79rb" event={"ID":"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae","Type":"ContainerStarted","Data":"666d4e5fca9bcaf359d5ec18543acff41783f1ff841eb77be070d7d30a7e38fd"}
Sep 08 15:32:23.123018 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.122994    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg86p" event={"ID":"3781875d-6d59-49ac-a0c6-f98fc520af7d","Type":"ContainerStarted","Data":"5791254ef033618676278aa05bd488bfbaa6615c4944273a9027f608b7e14f43"}
Sep 08 15:32:23.124317 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.124298    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-snrjc" event={"ID":"e7b3c4b8-fdd1-4e92-b20b-3690484981ae","Type":"ContainerStarted","Data":"706a1e400594f81e72a7040159e4aa3bc322fbc397cdc04981629e2f9d5cc9bb"}
Sep 08 15:32:23.126258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.126224    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal" event={"ID":"d44a152144865d9e36334453185dfa67","Type":"ContainerStarted","Data":"407a75fd3d642679c8ea96bab886c7213b43767fec6be4747ad5831a7c1a449b"}
Sep 08 15:32:23.127395 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.127368    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rk9np" event={"ID":"11eccf64-cc14-4b74-bec1-2095cb7e6862","Type":"ContainerStarted","Data":"e28fad2c2c1017aa53fa02c0d146323546b19d4a1da00550b9b1158e8835e6f9"}
Sep 08 15:32:23.128412 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.128394    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg" event={"ID":"e57501c8-ac9f-4925-9bd7-065567aaecb9","Type":"ContainerStarted","Data":"022dd1d05c3b6287bd19b208f54f5bff4fa2d3611d2fefadb4f1898f89134d07"}
Sep 08 15:32:23.129507 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.129484    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cwsdd" event={"ID":"979e19fc-7472-443b-90b7-e00a65490417","Type":"ContainerStarted","Data":"19e69ea1412188b78c8ad312d3e6baafe96ea42a56e74e06677f8c906881d1aa"}
Sep 08 15:32:23.140229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.140186    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-78.ec2.internal" podStartSLOduration=2.14017379 podStartE2EDuration="2.14017379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:23.139939687 +0000 UTC m=+3.500482453" watchObservedRunningTime="2026-09-08 15:32:23.14017379 +0000 UTC m=+3.500716555"
Sep 08 15:32:23.707401 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.706115    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:23.707401 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.706408    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:23.707401 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:23.706602    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:23.707401 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:23.706665    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret podName:64661b07-5e5d-4f6c-bcf3-d77316769cfd nodeName:}" failed. No retries permitted until 2026-09-08 15:32:25.706646703 +0000 UTC m=+6.067189449 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret") pod "global-pull-secret-syncer-sms54" (UID: "64661b07-5e5d-4f6c-bcf3-d77316769cfd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:23.707401 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:23.707080    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:23.707401 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:23.707134    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs podName:1545a607-e922-4781-af5d-4e80d497ffc1 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:25.707116187 +0000 UTC m=+6.067658931 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs") pod "network-metrics-daemon-7ctjw" (UID: "1545a607-e922-4781-af5d-4e80d497ffc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:23.797701 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.797462    2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Sep 08 15:32:23.807573 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:23.806941    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:23.807573 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:23.807139    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:32:23.807573 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:23.807161    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:32:23.807573 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:23.807175    2579 projected.go:196] Error preparing data for projected volume kube-api-access-6x4jj for pod openshift-network-diagnostics/network-check-target-8bsws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:23.807573 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:23.807237    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj podName:61a9a956-b2e6-4566-aa72-6f24280f2717 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:25.807218655 +0000 UTC m=+6.167761401 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x4jj" (UniqueName: "kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj") pod "network-check-target-8bsws" (UID: "61a9a956-b2e6-4566-aa72-6f24280f2717") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:24.051867 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:24.051694    2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-07 15:27:22 +0000 UTC" deadline="2028-05-23 04:05:30.252557434 +0000 UTC"
Sep 08 15:32:24.051867 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:24.051753    2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14940h33m6.200808442s"
Sep 08 15:32:24.108382 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:24.108346    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:24.108602 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:24.108494    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:24.108899 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:24.108877    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:24.109377 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:24.108993    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:24.109377 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:24.109056    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:24.109377 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:24.109126    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:24.156440 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:24.156402    2579 generic.go:356] "Generic (PLEG): container finished" podID="818533e6f13755cf38d319bb95c21d55" containerID="99648e6e1146a1f3290ea0a40f75c26b9bdb7e7fc8f27082196575958349a2ed" exitCode=0
Sep 08 15:32:24.157220 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:24.157192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal" event={"ID":"818533e6f13755cf38d319bb95c21d55","Type":"ContainerDied","Data":"99648e6e1146a1f3290ea0a40f75c26b9bdb7e7fc8f27082196575958349a2ed"}
Sep 08 15:32:25.193166 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:25.193073    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal" event={"ID":"818533e6f13755cf38d319bb95c21d55","Type":"ContainerStarted","Data":"f9bf9b0a5a0ee25be0b558e85d239e1e565a3bb344db45bf802b442b2d0ebf05"}
Sep 08 15:32:25.208903 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:25.208840    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-78.ec2.internal" podStartSLOduration=4.208819044 podStartE2EDuration="4.208819044s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:25.207833385 +0000 UTC m=+5.568376153" watchObservedRunningTime="2026-09-08 15:32:25.208819044 +0000 UTC m=+5.569361810"
Sep 08 15:32:25.723948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:25.723684    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:25.723948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:25.723803    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:25.723948 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:25.723868    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:25.723948 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:25.723899    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:25.723948 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:25.723945    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret podName:64661b07-5e5d-4f6c-bcf3-d77316769cfd nodeName:}" failed. No retries permitted until 2026-09-08 15:32:29.72392521 +0000 UTC m=+10.084467970 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret") pod "global-pull-secret-syncer-sms54" (UID: "64661b07-5e5d-4f6c-bcf3-d77316769cfd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:25.724263 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:25.723979    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs podName:1545a607-e922-4781-af5d-4e80d497ffc1 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:29.723955561 +0000 UTC m=+10.084498306 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs") pod "network-metrics-daemon-7ctjw" (UID: "1545a607-e922-4781-af5d-4e80d497ffc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:25.825072 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:25.825035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:25.825265 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:25.825200    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:32:25.825265 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:25.825221    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:32:25.825265 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:25.825232    2579 projected.go:196] Error preparing data for projected volume kube-api-access-6x4jj for pod openshift-network-diagnostics/network-check-target-8bsws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:25.825471 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:25.825290    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj podName:61a9a956-b2e6-4566-aa72-6f24280f2717 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:29.825271501 +0000 UTC m=+10.185814263 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x4jj" (UniqueName: "kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj") pod "network-check-target-8bsws" (UID: "61a9a956-b2e6-4566-aa72-6f24280f2717") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:26.108460 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:26.108374    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:26.108634 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:26.108526    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:26.108634 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:26.108591    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:26.108736 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:26.108657    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:26.108736 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:26.108702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:26.108833 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:26.108767    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:28.108460 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:28.108420    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:28.108973 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:28.108546    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:28.108973 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:28.108938    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:28.109147 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:28.109110    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:28.109253 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:28.109172    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:28.109253 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:28.109242    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:29.758330 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:29.758278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:29.758825 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:29.758344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:29.758825 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:29.758435    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:29.758825 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:29.758512    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs podName:1545a607-e922-4781-af5d-4e80d497ffc1 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:37.758490931 +0000 UTC m=+18.119033676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs") pod "network-metrics-daemon-7ctjw" (UID: "1545a607-e922-4781-af5d-4e80d497ffc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:29.758825 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:29.758546    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:29.758825 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:29.758602    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret podName:64661b07-5e5d-4f6c-bcf3-d77316769cfd nodeName:}" failed. No retries permitted until 2026-09-08 15:32:37.758584482 +0000 UTC m=+18.119127231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret") pod "global-pull-secret-syncer-sms54" (UID: "64661b07-5e5d-4f6c-bcf3-d77316769cfd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:29.859204 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:29.859137    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:29.859378 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:29.859324    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:32:29.859378 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:29.859353    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:32:29.859378 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:29.859369    2579 projected.go:196] Error preparing data for projected volume kube-api-access-6x4jj for pod openshift-network-diagnostics/network-check-target-8bsws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:29.859566 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:29.859434    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj podName:61a9a956-b2e6-4566-aa72-6f24280f2717 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:37.859415066 +0000 UTC m=+18.219957826 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x4jj" (UniqueName: "kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj") pod "network-check-target-8bsws" (UID: "61a9a956-b2e6-4566-aa72-6f24280f2717") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:30.107935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:30.107848    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:30.108117 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:30.107986    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:30.108117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:30.108085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:30.108117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:30.108085    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:30.109075 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:30.109040    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:30.109200 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:30.109176    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:32.108232 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:32.108197    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:32.108641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:32.108204    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:32.108641 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:32.108316    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:32.108641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:32.108207    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:32.108641 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:32.108388    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:32.108641 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:32.108465    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:34.107461 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:34.107375    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:34.107461 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:34.107399    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:34.107461 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:34.107415    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:34.108102 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:34.107500    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:34.108102 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:34.107573    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:34.108102 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:34.107645    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:36.113301 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:36.113263    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:36.113781 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:36.113279    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:36.113781 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:36.113383    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:36.113781 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:36.113414    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:36.113781 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:36.113510    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:36.113781 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:36.113577    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:37.819916 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:37.819878    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:37.820464 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:37.819951    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:37.820464 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:37.820061    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:37.820464 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:37.820128    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret podName:64661b07-5e5d-4f6c-bcf3-d77316769cfd nodeName:}" failed. No retries permitted until 2026-09-08 15:32:53.820113074 +0000 UTC m=+34.180655816 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret") pod "global-pull-secret-syncer-sms54" (UID: "64661b07-5e5d-4f6c-bcf3-d77316769cfd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:37.820464 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:37.820067    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:37.820464 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:37.820243    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs podName:1545a607-e922-4781-af5d-4e80d497ffc1 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:53.82021995 +0000 UTC m=+34.180762724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs") pod "network-metrics-daemon-7ctjw" (UID: "1545a607-e922-4781-af5d-4e80d497ffc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:37.920342 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:37.920300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:37.920536 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:37.920501    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:32:37.920536 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:37.920532    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:32:37.920714 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:37.920545    2579 projected.go:196] Error preparing data for projected volume kube-api-access-6x4jj for pod openshift-network-diagnostics/network-check-target-8bsws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:37.920714 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:37.920613    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj podName:61a9a956-b2e6-4566-aa72-6f24280f2717 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:53.920590885 +0000 UTC m=+34.281133631 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x4jj" (UniqueName: "kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj") pod "network-check-target-8bsws" (UID: "61a9a956-b2e6-4566-aa72-6f24280f2717") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:38.107668 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:38.107630    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:38.107847 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:38.107634    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:38.107847 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:38.107634    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:38.107847 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:38.107773    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:38.107997 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:38.107890    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:38.108055 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:38.108024    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:40.108639 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:40.108602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:40.109198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:40.108695    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:40.109198 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:40.108741    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:40.109198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:40.108706    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:40.109198 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:40.108802    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:40.109198 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:40.108906    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:41.226206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.225899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-g79rb" event={"ID":"8dea2c94-a3f2-4dbe-b27f-8eb8745980ae","Type":"ContainerStarted","Data":"b2a8c57cd159aaaf0e7804ada7993784829cfb18fa5cd9679151b1b3cddfbd43"}
Sep 08 15:32:41.227594 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.227571    2579 generic.go:356] "Generic (PLEG): container finished" podID="3781875d-6d59-49ac-a0c6-f98fc520af7d" containerID="a3abbf6d46fd3ba0707bf16df9abf045daef36eec2ee96f33bb743bb66cab56d" exitCode=0
Sep 08 15:32:41.227705 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.227639    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg86p" event={"ID":"3781875d-6d59-49ac-a0c6-f98fc520af7d","Type":"ContainerDied","Data":"a3abbf6d46fd3ba0707bf16df9abf045daef36eec2ee96f33bb743bb66cab56d"}
Sep 08 15:32:41.229146 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.229104    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-snrjc" event={"ID":"e7b3c4b8-fdd1-4e92-b20b-3690484981ae","Type":"ContainerStarted","Data":"ca90fe5b611155791bca01c09aa3942ace02979b401ced8cebe86262dd5df4da"}
Sep 08 15:32:41.230999 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.230715    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rk9np" event={"ID":"11eccf64-cc14-4b74-bec1-2095cb7e6862","Type":"ContainerStarted","Data":"15f0c3e13a359b3b6f0de5862d1b004e2f61ae94b8146cba3069a0a311577124"}
Sep 08 15:32:41.236365 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.236341    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg" event={"ID":"e57501c8-ac9f-4925-9bd7-065567aaecb9","Type":"ContainerStarted","Data":"34708f2f950061a81d7dd0f765cf18685b5b60270467ccad942518b53e509bfd"}
Sep 08 15:32:41.237800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.237775    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-h28rz" event={"ID":"157b136a-9d8d-4374-aa00-9e2e945e12e9","Type":"ContainerStarted","Data":"4c819580ed3d8e91dcae7ffce68fdd0991d6d055f3028beea39d4da8ee75ccbc"}
Sep 08 15:32:41.239327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.239302    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2bl57" event={"ID":"a9f914ab-e624-4504-9680-436b9c127d8e","Type":"ContainerStarted","Data":"29cd5b71243f52a5b0c34a027d0ba0eb031ed25635976462dcd67811df7a5a5d"}
Sep 08 15:32:41.242494 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.242468    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"c51d531dce58de2d4feb5966ed96a3a3e7cf9508d286170bfbfb3fb31948fbf9"}
Sep 08 15:32:41.242597 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.242537    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"d1cabda0c8173b933572a21510ca01c8f7bc4da2f8b3d73138b0c3adee075e7f"}
Sep 08 15:32:41.242597 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.242571    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"c5495d5ac054b17ede213424e8789020ff4fea9c736d0f1a8aee2a8a7f3c8aa4"}
Sep 08 15:32:41.242705 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.242606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"2b23567c613625ea46831a8a4bf8fcddbfa3836d32fe44dff9247c6ed7290167"}
Sep 08 15:32:41.242705 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.242635    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"db17f788fcd2ce9afae928921b5b69febc5ac7a95e6cf5c397836895e44a7d01"}
Sep 08 15:32:41.242705 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.242667    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"f41de359bbdf952c7af12707280eac6471b428ec6ec89d88ca3834aeeb674f7b"}
Sep 08 15:32:41.243485 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.243435    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-g79rb" podStartSLOduration=3.365678838 podStartE2EDuration="21.243417265s" totalImagesPullingTime="17.877738427s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:41.242736278 +0000 UTC m=+21.603279044" watchObservedRunningTime="2026-09-08 15:32:41.243417265 +0000 UTC m=+21.603960030"
Sep 08 15:32:41.256181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.256128    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-h28rz" podStartSLOduration=3.639536045 podStartE2EDuration="21.256110878s" totalImagesPullingTime="17.616574833s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:41.255853255 +0000 UTC m=+21.616396021" watchObservedRunningTime="2026-09-08 15:32:41.256110878 +0000 UTC m=+21.616653644"
Sep 08 15:32:41.272524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.272411    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rk9np" podStartSLOduration=3.652966138 podStartE2EDuration="21.272389318s" totalImagesPullingTime="17.61942318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:41.271770774 +0000 UTC m=+21.632313540" watchObservedRunningTime="2026-09-08 15:32:41.272389318 +0000 UTC m=+21.632932086"
Sep 08 15:32:41.334970 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:41.334904    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2bl57" podStartSLOduration=3.7307530829999997 podStartE2EDuration="21.334883367s" totalImagesPullingTime="17.604130284s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:41.317387127 +0000 UTC m=+21.677929936" watchObservedRunningTime="2026-09-08 15:32:41.334883367 +0000 UTC m=+21.695426135"
Sep 08 15:32:42.031178 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.031142    2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Sep 08 15:32:42.052728 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.052626    2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-08T15:32:42.031163155Z","UUID":"32111924-c70f-4413-aef1-be91b5d66580","Handler":null,"Name":"","Endpoint":""}
Sep 08 15:32:42.054218 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.054196    2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Sep 08 15:32:42.054323 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.054233    2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Sep 08 15:32:42.108092 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.108055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:42.108272 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:42.108201    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:42.108272 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.108053    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:42.108388 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:42.108300    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:42.108388 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.108055    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:42.108388 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:42.108370    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:42.247071 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.246953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg" event={"ID":"e57501c8-ac9f-4925-9bd7-065567aaecb9","Type":"ContainerStarted","Data":"070fccfa29873358fbb868f15fca1911e290740221000fe1908743fe5aca3f13"}
Sep 08 15:32:42.248725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.248694    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-cwsdd" event={"ID":"979e19fc-7472-443b-90b7-e00a65490417","Type":"ContainerStarted","Data":"e559b9c08a91154b7818fc99287980929fa46e7af5613108da1c4506e18962dc"}
Sep 08 15:32:42.263207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.263160    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-snrjc" podStartSLOduration=8.334500919 podStartE2EDuration="22.263143635s" totalImagesPullingTime="13.928642716s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:41.33435274 +0000 UTC m=+21.694895508" watchObservedRunningTime="2026-09-08 15:32:42.263143635 +0000 UTC m=+22.623686450"
Sep 08 15:32:42.263764 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:42.263724    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-cwsdd" podStartSLOduration=4.641154934 podStartE2EDuration="22.263714182s" totalImagesPullingTime="17.622559248s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:42.263094091 +0000 UTC m=+22.623636856" watchObservedRunningTime="2026-09-08 15:32:42.263714182 +0000 UTC m=+22.624256946"
Sep 08 15:32:43.254499 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:43.254465    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg" event={"ID":"e57501c8-ac9f-4925-9bd7-065567aaecb9","Type":"ContainerStarted","Data":"d45291453cce3c9e04a2d4dad116ecb139cb05d07ed181eb51372a7e5e0ad4bb"}
Sep 08 15:32:43.283615 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:43.283570    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-gz8jg" podStartSLOduration=3.461073041 podStartE2EDuration="23.283553527s" totalImagesPullingTime="19.822480486s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:43.283062321 +0000 UTC m=+23.643605087" watchObservedRunningTime="2026-09-08 15:32:43.283553527 +0000 UTC m=+23.644096337"
Sep 08 15:32:44.107824 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:44.107785    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:44.108039 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:44.107784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:44.108039 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:44.107916    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:44.108039 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:44.107784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:44.108039 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:44.108003    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:44.108210 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:44.108105    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:44.261248 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:44.261207    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"c8c8838b888e0ab0f584bed13d44149f3b298dab4025f73b664e99f22695511d"}
Sep 08 15:32:44.378311 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:44.378215    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:44.378856 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:44.378835    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:45.263948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:45.263915    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:45.264498 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:45.264480    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2bl57"
Sep 08 15:32:46.108154 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:46.107820    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:46.108154 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:46.107822    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:46.108154 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:46.108114    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:46.108488 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:46.107880    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:46.108488 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:46.108226    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:46.108488 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:46.108279    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:46.268814 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:46.268768    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" event={"ID":"143e1968-53a1-4a02-b0c3-a841ecaa2afd","Type":"ContainerStarted","Data":"3bf559f01d97c485c46b1ac55364f4f9840b06c562a4f539e305c97aa02a9d50"}
Sep 08 15:32:46.294534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:46.294481    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9" podStartSLOduration=8.641287089 podStartE2EDuration="26.294466338s" totalImagesPullingTime="17.653179249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:46.294082765 +0000 UTC m=+26.654625529" watchObservedRunningTime="2026-09-08 15:32:46.294466338 +0000 UTC m=+26.655009154"
Sep 08 15:32:47.276255 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:47.273752    2579 generic.go:356] "Generic (PLEG): container finished" podID="3781875d-6d59-49ac-a0c6-f98fc520af7d" containerID="0fc6f89cc1b707b2f3f40211346e9e0b5d2446894caa7783b71819670f7d2a98" exitCode=0
Sep 08 15:32:47.276255 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:47.275396    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg86p" event={"ID":"3781875d-6d59-49ac-a0c6-f98fc520af7d","Type":"ContainerDied","Data":"0fc6f89cc1b707b2f3f40211346e9e0b5d2446894caa7783b71819670f7d2a98"}
Sep 08 15:32:47.276255 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:47.275444    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:47.276255 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:47.275904    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:47.276255 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:47.275985    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:47.297492 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:47.297456    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:47.299075 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:47.299051    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:32:48.061375 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:48.061156    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sms54"]
Sep 08 15:32:48.061524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:48.061513    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:48.061634 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:48.061610    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:48.064689 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:48.064636    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8bsws"]
Sep 08 15:32:48.064824 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:48.064760    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:48.064883 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:48.064845    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:48.065281 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:48.065259    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7ctjw"]
Sep 08 15:32:48.065378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:48.065366    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:48.065492 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:48.065469    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:49.108110 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:49.108081    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:49.108505 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:49.108184    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:49.280332 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:49.280299    2579 generic.go:356] "Generic (PLEG): container finished" podID="3781875d-6d59-49ac-a0c6-f98fc520af7d" containerID="1ad1bc48bf17cf7e73b3a7927ff5e4c9982c59c5dab2bbac49de7bc6dc66603f" exitCode=0
Sep 08 15:32:49.280502 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:49.280386    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg86p" event={"ID":"3781875d-6d59-49ac-a0c6-f98fc520af7d","Type":"ContainerDied","Data":"1ad1bc48bf17cf7e73b3a7927ff5e4c9982c59c5dab2bbac49de7bc6dc66603f"}
Sep 08 15:32:50.108451 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:50.108370    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:50.108903 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:50.108462    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:50.108903 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:50.108548    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:50.108903 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:50.108659    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:51.107478 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:51.107439    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:51.107649 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:51.107540    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:51.287075 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:51.287042    2579 generic.go:356] "Generic (PLEG): container finished" podID="3781875d-6d59-49ac-a0c6-f98fc520af7d" containerID="2ebfdcba0284916356c200fd294823a47b563a7b389b64be17543bc024918d15" exitCode=0
Sep 08 15:32:51.287433 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:51.287088    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg86p" event={"ID":"3781875d-6d59-49ac-a0c6-f98fc520af7d","Type":"ContainerDied","Data":"2ebfdcba0284916356c200fd294823a47b563a7b389b64be17543bc024918d15"}
Sep 08 15:32:52.107952 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:52.107773    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:52.108151 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:52.107837    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:52.108151 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:52.108050    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-sms54" podUID="64661b07-5e5d-4f6c-bcf3-d77316769cfd"
Sep 08 15:32:52.108151 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:52.108107    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-7ctjw" podUID="1545a607-e922-4781-af5d-4e80d497ffc1"
Sep 08 15:32:53.108099 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.108044    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:53.108735 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.108174    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8bsws" podUID="61a9a956-b2e6-4566-aa72-6f24280f2717"
Sep 08 15:32:53.422942 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.422905    2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-134-78.ec2.internal" event="NodeReady"
Sep 08 15:32:53.423139 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.423090    2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Sep 08 15:32:53.461170 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.461133    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-8679696669-phnvj"]
Sep 08 15:32:53.505205 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.505169    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-blrnj"]
Sep 08 15:32:53.505376 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.505276    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.508144 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.508103    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Sep 08 15:32:53.508279 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.508172    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Sep 08 15:32:53.508352 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.508324    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vjkq6\""
Sep 08 15:32:53.508408 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.508371    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Sep 08 15:32:53.514524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.514497    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Sep 08 15:32:53.518174 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.518154    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8679696669-phnvj"]
Sep 08 15:32:53.518274 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.518190    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-rtsvw"]
Sep 08 15:32:53.518325 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.518280    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.520978 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.520944    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Sep 08 15:32:53.521086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.520991    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Sep 08 15:32:53.521086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.521054    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5prt2\""
Sep 08 15:32:53.540284 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.540258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-blrnj"]
Sep 08 15:32:53.540439 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.540296    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rtsvw"]
Sep 08 15:32:53.540439 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.540400    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rtsvw"
Sep 08 15:32:53.544421 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.544395    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nqnwb\""
Sep 08 15:32:53.544421 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.544418    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Sep 08 15:32:53.544641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.544395    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Sep 08 15:32:53.544641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.544424    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Sep 08 15:32:53.618928 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.618890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:53.635851 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.635824    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65b666ba-f38b-4226-bbc7-ab2b14b07adf-ca-trust-extracted\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.635953 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.635858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-installation-pull-secrets\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.635953 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.635877    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-bound-sa-token\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.635953 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.635926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.636082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636013    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.636082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636057    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-trusted-ca\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.636156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636075    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c49db913-6137-4007-9639-7b4ecdca2171-cert\") pod \"ingress-canary-rtsvw\" (UID: \"c49db913-6137-4007-9639-7b4ecdca2171\") " pod="openshift-ingress-canary/ingress-canary-rtsvw"
Sep 08 15:32:53.636156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636128    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9w46\" (UniqueName: \"kubernetes.io/projected/c49db913-6137-4007-9639-7b4ecdca2171-kube-api-access-f9w46\") pod \"ingress-canary-rtsvw\" (UID: \"c49db913-6137-4007-9639-7b4ecdca2171\") " pod="openshift-ingress-canary/ingress-canary-rtsvw"
Sep 08 15:32:53.636224 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636189    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-image-registry-private-configuration\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.636224 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636209    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/573ec29c-f2da-42f9-8a3d-4207f5521735-config-volume\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.636294 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636224    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7wvs\" (UniqueName: \"kubernetes.io/projected/573ec29c-f2da-42f9-8a3d-4207f5521735-kube-api-access-z7wvs\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.636294 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636254    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-certificates\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.636294 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7tm95\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-kube-api-access-7tm95\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.636394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.636309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/573ec29c-f2da-42f9-8a3d-4207f5521735-tmp-dir\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.723770 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.723688    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:53.737618 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737588    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-trusted-ca\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.737618 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737623    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c49db913-6137-4007-9639-7b4ecdca2171-cert\") pod \"ingress-canary-rtsvw\" (UID: \"c49db913-6137-4007-9639-7b4ecdca2171\") " pod="openshift-ingress-canary/ingress-canary-rtsvw"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737640    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9w46\" (UniqueName: \"kubernetes.io/projected/c49db913-6137-4007-9639-7b4ecdca2171-kube-api-access-f9w46\") pod \"ingress-canary-rtsvw\" (UID: \"c49db913-6137-4007-9639-7b4ecdca2171\") " pod="openshift-ingress-canary/ingress-canary-rtsvw"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-image-registry-private-configuration\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737713    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/573ec29c-f2da-42f9-8a3d-4207f5521735-config-volume\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7wvs\" (UniqueName: \"kubernetes.io/projected/573ec29c-f2da-42f9-8a3d-4207f5521735-kube-api-access-z7wvs\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737769    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-certificates\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737785    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7tm95\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-kube-api-access-7tm95\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737801    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/573ec29c-f2da-42f9-8a3d-4207f5521735-tmp-dir\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65b666ba-f38b-4226-bbc7-ab2b14b07adf-ca-trust-extracted\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737842    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-installation-pull-secrets\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.737861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.737858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-bound-sa-token\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.738376 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.738354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.738427 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.738412    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.738520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.738498    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/573ec29c-f2da-42f9-8a3d-4207f5521735-config-volume\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.738559 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.738527    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:32:53.738559 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.738538    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679696669-phnvj: secret "image-registry-tls" not found
Sep 08 15:32:53.738643 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.738586    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls podName:65b666ba-f38b-4226-bbc7-ab2b14b07adf nodeName:}" failed. No retries permitted until 2026-09-08 15:32:54.238572088 +0000 UTC m=+34.599114831 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls") pod "image-registry-8679696669-phnvj" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf") : secret "image-registry-tls" not found
Sep 08 15:32:53.738643 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.738598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/573ec29c-f2da-42f9-8a3d-4207f5521735-tmp-dir\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.738756 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.738709    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:32:53.738756 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.738728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65b666ba-f38b-4226-bbc7-ab2b14b07adf-ca-trust-extracted\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.738870 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.738766    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls podName:573ec29c-f2da-42f9-8a3d-4207f5521735 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:54.238750578 +0000 UTC m=+34.599293334 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls") pod "dns-default-blrnj" (UID: "573ec29c-f2da-42f9-8a3d-4207f5521735") : secret "dns-default-metrics-tls" not found
Sep 08 15:32:53.738870 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.738778    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-trusted-ca\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.739033 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.739010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-certificates\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.743090 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.743041    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-installation-pull-secrets\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.743218 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.743110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c49db913-6137-4007-9639-7b4ecdca2171-cert\") pod \"ingress-canary-rtsvw\" (UID: \"c49db913-6137-4007-9639-7b4ecdca2171\") " pod="openshift-ingress-canary/ingress-canary-rtsvw"
Sep 08 15:32:53.743218 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.743110    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-image-registry-private-configuration\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.747383 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.747338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7wvs\" (UniqueName: \"kubernetes.io/projected/573ec29c-f2da-42f9-8a3d-4207f5521735-kube-api-access-z7wvs\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:53.747866 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.747842    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9w46\" (UniqueName: \"kubernetes.io/projected/c49db913-6137-4007-9639-7b4ecdca2171-kube-api-access-f9w46\") pod \"ingress-canary-rtsvw\" (UID: \"c49db913-6137-4007-9639-7b4ecdca2171\") " pod="openshift-ingress-canary/ingress-canary-rtsvw"
Sep 08 15:32:53.747996 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.747908    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7tm95\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-kube-api-access-7tm95\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.747996 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.747985    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-bound-sa-token\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:53.839344 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.839300    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:53.839523 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.839370    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:53.839523 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.839458    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:53.839523 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.839517    2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:53.839636 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.839542    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs podName:1545a607-e922-4781-af5d-4e80d497ffc1 nodeName:}" failed. No retries permitted until 2026-09-08 15:33:25.839519937 +0000 UTC m=+66.200062721 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs") pod "network-metrics-daemon-7ctjw" (UID: "1545a607-e922-4781-af5d-4e80d497ffc1") : object "openshift-multus"/"metrics-daemon-secret" not registered
Sep 08 15:32:53.839636 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.839578    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret podName:64661b07-5e5d-4f6c-bcf3-d77316769cfd nodeName:}" failed. No retries permitted until 2026-09-08 15:33:25.83956677 +0000 UTC m=+66.200109514 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret") pod "global-pull-secret-syncer-sms54" (UID: "64661b07-5e5d-4f6c-bcf3-d77316769cfd") : object "kube-system"/"original-pull-secret" not registered
Sep 08 15:32:53.851497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.851474    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-rtsvw"
Sep 08 15:32:53.940209 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:53.940174    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:53.940363 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.940345    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Sep 08 15:32:53.940414 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.940366    2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Sep 08 15:32:53.940414 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.940378    2579 projected.go:196] Error preparing data for projected volume kube-api-access-6x4jj for pod openshift-network-diagnostics/network-check-target-8bsws: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:53.940493 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:53.940432    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj podName:61a9a956-b2e6-4566-aa72-6f24280f2717 nodeName:}" failed. No retries permitted until 2026-09-08 15:33:25.940416779 +0000 UTC m=+66.300959531 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6x4jj" (UniqueName: "kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj") pod "network-check-target-8bsws" (UID: "61a9a956-b2e6-4566-aa72-6f24280f2717") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Sep 08 15:32:54.112041 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.112010    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:32:54.112041 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.112038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:32:54.115351 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.115169    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:32:54.115351 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.115248    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xsqld\""
Sep 08 15:32:54.115351 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.115261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:32:54.177229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.177184    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-rtsvw"]
Sep 08 15:32:54.183067 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:32:54.183037    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc49db913_6137_4007_9639_7b4ecdca2171.slice/crio-4935ffac4e34b68cfe3f9f9b64297dc99868f4948454d1d0ed42e455ade97db4 WatchSource:0}: Error finding container 4935ffac4e34b68cfe3f9f9b64297dc99868f4948454d1d0ed42e455ade97db4: Status 404 returned error can't find the container with id 4935ffac4e34b68cfe3f9f9b64297dc99868f4948454d1d0ed42e455ade97db4
Sep 08 15:32:54.241762 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.241730    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:54.241956 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.241780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:54.241956 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:54.241891    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:32:54.241956 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:54.241905    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679696669-phnvj: secret "image-registry-tls" not found
Sep 08 15:32:54.242139 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:54.241985    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls podName:65b666ba-f38b-4226-bbc7-ab2b14b07adf nodeName:}" failed. No retries permitted until 2026-09-08 15:32:55.24195178 +0000 UTC m=+35.602494522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls") pod "image-registry-8679696669-phnvj" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf") : secret "image-registry-tls" not found
Sep 08 15:32:54.242139 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:54.242023    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:32:54.242139 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:54.242066    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls podName:573ec29c-f2da-42f9-8a3d-4207f5521735 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:55.242054231 +0000 UTC m=+35.602596986 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls") pod "dns-default-blrnj" (UID: "573ec29c-f2da-42f9-8a3d-4207f5521735") : secret "dns-default-metrics-tls" not found
Sep 08 15:32:54.296561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:54.296523    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rtsvw" event={"ID":"c49db913-6137-4007-9639-7b4ecdca2171","Type":"ContainerStarted","Data":"4935ffac4e34b68cfe3f9f9b64297dc99868f4948454d1d0ed42e455ade97db4"}
Sep 08 15:32:55.107692 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:55.107639    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:32:55.111727 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:55.111040    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:32:55.111727 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:55.111083    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:32:55.111727 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:55.111168    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xt4hq\""
Sep 08 15:32:55.251336 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:55.251298    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:55.251823 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:55.251361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:55.251823 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:55.251490    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:32:55.251823 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:55.251543    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:32:55.251823 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:55.251557    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679696669-phnvj: secret "image-registry-tls" not found
Sep 08 15:32:55.251823 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:55.251564    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls podName:573ec29c-f2da-42f9-8a3d-4207f5521735 nodeName:}" failed. No retries permitted until 2026-09-08 15:32:57.251546228 +0000 UTC m=+37.612088974 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls") pod "dns-default-blrnj" (UID: "573ec29c-f2da-42f9-8a3d-4207f5521735") : secret "dns-default-metrics-tls" not found
Sep 08 15:32:55.251823 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:55.251610    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls podName:65b666ba-f38b-4226-bbc7-ab2b14b07adf nodeName:}" failed. No retries permitted until 2026-09-08 15:32:57.251594186 +0000 UTC m=+37.612136929 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls") pod "image-registry-8679696669-phnvj" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf") : secret "image-registry-tls" not found
Sep 08 15:32:57.269890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:57.269653    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:32:57.270342 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:57.269914    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:32:57.270342 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:57.269815    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:32:57.270342 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:57.270036    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls podName:573ec29c-f2da-42f9-8a3d-4207f5521735 nodeName:}" failed. No retries permitted until 2026-09-08 15:33:01.270015828 +0000 UTC m=+41.630558584 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls") pod "dns-default-blrnj" (UID: "573ec29c-f2da-42f9-8a3d-4207f5521735") : secret "dns-default-metrics-tls" not found
Sep 08 15:32:57.270342 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:57.270072    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:32:57.270342 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:57.270086    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679696669-phnvj: secret "image-registry-tls" not found
Sep 08 15:32:57.270342 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:32:57.270141    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls podName:65b666ba-f38b-4226-bbc7-ab2b14b07adf nodeName:}" failed. No retries permitted until 2026-09-08 15:33:01.270127945 +0000 UTC m=+41.630670703 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls") pod "image-registry-8679696669-phnvj" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf") : secret "image-registry-tls" not found
Sep 08 15:32:57.522073 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:57.521990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:57.775586 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:57.775474    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:57.873848 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:57.873819    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:57.994590 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:57.994555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:58.058979 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:58.058875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:58.212930 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:58.212897    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:58.309392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:58.309313    2579 generic.go:356] "Generic (PLEG): container finished" podID="3781875d-6d59-49ac-a0c6-f98fc520af7d" containerID="273e80b700426013836e670050f3a29d608022a9716e369b82f332dcba41de63" exitCode=0
Sep 08 15:32:58.309879 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:58.309401    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg86p" event={"ID":"3781875d-6d59-49ac-a0c6-f98fc520af7d","Type":"ContainerDied","Data":"273e80b700426013836e670050f3a29d608022a9716e369b82f332dcba41de63"}
Sep 08 15:32:58.310953 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:58.310933    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-rtsvw" event={"ID":"c49db913-6137-4007-9639-7b4ecdca2171","Type":"ContainerStarted","Data":"c627ce0d217a401abda9b0433475a6d3fec948324fc4c73d647db92ded884469"}
Sep 08 15:32:58.335339 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:58.335308    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:58.351177 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:58.351132    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-rtsvw" podStartSLOduration=1.923322499 podStartE2EDuration="5.351115634s" totalImagesPullingTime="3.427793135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:32:58.350923353 +0000 UTC m=+38.711466119" watchObservedRunningTime="2026-09-08 15:32:58.351115634 +0000 UTC m=+38.711658406"
Sep 08 15:32:58.435007 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:58.434954    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:32:59.317214 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:59.317178    2579 generic.go:356] "Generic (PLEG): container finished" podID="3781875d-6d59-49ac-a0c6-f98fc520af7d" containerID="39c5f71386112a4cf21c3e6eb233a3ce3534ddca3fbbdf26493b41c7d061e4d2" exitCode=0
Sep 08 15:32:59.317617 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:32:59.317255    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg86p" event={"ID":"3781875d-6d59-49ac-a0c6-f98fc520af7d","Type":"ContainerDied","Data":"39c5f71386112a4cf21c3e6eb233a3ce3534ddca3fbbdf26493b41c7d061e4d2"}
Sep 08 15:33:00.323287 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:00.323256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-sg86p" event={"ID":"3781875d-6d59-49ac-a0c6-f98fc520af7d","Type":"ContainerStarted","Data":"a25cebaa4a2fa145f88d4f870a62dfb63a7b46316adc36fa00e1fdfdc69301c1"}
Sep 08 15:33:00.346784 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:00.346735    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-sg86p" podStartSLOduration=9.041901249 podStartE2EDuration="40.346718946s" totalImagesPullingTime="31.304817697s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:00.344888778 +0000 UTC m=+40.705431554" watchObservedRunningTime="2026-09-08 15:33:00.346718946 +0000 UTC m=+40.707261711"
Sep 08 15:33:00.469975 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:00.469940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:00.537162 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:00.537130    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:01.301857 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:01.301815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:33:01.301857 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:01.301860    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:33:01.302087 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:01.301992    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:33:01.302087 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:01.302007    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679696669-phnvj: secret "image-registry-tls" not found
Sep 08 15:33:01.302087 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:01.302054    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls podName:65b666ba-f38b-4226-bbc7-ab2b14b07adf nodeName:}" failed. No retries permitted until 2026-09-08 15:33:09.302040402 +0000 UTC m=+49.662583145 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls") pod "image-registry-8679696669-phnvj" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf") : secret "image-registry-tls" not found
Sep 08 15:33:01.302087 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:01.301992    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:33:01.302235 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:01.302124    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls podName:573ec29c-f2da-42f9-8a3d-4207f5521735 nodeName:}" failed. No retries permitted until 2026-09-08 15:33:09.302109469 +0000 UTC m=+49.662652212 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls") pod "dns-default-blrnj" (UID: "573ec29c-f2da-42f9-8a3d-4207f5521735") : secret "dns-default-metrics-tls" not found
Sep 08 15:33:03.597870 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:03.597831    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:03.698835 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:03.698804    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:03.799702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:03.799674    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:04.670018 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:04.669984    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:04.769997 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:04.769946    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:07.414010 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:07.413972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:09.117979 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:09.117931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:09.363132 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:09.363098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:33:09.363316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:09.363146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:33:09.363316 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:09.363271    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:33:09.363384 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:09.363335    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls podName:573ec29c-f2da-42f9-8a3d-4207f5521735 nodeName:}" failed. No retries permitted until 2026-09-08 15:33:25.363319781 +0000 UTC m=+65.723862524 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls") pod "dns-default-blrnj" (UID: "573ec29c-f2da-42f9-8a3d-4207f5521735") : secret "dns-default-metrics-tls" not found
Sep 08 15:33:09.363384 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:09.363279    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:33:09.363384 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:09.363373    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679696669-phnvj: secret "image-registry-tls" not found
Sep 08 15:33:09.363478 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:09.363416    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls podName:65b666ba-f38b-4226-bbc7-ab2b14b07adf nodeName:}" failed. No retries permitted until 2026-09-08 15:33:25.363404702 +0000 UTC m=+65.723947445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls") pod "image-registry-8679696669-phnvj" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf") : secret "image-registry-tls" not found
Sep 08 15:33:09.545555 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:09.545458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:09.614531 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:09.614496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:13.827625 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:13.827591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:13.927016 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:13.926983    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:15.418133 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:15.418088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:15.515365 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:15.515330    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:16.481401 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:16.481368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:16.556121 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:16.556083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:19.290524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:19.290498    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-78wt9"
Sep 08 15:33:19.457173 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:19.457132    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:19.519665 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:19.519632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:20.779655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:20.779610    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:20.839955 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:20.839918    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:21.396357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:21.396321    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:21.499373 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:21.499346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:25.373830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.373773    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:33:25.374371 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:25.373981    2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Sep 08 15:33:25.374371 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:25.374003    2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-8679696669-phnvj: secret "image-registry-tls" not found
Sep 08 15:33:25.374371 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.374024    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:33:25.374371 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:25.374081    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls podName:65b666ba-f38b-4226-bbc7-ab2b14b07adf nodeName:}" failed. No retries permitted until 2026-09-08 15:33:57.374060976 +0000 UTC m=+97.734603720 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls") pod "image-registry-8679696669-phnvj" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf") : secret "image-registry-tls" not found
Sep 08 15:33:25.374371 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:25.374130    2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Sep 08 15:33:25.374371 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:25.374169    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls podName:573ec29c-f2da-42f9-8a3d-4207f5521735 nodeName:}" failed. No retries permitted until 2026-09-08 15:33:57.37415702 +0000 UTC m=+97.734699763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls") pod "dns-default-blrnj" (UID: "573ec29c-f2da-42f9-8a3d-4207f5521735") : secret "dns-default-metrics-tls" not found
Sep 08 15:33:25.877666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.877620    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:33:25.877666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.877677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:33:25.880626 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.880603    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Sep 08 15:33:25.880740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.880725    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Sep 08 15:33:25.888879 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:25.888857    2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Sep 08 15:33:25.888930 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:25.888921    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs podName:1545a607-e922-4781-af5d-4e80d497ffc1 nodeName:}" failed. No retries permitted until 2026-09-08 15:34:29.888904007 +0000 UTC m=+130.249446750 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs") pod "network-metrics-daemon-7ctjw" (UID: "1545a607-e922-4781-af5d-4e80d497ffc1") : secret "metrics-daemon-secret" not found
Sep 08 15:33:25.891908 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.891891    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/64661b07-5e5d-4f6c-bcf3-d77316769cfd-original-pull-secret\") pod \"global-pull-secret-syncer-sms54\" (UID: \"64661b07-5e5d-4f6c-bcf3-d77316769cfd\") " pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:33:25.930329 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.930293    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-sms54"
Sep 08 15:33:25.979086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.979042    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:33:25.982584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.982562    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Sep 08 15:33:25.992222 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:25.992195    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Sep 08 15:33:26.002805 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:26.002780    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x4jj\" (UniqueName: \"kubernetes.io/projected/61a9a956-b2e6-4566-aa72-6f24280f2717-kube-api-access-6x4jj\") pod \"network-check-target-8bsws\" (UID: \"61a9a956-b2e6-4566-aa72-6f24280f2717\") " pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:33:26.023142 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:26.023117    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xt4hq\""
Sep 08 15:33:26.031379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:26.031358    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:33:26.199088 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:26.199010    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-sms54"]
Sep 08 15:33:26.201777 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:33:26.201735    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod64661b07_5e5d_4f6c_bcf3_d77316769cfd.slice/crio-8f9d41f8387bb02903ffa20b415ed4429c5fee4bdb183c118ca678d4509df205 WatchSource:0}: Error finding container 8f9d41f8387bb02903ffa20b415ed4429c5fee4bdb183c118ca678d4509df205: Status 404 returned error can't find the container with id 8f9d41f8387bb02903ffa20b415ed4429c5fee4bdb183c118ca678d4509df205
Sep 08 15:33:26.297442 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:26.297409    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8bsws"]
Sep 08 15:33:26.300774 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:33:26.300751    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61a9a956_b2e6_4566_aa72_6f24280f2717.slice/crio-730b784f8c9c17a495cbf728201c29e01e20d595b7236d0bf3e3180830672d92 WatchSource:0}: Error finding container 730b784f8c9c17a495cbf728201c29e01e20d595b7236d0bf3e3180830672d92: Status 404 returned error can't find the container with id 730b784f8c9c17a495cbf728201c29e01e20d595b7236d0bf3e3180830672d92
Sep 08 15:33:26.384415 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:26.384374    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8bsws" event={"ID":"61a9a956-b2e6-4566-aa72-6f24280f2717","Type":"ContainerStarted","Data":"730b784f8c9c17a495cbf728201c29e01e20d595b7236d0bf3e3180830672d92"}
Sep 08 15:33:26.385516 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:26.385490    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sms54" event={"ID":"64661b07-5e5d-4f6c-bcf3-d77316769cfd","Type":"ContainerStarted","Data":"8f9d41f8387bb02903ffa20b415ed4429c5fee4bdb183c118ca678d4509df205"}
Sep 08 15:33:31.402397 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:31.402354    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8bsws" event={"ID":"61a9a956-b2e6-4566-aa72-6f24280f2717","Type":"ContainerStarted","Data":"23df0e91c477533d5efe7160cebfd2c97fe01b63d071caf4005f2a81f6edd65e"}
Sep 08 15:33:31.402896 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:31.402457    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:33:31.404038 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:31.403998    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-sms54" event={"ID":"64661b07-5e5d-4f6c-bcf3-d77316769cfd","Type":"ContainerStarted","Data":"86a65abfc0870924f613387b4675597e96f06b5d51a9485c81dd6b59d7ff8353"}
Sep 08 15:33:31.419094 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:31.419048    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8bsws" podStartSLOduration=66.493362305 podStartE2EDuration="1m11.419033248s" totalImagesPullingTime="4.925670943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:31.418861435 +0000 UTC m=+71.779404200" watchObservedRunningTime="2026-09-08 15:33:31.419033248 +0000 UTC m=+71.779576013"
Sep 08 15:33:31.433609 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:31.433554    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-sms54" podStartSLOduration=66.405655303 podStartE2EDuration="1m11.433536709s" totalImagesPullingTime="5.027881406s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:31.433019539 +0000 UTC m=+71.793562305" watchObservedRunningTime="2026-09-08 15:33:31.433536709 +0000 UTC m=+71.794079473"
Sep 08 15:33:34.392347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:34.392313    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:34.454158 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:34.454125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:42.690136 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:42.690009    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:42.749217 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:42.749181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:44.470860 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.470824    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-swk74"]
Sep 08 15:33:44.473170 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.473153    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-swk74"
Sep 08 15:33:44.476131 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.476107    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-nxdp4\""
Sep 08 15:33:44.483423 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.483397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-swk74"]
Sep 08 15:33:44.509621 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.509584    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dwhrg\" (UniqueName: \"kubernetes.io/projected/4aa3f496-7bf0-43a0-a2c0-e5f71504cb0a-kube-api-access-dwhrg\") pod \"network-check-source-685456655f-swk74\" (UID: \"4aa3f496-7bf0-43a0-a2c0-e5f71504cb0a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-swk74"
Sep 08 15:33:44.577922 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.577885    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5"]
Sep 08 15:33:44.579636 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.579612    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5"
Sep 08 15:33:44.581176 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.581152    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-hxzg9"]
Sep 08 15:33:44.585154 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.585128    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.585387 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.585144    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:33:44.585515 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.585175    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Sep 08 15:33:44.585515 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.585209    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-v2mlf\""
Sep 08 15:33:44.587750 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.587721    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Sep 08 15:33:44.588052 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.588035    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-95hxz\""
Sep 08 15:33:44.588142 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.588128    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Sep 08 15:33:44.588472 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.588442    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Sep 08 15:33:44.588600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.588586    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Sep 08 15:33:44.592808 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.592787    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5"]
Sep 08 15:33:44.594447 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.594429    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Sep 08 15:33:44.595674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.595656    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-hxzg9"]
Sep 08 15:33:44.610446 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.610417    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-tmp\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.610566 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.610473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.610566 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.610493    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-serving-cert\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.610566 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.610510    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-snapshots\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.610566 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.610537    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zdrsr\" (UniqueName: \"kubernetes.io/projected/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-kube-api-access-zdrsr\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.610566 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.610560    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.610725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.610631    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dwhrg\" (UniqueName: \"kubernetes.io/projected/4aa3f496-7bf0-43a0-a2c0-e5f71504cb0a-kube-api-access-dwhrg\") pod \"network-check-source-685456655f-swk74\" (UID: \"4aa3f496-7bf0-43a0-a2c0-e5f71504cb0a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-swk74"
Sep 08 15:33:44.610725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.610684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8plj9\" (UniqueName: \"kubernetes.io/projected/337c1de9-5b39-40c4-99b1-18ff31d5cbb0-kube-api-access-8plj9\") pod \"volume-data-source-validator-695c895bd6-bxkg5\" (UID: \"337c1de9-5b39-40c4-99b1-18ff31d5cbb0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5"
Sep 08 15:33:44.623249 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.623214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dwhrg\" (UniqueName: \"kubernetes.io/projected/4aa3f496-7bf0-43a0-a2c0-e5f71504cb0a-kube-api-access-dwhrg\") pod \"network-check-source-685456655f-swk74\" (UID: \"4aa3f496-7bf0-43a0-a2c0-e5f71504cb0a\") " pod="openshift-network-diagnostics/network-check-source-685456655f-swk74"
Sep 08 15:33:44.711732 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.711691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zdrsr\" (UniqueName: \"kubernetes.io/projected/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-kube-api-access-zdrsr\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.711732 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.711735    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.712014 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.711799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8plj9\" (UniqueName: \"kubernetes.io/projected/337c1de9-5b39-40c4-99b1-18ff31d5cbb0-kube-api-access-8plj9\") pod \"volume-data-source-validator-695c895bd6-bxkg5\" (UID: \"337c1de9-5b39-40c4-99b1-18ff31d5cbb0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5"
Sep 08 15:33:44.712014 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.711836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-tmp\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.712014 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.711874    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.712014 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.711896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-serving-cert\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.712014 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.711919    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-snapshots\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.712553 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.712527    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-service-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.712638 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.712554    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-snapshots\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.712638 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.712536    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-tmp\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.712754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.712734    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-trusted-ca-bundle\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.714356 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.714337    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-serving-cert\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.725723 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.725657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8plj9\" (UniqueName: \"kubernetes.io/projected/337c1de9-5b39-40c4-99b1-18ff31d5cbb0-kube-api-access-8plj9\") pod \"volume-data-source-validator-695c895bd6-bxkg5\" (UID: \"337c1de9-5b39-40c4-99b1-18ff31d5cbb0\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5"
Sep 08 15:33:44.727554 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.727533    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zdrsr\" (UniqueName: \"kubernetes.io/projected/bf2eb183-a8ef-41fb-a0fc-11dd92e7326f-kube-api-access-zdrsr\") pod \"insights-operator-76bcd6ccf5-hxzg9\" (UID: \"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f\") " pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.781934 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.781877    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-685456655f-swk74"
Sep 08 15:33:44.827924 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.827625    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:44.893539 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.893499    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5"
Sep 08 15:33:44.900421 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.900401    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9"
Sep 08 15:33:44.957207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:44.957125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:45.046320 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:45.046285    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-685456655f-swk74"]
Sep 08 15:33:45.049141 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:33:45.049104    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4aa3f496_7bf0_43a0_a2c0_e5f71504cb0a.slice/crio-669b18fc95fb66bd15d0558cf0dc598df1b0773e1fa50e2945027a68e0000c67 WatchSource:0}: Error finding container 669b18fc95fb66bd15d0558cf0dc598df1b0773e1fa50e2945027a68e0000c67: Status 404 returned error can't find the container with id 669b18fc95fb66bd15d0558cf0dc598df1b0773e1fa50e2945027a68e0000c67
Sep 08 15:33:45.171092 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:45.171062    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5"]
Sep 08 15:33:45.174606 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:33:45.174578    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod337c1de9_5b39_40c4_99b1_18ff31d5cbb0.slice/crio-413f5739c25c2233fdda68de3e95696f3501c62af89cd40078f974e87b39321b WatchSource:0}: Error finding container 413f5739c25c2233fdda68de3e95696f3501c62af89cd40078f974e87b39321b: Status 404 returned error can't find the container with id 413f5739c25c2233fdda68de3e95696f3501c62af89cd40078f974e87b39321b
Sep 08 15:33:45.182431 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:45.182409    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-76bcd6ccf5-hxzg9"]
Sep 08 15:33:45.186392 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:33:45.186365    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2eb183_a8ef_41fb_a0fc_11dd92e7326f.slice/crio-7c59b57e53c191a52801e6a52307cd09cd28edbc0b4f580b09f0bac9e6df76cc WatchSource:0}: Error finding container 7c59b57e53c191a52801e6a52307cd09cd28edbc0b4f580b09f0bac9e6df76cc: Status 404 returned error can't find the container with id 7c59b57e53c191a52801e6a52307cd09cd28edbc0b4f580b09f0bac9e6df76cc
Sep 08 15:33:45.438651 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:45.438616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5" event={"ID":"337c1de9-5b39-40c4-99b1-18ff31d5cbb0","Type":"ContainerStarted","Data":"413f5739c25c2233fdda68de3e95696f3501c62af89cd40078f974e87b39321b"}
Sep 08 15:33:45.440195 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:45.440151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-swk74" event={"ID":"4aa3f496-7bf0-43a0-a2c0-e5f71504cb0a","Type":"ContainerStarted","Data":"f016a3884485995432bee988607edbb8b51c6a344638e4193568664f2f508e88"}
Sep 08 15:33:45.440344 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:45.440199    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-685456655f-swk74" event={"ID":"4aa3f496-7bf0-43a0-a2c0-e5f71504cb0a","Type":"ContainerStarted","Data":"669b18fc95fb66bd15d0558cf0dc598df1b0773e1fa50e2945027a68e0000c67"}
Sep 08 15:33:45.441303 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:45.441279    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9" event={"ID":"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f","Type":"ContainerStarted","Data":"7c59b57e53c191a52801e6a52307cd09cd28edbc0b4f580b09f0bac9e6df76cc"}
Sep 08 15:33:45.455212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:45.455168    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-685456655f-swk74" podStartSLOduration=1.4551553099999999 podStartE2EDuration="1.45515531s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:33:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:45.453981293 +0000 UTC m=+85.814524055" watchObservedRunningTime="2026-09-08 15:33:45.45515531 +0000 UTC m=+85.815698075"
Sep 08 15:33:46.446801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:46.446761    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5" event={"ID":"337c1de9-5b39-40c4-99b1-18ff31d5cbb0","Type":"ContainerStarted","Data":"6e4898c3de1d4d81b8ccd0963f65d167d2ea4558e8fa3a455a28dd9e61eae487"}
Sep 08 15:33:46.461514 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:46.461454    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-695c895bd6-bxkg5" podStartSLOduration=1.358580852 podStartE2EDuration="2.461435031s" totalImagesPullingTime="1.102854179s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:46.461078154 +0000 UTC m=+86.821620919" watchObservedRunningTime="2026-09-08 15:33:46.461435031 +0000 UTC m=+86.821977797"
Sep 08 15:33:46.549713 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:46.549625    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:46.614253 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:46.614200    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:47.452197 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:47.452157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9" event={"ID":"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f","Type":"ContainerStarted","Data":"ef394f4ebc8cbfe9da9dcd8a2c8dbf1446280b398e52d1752e667a4ad9cd9f89"}
Sep 08 15:33:47.482104 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:47.482007    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9" podStartSLOduration=1.445602356 podStartE2EDuration="3.481990273s" totalImagesPullingTime="2.036387917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:47.480465892 +0000 UTC m=+87.841008657" watchObservedRunningTime="2026-09-08 15:33:47.481990273 +0000 UTC m=+87.842533038"
Sep 08 15:33:48.066101 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.066070    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-hlcgw"]
Sep 08 15:33:48.068131 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.068110    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.070702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.070681    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Sep 08 15:33:48.070949 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.070934    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Sep 08 15:33:48.071841 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.071822    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-l67b9\""
Sep 08 15:33:48.084105 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.084078    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hlcgw"]
Sep 08 15:33:48.094513 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.094482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:48.141171 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.141139    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-crio-socket\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.141331 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.141181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-data-volume\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.141331 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.141214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cb7nr\" (UniqueName: \"kubernetes.io/projected/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-api-access-cb7nr\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.141331 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.141256    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.141331 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.141273    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.173028 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.172990    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:48.242122 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.242082    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cb7nr\" (UniqueName: \"kubernetes.io/projected/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-api-access-cb7nr\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.242317 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.242132    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.242317 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:48.242208    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:33:48.242317 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.242253    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.242317 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:48.242283    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:33:48.742261753 +0000 UTC m=+89.102804525 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : configmap "kube-rbac-proxy" not found
Sep 08 15:33:48.242564 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:48.242346    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:48.242564 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.242388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-crio-socket\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.242564 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:48.242399    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:33:48.742382119 +0000 UTC m=+89.102924862 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:48.242564 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.242450    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-crio-socket\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.242564 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.242449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-data-volume\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.242728 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.242715    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-data-volume\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.252741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.252717    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cb7nr\" (UniqueName: \"kubernetes.io/projected/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-api-access-cb7nr\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.554373 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.554338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:48.567355 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.567325    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf"]
Sep 08 15:33:48.569166 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.569150    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf"
Sep 08 15:33:48.571516 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.571496    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Sep 08 15:33:48.571648 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.571599    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Sep 08 15:33:48.571811 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.571795    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4vtmt\""
Sep 08 15:33:48.582646 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.582623    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf"]
Sep 08 15:33:48.645580 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.645543    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grl4j\" (UniqueName: \"kubernetes.io/projected/ae206cb3-bd67-4af9-b59c-c135ef04d1be-kube-api-access-grl4j\") pod \"migrator-fdbb8fdff-kvltf\" (UID: \"ae206cb3-bd67-4af9-b59c-c135ef04d1be\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf"
Sep 08 15:33:48.648479 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.648456    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:48.746089 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.746050    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grl4j\" (UniqueName: \"kubernetes.io/projected/ae206cb3-bd67-4af9-b59c-c135ef04d1be-kube-api-access-grl4j\") pod \"migrator-fdbb8fdff-kvltf\" (UID: \"ae206cb3-bd67-4af9-b59c-c135ef04d1be\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf"
Sep 08 15:33:48.746275 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.746120    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.746275 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.746142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:48.746275 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:48.746254    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:33:48.746371 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:48.746314    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:48.746371 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:48.746328    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:33:49.746309387 +0000 UTC m=+90.106852133 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : configmap "kube-rbac-proxy" not found
Sep 08 15:33:48.746371 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:48.746358    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:33:49.746346116 +0000 UTC m=+90.106888859 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:48.749911 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.749869    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:48.754992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.754947    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-grl4j\" (UniqueName: \"kubernetes.io/projected/ae206cb3-bd67-4af9-b59c-c135ef04d1be-kube-api-access-grl4j\") pod \"migrator-fdbb8fdff-kvltf\" (UID: \"ae206cb3-bd67-4af9-b59c-c135ef04d1be\") " pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf"
Sep 08 15:33:48.877397 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:48.877353    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf"
Sep 08 15:33:49.144506 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:49.144427    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf"]
Sep 08 15:33:49.147064 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:33:49.147022    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae206cb3_bd67_4af9_b59c_c135ef04d1be.slice/crio-8a7f75f9d61c702042330b9f934b6ebf4df5a357bb67cb1ae4420739f7c493e7 WatchSource:0}: Error finding container 8a7f75f9d61c702042330b9f934b6ebf4df5a357bb67cb1ae4420739f7c493e7: Status 404 returned error can't find the container with id 8a7f75f9d61c702042330b9f934b6ebf4df5a357bb67cb1ae4420739f7c493e7
Sep 08 15:33:49.313068 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:49.313039    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:49.463444 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:49.463364    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf" event={"ID":"ae206cb3-bd67-4af9-b59c-c135ef04d1be","Type":"ContainerStarted","Data":"8a7f75f9d61c702042330b9f934b6ebf4df5a357bb67cb1ae4420739f7c493e7"}
Sep 08 15:33:49.752590 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:49.752494    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:49.752590 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:49.752537    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:49.753106 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:49.752642    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:49.753106 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:49.752642    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:33:49.753106 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:49.752690    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:33:51.752676651 +0000 UTC m=+92.113219394 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:49.753106 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:49.752707    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:33:51.752699845 +0000 UTC m=+92.113242587 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : configmap "kube-rbac-proxy" not found
Sep 08 15:33:49.795076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:49.795043    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:49.830770 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:49.830745    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h28rz_157b136a-9d8d-4374-aa00-9e2e945e12e9/dns-node-resolver/0.log"
Sep 08 15:33:49.897192 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:49.897145    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:50.038061 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:50.037982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:50.096049 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:50.096017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:51.030639 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.030612    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-snrjc_e7b3c4b8-fdd1-4e92-b20b-3690484981ae/node-ca/0.log"
Sep 08 15:33:51.471172 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.471139    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf" event={"ID":"ae206cb3-bd67-4af9-b59c-c135ef04d1be","Type":"ContainerStarted","Data":"7115e9f93a9bdb71836ee04605b91dd32f90bfdc7a10d4f395db4ec50cd31cf3"}
Sep 08 15:33:51.471344 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.471191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf" event={"ID":"ae206cb3-bd67-4af9-b59c-c135ef04d1be","Type":"ContainerStarted","Data":"d0b3d4ea9b4d0b6bb771fa69e4d4b006482c299761c35fd46c62ec463f30e9df"}
Sep 08 15:33:51.490301 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.490250    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-fdbb8fdff-kvltf" podStartSLOduration=2.161684782 podStartE2EDuration="3.490235007s" totalImagesPullingTime="1.328550225s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:33:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:51.489434496 +0000 UTC m=+91.849977262" watchObservedRunningTime="2026-09-08 15:33:51.490235007 +0000 UTC m=+91.850777771"
Sep 08 15:33:51.567201 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.567160    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:51.652510 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.652470    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:51.723238 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.723161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:51.769129 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.769090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:51.769129 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.769128    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:51.769336 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:51.769226    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:33:51.769336 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:51.769264    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:51.769336 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:51.769300    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:33:55.769282916 +0000 UTC m=+96.129825662 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : configmap "kube-rbac-proxy" not found
Sep 08 15:33:51.769336 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:51.769318    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:33:55.769310251 +0000 UTC m=+96.129852994 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:51.830599 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:51.830569    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rtsvw_c49db913-6137-4007-9639-7b4ecdca2171/serve-healthcheck-canary/0.log"
Sep 08 15:33:52.604458 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:52.604420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:53.569351 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:53.569316    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:53.721212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:53.721184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:53.810611 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:53.810580    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:53.912336 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:53.912300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:54.665743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:54.665705    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:55.067594 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:55.067505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:55.460708 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:55.460672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:55.657633 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:55.657595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:55.800658 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:55.800563    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:55.800658 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:55.800610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:33:55.800849 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:55.800690    2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Sep 08 15:33:55.800849 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:55.800769    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:34:03.800752223 +0000 UTC m=+104.161295000 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : configmap "kube-rbac-proxy" not found
Sep 08 15:33:55.800849 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:55.800771    2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:55.800849 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:33:55.800832    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls podName:c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc nodeName:}" failed. No retries permitted until 2026-09-08 15:34:03.800818431 +0000 UTC m=+104.161361179 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls") pod "insights-runtime-extractor-hlcgw" (UID: "c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc") : secret "insights-runtime-extractor-tls" not found
Sep 08 15:33:55.908902 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:55.908864    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:56.262270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:56.262233    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:56.669681 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:56.669651    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:56.865112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:56.865077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:57.288757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.288703    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:57.412367 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.412338    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:57.413223 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.413201    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:33:57.413280 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.413240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:33:57.415577 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.415548    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"image-registry-8679696669-phnvj\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") " pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:33:57.415577 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.415572    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/573ec29c-f2da-42f9-8a3d-4207f5521735-metrics-tls\") pod \"dns-default-blrnj\" (UID: \"573ec29c-f2da-42f9-8a3d-4207f5521735\") " pod="openshift-dns/dns-default-blrnj"
Sep 08 15:33:57.418707 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.418690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-vjkq6\""
Sep 08 15:33:57.427184 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.427166    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:33:57.430605 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.430589    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5prt2\""
Sep 08 15:33:57.438696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.438675    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-blrnj"
Sep 08 15:33:57.512970 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.512911    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:57.661730 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.661686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:57.703024 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.702990    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-8679696669-phnvj"]
Sep 08 15:33:57.707091 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:33:57.707058    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod65b666ba_f38b_4226_bbc7_ab2b14b07adf.slice/crio-9c96944c502c014331002c76514e8c3f2b3b2d2538ae4fac57cc5adde5ae0f7d WatchSource:0}: Error finding container 9c96944c502c014331002c76514e8c3f2b3b2d2538ae4fac57cc5adde5ae0f7d: Status 404 returned error can't find the container with id 9c96944c502c014331002c76514e8c3f2b3b2d2538ae4fac57cc5adde5ae0f7d
Sep 08 15:33:57.724102 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:57.724073    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-blrnj"]
Sep 08 15:33:57.737064 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:33:57.737018    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod573ec29c_f2da_42f9_8a3d_4207f5521735.slice/crio-7cec61e010abb3e4b58c02083ee1663493c49d217851a3d9a031b2561c8f3c1c WatchSource:0}: Error finding container 7cec61e010abb3e4b58c02083ee1663493c49d217851a3d9a031b2561c8f3c1c: Status 404 returned error can't find the container with id 7cec61e010abb3e4b58c02083ee1663493c49d217851a3d9a031b2561c8f3c1c
Sep 08 15:33:58.255474 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:58.255436    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:58.313333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:58.313299    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:58.495851 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:58.495818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8679696669-phnvj" event={"ID":"65b666ba-f38b-4226-bbc7-ab2b14b07adf","Type":"ContainerStarted","Data":"5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851"}
Sep 08 15:33:58.496068 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:58.495878    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8679696669-phnvj" event={"ID":"65b666ba-f38b-4226-bbc7-ab2b14b07adf","Type":"ContainerStarted","Data":"9c96944c502c014331002c76514e8c3f2b3b2d2538ae4fac57cc5adde5ae0f7d"}
Sep 08 15:33:58.496068 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:58.495903    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:33:58.497304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:58.497273    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blrnj" event={"ID":"573ec29c-f2da-42f9-8a3d-4207f5521735","Type":"ContainerStarted","Data":"7cec61e010abb3e4b58c02083ee1663493c49d217851a3d9a031b2561c8f3c1c"}
Sep 08 15:33:58.853746 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:58.853697    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:59.055586 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:59.055545    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:59.473324 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:59.473249    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:59.655908 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:59.655869    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:33:59.766336 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:33:59.766251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:00.059026 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:00.058930    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:00.458227 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:00.458194    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:00.512777 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:00.512736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blrnj" event={"ID":"573ec29c-f2da-42f9-8a3d-4207f5521735","Type":"ContainerStarted","Data":"891140277e27209130ed9458ad3712a0f653d7b3814b31b0efed72e511f20545"}
Sep 08 15:34:00.513206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:00.512791    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-blrnj" event={"ID":"573ec29c-f2da-42f9-8a3d-4207f5521735","Type":"ContainerStarted","Data":"cf90d9d44800b82b60ff095f579218937e5f3704d9ea7e1784201444ffcd68d1"}
Sep 08 15:34:00.513206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:00.512818    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-blrnj"
Sep 08 15:34:00.530391 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:00.530338    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-blrnj" podStartSLOduration=65.85751173 podStartE2EDuration="1m7.530321501s" totalImagesPullingTime="1.672809771s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:34:00.528829392 +0000 UTC m=+100.889372160" watchObservedRunningTime="2026-09-08 15:34:00.530321501 +0000 UTC m=+100.890864265"
Sep 08 15:34:00.530639 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:00.530619    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-8679696669-phnvj" podStartSLOduration=100.530614213 podStartE2EDuration="1m40.530614213s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:33:58.521350024 +0000 UTC m=+98.881892798" watchObservedRunningTime="2026-09-08 15:34:00.530614213 +0000 UTC m=+100.891156978"
Sep 08 15:34:01.239379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:01.239340    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:01.302258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:01.302217    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:01.482065 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:01.482031    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:01.852706 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:01.852673    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:02.057067 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:02.057035    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:02.408692 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:02.408664    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8bsws"
Sep 08 15:34:02.452601 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:02.452562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:03.257676 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:03.257636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:03.650639 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:03.650598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:03.852872 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:03.852835    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:03.867903 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:03.867871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:34:03.868013 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:03.867911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:34:03.868454 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:03.868436    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:34:03.870195 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:03.870174    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-hlcgw\" (UID: \"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc\") " pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:34:03.977376 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:03.977288    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-hlcgw"
Sep 08 15:34:04.072359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:04.072324    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:04.259823 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:04.259732    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:04.280487 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:04.280312    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-hlcgw"]
Sep 08 15:34:04.282997 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:34:04.282955    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2e74e0a_c02e_4d54_bb7a_8d8deb79f6bc.slice/crio-04ad371388de774cb8534d76f2b0f56131a8c2204f68d5ddc3d55b265d82f69d WatchSource:0}: Error finding container 04ad371388de774cb8534d76f2b0f56131a8c2204f68d5ddc3d55b265d82f69d: Status 404 returned error can't find the container with id 04ad371388de774cb8534d76f2b0f56131a8c2204f68d5ddc3d55b265d82f69d
Sep 08 15:34:04.417060 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:04.417021    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:04.528931 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:04.528846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hlcgw" event={"ID":"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc","Type":"ContainerStarted","Data":"fbfb50db1405970b7968f61087cce264e5d798373b0cf5eb5aca306fc5fd85ae"}
Sep 08 15:34:04.528931 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:04.528900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hlcgw" event={"ID":"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc","Type":"ContainerStarted","Data":"04ad371388de774cb8534d76f2b0f56131a8c2204f68d5ddc3d55b265d82f69d"}
Sep 08 15:34:06.537280 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:06.537248    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hlcgw" event={"ID":"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc","Type":"ContainerStarted","Data":"9e90c23a8fb48fdd200843ed041923a53148a04adb49aa1c940bf86ecd4dd297"}
Sep 08 15:34:07.346371 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:07.346331    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:07.409069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:07.408999    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:07.543058 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:07.543023    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-hlcgw" event={"ID":"c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc","Type":"ContainerStarted","Data":"3c07e6751d68af149cdc3937963c195b6408a15da6c0889b99bdc1b8288d8b29"}
Sep 08 15:34:07.563194 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:07.563135    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-hlcgw" podStartSLOduration=16.642711592 podStartE2EDuration="19.563117485s" totalImagesPullingTime="2.920405893s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 15:33:48 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:34:07.561358733 +0000 UTC m=+107.921901498" watchObservedRunningTime="2026-09-08 15:34:07.563117485 +0000 UTC m=+107.923660249"
Sep 08 15:34:10.518613 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.518581    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-blrnj"
Sep 08 15:34:10.864580 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.864539    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"]
Sep 08 15:34:10.867599 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.867576    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:10.870479 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.870456    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Sep 08 15:34:10.871319 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.871298    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Sep 08 15:34:10.871429 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.871412    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Sep 08 15:34:10.871487 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.871433    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Sep 08 15:34:10.871541 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.871517    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Sep 08 15:34:10.871594 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.871576    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Sep 08 15:34:10.871740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.871725    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Sep 08 15:34:10.883367 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:10.883338    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"]
Sep 08 15:34:11.021566 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.021530    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7d7794-5aab-4977-8510-df568b349547-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.021566 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.021570    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.021776 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.021591    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhkfr\" (UniqueName: \"kubernetes.io/projected/5c7d7794-5aab-4977-8510-df568b349547-kube-api-access-vhkfr\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.021776 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.021651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-hub\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.021776 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.021710    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-ca\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.021776 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.021724    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.025699 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.025664    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:11.122262 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.122167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.122262 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.122203    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhkfr\" (UniqueName: \"kubernetes.io/projected/5c7d7794-5aab-4977-8510-df568b349547-kube-api-access-vhkfr\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.122491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.122281    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-hub\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.122491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.122372    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-ca\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.122491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.122401    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.122491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.122461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7d7794-5aab-4977-8510-df568b349547-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.123355 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.123326    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/5c7d7794-5aab-4977-8510-df568b349547-additional-service-ca\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.123527 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.123496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:11.125112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.125092    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-ca\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.125387 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.125365    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.125452 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.125427    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.125521 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.125472    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/5c7d7794-5aab-4977-8510-df568b349547-hub\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.131534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.131505    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhkfr\" (UniqueName: \"kubernetes.io/projected/5c7d7794-5aab-4977-8510-df568b349547-kube-api-access-vhkfr\") pod \"cluster-proxy-proxy-agent-5d68c86c4b-zx5tf\" (UID: \"5c7d7794-5aab-4977-8510-df568b349547\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.187339 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.187300    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"
Sep 08 15:34:11.457402 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.457324    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf"]
Sep 08 15:34:11.460664 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:34:11.460635    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5c7d7794_5aab_4977_8510_df568b349547.slice/crio-b7d0cd6cc50c0e612a3b251b917079fbbe766d812d71e8572ec542542b8988b3 WatchSource:0}: Error finding container b7d0cd6cc50c0e612a3b251b917079fbbe766d812d71e8572ec542542b8988b3: Status 404 returned error can't find the container with id b7d0cd6cc50c0e612a3b251b917079fbbe766d812d71e8572ec542542b8988b3
Sep 08 15:34:11.556390 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:11.556349    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf" event={"ID":"5c7d7794-5aab-4977-8510-df568b349547","Type":"ContainerStarted","Data":"b7d0cd6cc50c0e612a3b251b917079fbbe766d812d71e8572ec542542b8988b3"}
Sep 08 15:34:16.576657 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:16.576613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf" event={"ID":"5c7d7794-5aab-4977-8510-df568b349547","Type":"ContainerStarted","Data":"6432583a760176cc89a52b1f53416f4433f8f46ed3e08edfe14757377a4796b6"}
Sep 08 15:34:16.577061 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:16.576668    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf" event={"ID":"5c7d7794-5aab-4977-8510-df568b349547","Type":"ContainerStarted","Data":"66e142eb62ab201ff5f66fa83aadd477a7d2d032b79a8904657ba2cff3cbed67"}
Sep 08 15:34:16.577061 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:16.576685    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf" event={"ID":"5c7d7794-5aab-4977-8510-df568b349547","Type":"ContainerStarted","Data":"279a85d83cf987f8bf5f1a9ebaed647104861bed68ddcc4255788e0095cec48b"}
Sep 08 15:34:16.599480 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:16.599407    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-5d68c86c4b-zx5tf" podStartSLOduration=2.076398044 podStartE2EDuration="6.599392503s" totalImagesPullingTime="4.522994459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:34:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:34:16.598087342 +0000 UTC m=+116.958630131" watchObservedRunningTime="2026-09-08 15:34:16.599392503 +0000 UTC m=+116.959935269"
Sep 08 15:34:17.432688 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:17.432646    2579 patch_prober.go:28] interesting pod/image-registry-8679696669-phnvj container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Sep 08 15:34:17.432849 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:17.432711    2579 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-8679696669-phnvj" podUID="65b666ba-f38b-4226-bbc7-ab2b14b07adf" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:34:18.424634 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:18.424591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:18.482416 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:18.482385    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:19.512419 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:19.512391    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:34:19.747717 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:19.747684    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:19.848791 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:19.848762    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:19.962086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:19.959112    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:20.057052 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:20.057011    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:20.130161 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:20.130064    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:20.196020 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:20.195986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:20.637822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:20.637790    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:20.704659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:20.704624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:23.021698 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:23.021656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:23.103454 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:23.103417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:23.753548 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:23.753514    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:25.606033 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:25.605997    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:26.222638 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:26.222603    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:26.323747 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:26.323712    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:27.185055 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.185022    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:27.284604 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.284565    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:27.389806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.389763    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:27.452878 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.452789    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-ksrvp"]
Sep 08 15:34:27.457465 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.457447    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.461407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.461385    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Sep 08 15:34:27.462912 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.462891    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Sep 08 15:34:27.463398 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.463377    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Sep 08 15:34:27.463516 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.463398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gfwpq\""
Sep 08 15:34:27.463516 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.463405    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Sep 08 15:34:27.463516 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.463407    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Sep 08 15:34:27.463516 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.463381    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Sep 08 15:34:27.529363 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.529326    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:27.554370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.554370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554375    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-sys\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.554612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554405    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-wtmp\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.554612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554427    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5bnc\" (UniqueName: \"kubernetes.io/projected/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-kube-api-access-c5bnc\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.554612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554454    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-tls\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.554612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-metrics-client-ca\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.554612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-textfile\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.554612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554596    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.554827 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.554655    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-root\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.621860 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.621830    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:27.655956 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.655918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-textfile\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656079 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.655978    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656079 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656030    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-root\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656079 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656062    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656201 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656096    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-sys\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656201 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656122    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-wtmp\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656201 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656129    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-root\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656201 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656142    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5bnc\" (UniqueName: \"kubernetes.io/projected/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-kube-api-access-c5bnc\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656221    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-sys\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656221    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-tls\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656309    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-wtmp\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656314    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-metrics-client-ca\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656366    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-textfile\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656748 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656721    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-accelerators-collector-config\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.656886 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.656785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-metrics-client-ca\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.658497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.658471    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.658680 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.658659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-node-exporter-tls\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.665335 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.665310    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5bnc\" (UniqueName: \"kubernetes.io/projected/83eb7ece-ab61-41a2-bbd1-dae9c34efa66-kube-api-access-c5bnc\") pod \"node-exporter-ksrvp\" (UID: \"83eb7ece-ab61-41a2-bbd1-dae9c34efa66\") " pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.722012 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.721879    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:27.767237 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:27.767198    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-ksrvp"
Sep 08 15:34:27.778841 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:34:27.778817    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83eb7ece_ab61_41a2_bbd1_dae9c34efa66.slice/crio-5f5c991996c5d89eb31cf6845ee5d1df4e97ade565d6aa7716a2fa58ce4f5a5d WatchSource:0}: Error finding container 5f5c991996c5d89eb31cf6845ee5d1df4e97ade565d6aa7716a2fa58ce4f5a5d: Status 404 returned error can't find the container with id 5f5c991996c5d89eb31cf6845ee5d1df4e97ade565d6aa7716a2fa58ce4f5a5d
Sep 08 15:34:28.038154 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:28.038054    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:28.104111 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:28.104077    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:28.419663 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:28.419635    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:28.502293 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:28.502260    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:28.617552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:28.617513    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksrvp" event={"ID":"83eb7ece-ab61-41a2-bbd1-dae9c34efa66","Type":"ContainerStarted","Data":"5f5c991996c5d89eb31cf6845ee5d1df4e97ade565d6aa7716a2fa58ce4f5a5d"}
Sep 08 15:34:28.788505 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:28.788407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:29.625943 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:29.625896    2579 generic.go:356] "Generic (PLEG): container finished" podID="83eb7ece-ab61-41a2-bbd1-dae9c34efa66" containerID="d03e2d1785c18531aaae4ada71b90bf964ff09063a6ac25b81e251bdc2ce77a0" exitCode=0
Sep 08 15:34:29.626397 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:29.625996    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksrvp" event={"ID":"83eb7ece-ab61-41a2-bbd1-dae9c34efa66","Type":"ContainerDied","Data":"d03e2d1785c18531aaae4ada71b90bf964ff09063a6ac25b81e251bdc2ce77a0"}
Sep 08 15:34:29.974399 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:29.974313    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:34:29.976634 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:29.976614    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/1545a607-e922-4781-af5d-4e80d497ffc1-metrics-certs\") pod \"network-metrics-daemon-7ctjw\" (UID: \"1545a607-e922-4781-af5d-4e80d497ffc1\") " pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:34:30.127076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.127044    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xsqld\""
Sep 08 15:34:30.135379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.135356    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-7ctjw"
Sep 08 15:34:30.364537 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.364505    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:30.404128 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.404097    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-7ctjw"]
Sep 08 15:34:30.407572 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:34:30.407538    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1545a607_e922_4781_af5d_4e80d497ffc1.slice/crio-9bd18cbf5529575d3c93e5c5bddf3f73fe92b6acdf70c72d849c1c574dd731d8 WatchSource:0}: Error finding container 9bd18cbf5529575d3c93e5c5bddf3f73fe92b6acdf70c72d849c1c574dd731d8: Status 404 returned error can't find the container with id 9bd18cbf5529575d3c93e5c5bddf3f73fe92b6acdf70c72d849c1c574dd731d8
Sep 08 15:34:30.461667 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.461623    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:30.631839 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.631744    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksrvp" event={"ID":"83eb7ece-ab61-41a2-bbd1-dae9c34efa66","Type":"ContainerStarted","Data":"57dbea4bbe91618a6ee6eaa14d8a66853ca4252495e063ac0db00d2967206314"}
Sep 08 15:34:30.631839 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.631812    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-ksrvp" event={"ID":"83eb7ece-ab61-41a2-bbd1-dae9c34efa66","Type":"ContainerStarted","Data":"0529834a669fdb4c493b3cfacb88ba28a11c6779eaa7cb94457d811bf9d40df7"}
Sep 08 15:34:30.633040 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.633012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ctjw" event={"ID":"1545a607-e922-4781-af5d-4e80d497ffc1","Type":"ContainerStarted","Data":"9bd18cbf5529575d3c93e5c5bddf3f73fe92b6acdf70c72d849c1c574dd731d8"}
Sep 08 15:34:30.654089 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.654040    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-ksrvp" podStartSLOduration=2.575125588 podStartE2EDuration="3.654023959s" totalImagesPullingTime="1.017988368s" totalInitContainerRuntime="60.910003ms" isStatefulPod=true podCreationTimestamp="2026-09-08 15:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:34:30.653140599 +0000 UTC m=+131.013683365" watchObservedRunningTime="2026-09-08 15:34:30.654023959 +0000 UTC m=+131.014566717"
Sep 08 15:34:30.815384 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.815348    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:30.919459 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:30.919359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:31.638853 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:31.638749    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ctjw" event={"ID":"1545a607-e922-4781-af5d-4e80d497ffc1","Type":"ContainerStarted","Data":"61186b76dc1e1d69489578edb297cb1db927156156c5f0196f5ac81c271ce1fa"}
Sep 08 15:34:31.638853 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:31.638823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-7ctjw" event={"ID":"1545a607-e922-4781-af5d-4e80d497ffc1","Type":"ContainerStarted","Data":"998cc2085782f6826f9e56f3583b1e74c0952e7b29390440a12a40de2c08ce57"}
Sep 08 15:34:31.658349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:31.658298    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-7ctjw" podStartSLOduration=130.69345308 podStartE2EDuration="2m11.65827635s" totalImagesPullingTime="964.82327ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:32:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:34:31.65736334 +0000 UTC m=+132.017906102" watchObservedRunningTime="2026-09-08 15:34:31.65827635 +0000 UTC m=+132.018819114"
Sep 08 15:34:31.764328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:31.764280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:31.899936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:31.899842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:32.172266 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:32.172176    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:32.271327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:32.271292    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:32.729850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:32.729811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:32.824895 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:32.824862    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8679696669-phnvj"]
Sep 08 15:34:32.919153 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:32.919117    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:33.019809 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:33.019727    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:33.120670 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:33.120638    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:33.744895 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:33.744861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:35.389291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:35.389253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:35.489987 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:35.489931    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:35.693331 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:35.693231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:35.794861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:35.794812    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:37.436031 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:37.435999    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:37.536126 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:37.536083    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:44.099387 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:44.099334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:44.201200 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:44.201158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:44.293145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:44.293107    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:44.388711 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:44.388591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:44.568681 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:44.568648    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:44.671463 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:44.671362    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:44.973207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:44.973106    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.073513 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.073475    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.180844 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.180815    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.239597 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.239496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.421613 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.421559    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.525711 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.525612    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.623331 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.623296    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.772047 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.772014    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.873410 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.873376    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:45.973537 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:45.973506    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:46.086572 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:46.086536    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:46.190387 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:46.190301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:47.204705 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:47.204670    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:47.312787 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:47.312754    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:52.355338 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:52.355301    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:52.417585 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:52.417543    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:53.087383 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:53.087341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:53.188546 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:53.188513    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:55.457237 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:55.457192    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:55.589792 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:55.589756    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:57.845379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:57.845338    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-8679696669-phnvj" podUID="65b666ba-f38b-4226-bbc7-ab2b14b07adf" containerName="registry" containerID="cri-o://5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851" gracePeriod=30
Sep 08 15:34:58.075164 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.075138    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:34:58.177844 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.177809    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65b666ba-f38b-4226-bbc7-ab2b14b07adf-ca-trust-extracted\") pod \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") "
Sep 08 15:34:58.177844 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.177846    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-bound-sa-token\") pod \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") "
Sep 08 15:34:58.178125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.177882    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-certificates\") pod \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") "
Sep 08 15:34:58.178125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.177915    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") pod \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") "
Sep 08 15:34:58.178125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.177940    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-image-registry-private-configuration\") pod \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") "
Sep 08 15:34:58.178125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.177992    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7tm95\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-kube-api-access-7tm95\") pod \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") "
Sep 08 15:34:58.178125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.178019    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-installation-pull-secrets\") pod \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") "
Sep 08 15:34:58.178125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.178049    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-trusted-ca\") pod \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\" (UID: \"65b666ba-f38b-4226-bbc7-ab2b14b07adf\") "
Sep 08 15:34:58.178406 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.178300    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "65b666ba-f38b-4226-bbc7-ab2b14b07adf" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:34:58.179118 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.179054    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "65b666ba-f38b-4226-bbc7-ab2b14b07adf" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:34:58.181017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.180988    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "65b666ba-f38b-4226-bbc7-ab2b14b07adf" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:34:58.184911 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.184869    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "65b666ba-f38b-4226-bbc7-ab2b14b07adf" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:34:58.185503 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.185479    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-kube-api-access-7tm95" (OuterVolumeSpecName: "kube-api-access-7tm95") pod "65b666ba-f38b-4226-bbc7-ab2b14b07adf" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf"). InnerVolumeSpecName "kube-api-access-7tm95". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:34:58.185503 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.185488    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "65b666ba-f38b-4226-bbc7-ab2b14b07adf" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:34:58.185813 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.185670    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "65b666ba-f38b-4226-bbc7-ab2b14b07adf" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:34:58.195554 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.195529    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/65b666ba-f38b-4226-bbc7-ab2b14b07adf-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "65b666ba-f38b-4226-bbc7-ab2b14b07adf" (UID: "65b666ba-f38b-4226-bbc7-ab2b14b07adf"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:34:58.279271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.279183    2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/65b666ba-f38b-4226-bbc7-ab2b14b07adf-ca-trust-extracted\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:34:58.279271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.279237    2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-bound-sa-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:34:58.279271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.279250    2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-certificates\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:34:58.279271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.279261    2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-registry-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:34:58.279271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.279271    2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-image-registry-private-configuration\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:34:58.279520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.279280    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7tm95\" (UniqueName: \"kubernetes.io/projected/65b666ba-f38b-4226-bbc7-ab2b14b07adf-kube-api-access-7tm95\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:34:58.279520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.279289    2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/65b666ba-f38b-4226-bbc7-ab2b14b07adf-installation-pull-secrets\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:34:58.279520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.279298    2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/65b666ba-f38b-4226-bbc7-ab2b14b07adf-trusted-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:34:58.616766 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.616722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:58.718015 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.717981    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:34:58.729649 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.729618    2579 generic.go:356] "Generic (PLEG): container finished" podID="65b666ba-f38b-4226-bbc7-ab2b14b07adf" containerID="5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851" exitCode=0
Sep 08 15:34:58.729800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.729680    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-8679696669-phnvj"
Sep 08 15:34:58.729800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.729705    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8679696669-phnvj" event={"ID":"65b666ba-f38b-4226-bbc7-ab2b14b07adf","Type":"ContainerDied","Data":"5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851"}
Sep 08 15:34:58.729800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.729783    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-8679696669-phnvj" event={"ID":"65b666ba-f38b-4226-bbc7-ab2b14b07adf","Type":"ContainerDied","Data":"9c96944c502c014331002c76514e8c3f2b3b2d2538ae4fac57cc5adde5ae0f7d"}
Sep 08 15:34:58.729917 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.729805    2579 scope.go:117] "RemoveContainer" containerID="5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851"
Sep 08 15:34:58.738729 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.738712    2579 scope.go:117] "RemoveContainer" containerID="5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851"
Sep 08 15:34:58.739061 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:34:58.739036    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851\": container with ID starting with 5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851 not found: ID does not exist" containerID="5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851"
Sep 08 15:34:58.739156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.739074    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851"} err="failed to get container status \"5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851\": rpc error: code = NotFound desc = could not find container \"5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851\": container with ID starting with 5297b2ad7e4242620063a204f224c232bbe1ce22f4f093fffe87264a1dfe0851 not found: ID does not exist"
Sep 08 15:34:58.750398 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.750372    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-8679696669-phnvj"]
Sep 08 15:34:58.754445 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:34:58.754424    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-8679696669-phnvj"]
Sep 08 15:35:00.112602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:00.112563    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="65b666ba-f38b-4226-bbc7-ab2b14b07adf" path="/var/lib/kubelet/pods/65b666ba-f38b-4226-bbc7-ab2b14b07adf/volumes"
Sep 08 15:35:02.262914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:02.262875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:02.323546 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:02.323508    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:08.889885 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:08.889852    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:08.952389 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:08.952352    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:09.822191 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:09.822151    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:09.927905 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:09.927863    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:17.795434 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:17.795393    2579 generic.go:356] "Generic (PLEG): container finished" podID="bf2eb183-a8ef-41fb-a0fc-11dd92e7326f" containerID="ef394f4ebc8cbfe9da9dcd8a2c8dbf1446280b398e52d1752e667a4ad9cd9f89" exitCode=0
Sep 08 15:35:17.795434 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:17.795437    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9" event={"ID":"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f","Type":"ContainerDied","Data":"ef394f4ebc8cbfe9da9dcd8a2c8dbf1446280b398e52d1752e667a4ad9cd9f89"}
Sep 08 15:35:17.795879 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:17.795756    2579 scope.go:117] "RemoveContainer" containerID="ef394f4ebc8cbfe9da9dcd8a2c8dbf1446280b398e52d1752e667a4ad9cd9f89"
Sep 08 15:35:18.800820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:18.800788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-76bcd6ccf5-hxzg9" event={"ID":"bf2eb183-a8ef-41fb-a0fc-11dd92e7326f","Type":"ContainerStarted","Data":"0ff155403a7a8ad812f50d57541a807aac5396b39551390e3f62e83004e5c63a"}
Sep 08 15:35:22.407024 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:22.406943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:22.468948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:22.468909    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:43.598435 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:43.598395    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:43.656419 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:43.656387    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:44.186123 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:44.186085    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:44.287027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:44.286992    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:55.439411 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:55.439372    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:56.735003 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:56.734944    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:35:56.796804 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:35:56.796775    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:07.402104 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:07.402063    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:07.496631 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:07.496597    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:21.725649 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:21.725606    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:48.725531 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.725450    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"]
Sep 08 15:36:48.726017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.725688    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="65b666ba-f38b-4226-bbc7-ab2b14b07adf" containerName="registry"
Sep 08 15:36:48.726017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.725698    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="65b666ba-f38b-4226-bbc7-ab2b14b07adf" containerName="registry"
Sep 08 15:36:48.726017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.725739    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="65b666ba-f38b-4226-bbc7-ab2b14b07adf" containerName="registry"
Sep 08 15:36:48.728586 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.728570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.731402 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.731378    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:36:48.732463 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.732447    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:36:48.732540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.732488    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qc6rj\""
Sep 08 15:36:48.740621 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.740597    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"]
Sep 08 15:36:48.745600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.745578    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.745688 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.745619    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.745688 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.745647    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7fkw\" (UniqueName: \"kubernetes.io/projected/c0cda06a-9555-442e-a557-df603b152cda-kube-api-access-s7fkw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.846748 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.846691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.846952 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.846762    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7fkw\" (UniqueName: \"kubernetes.io/projected/c0cda06a-9555-442e-a557-df603b152cda-kube-api-access-s7fkw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.846952 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.846808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.847159 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.847135    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.847220 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.847178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:48.856006 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:48.855979    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7fkw\" (UniqueName: \"kubernetes.io/projected/c0cda06a-9555-442e-a557-df603b152cda-kube-api-access-s7fkw\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:49.037508 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:49.037403    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:36:49.314267 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:49.314184    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"]
Sep 08 15:36:49.317633 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:36:49.317604    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0cda06a_9555_442e_a557_df603b152cda.slice/crio-7a6d9dd97d9663665bfb39c9c5c234d7a8ed3cbd1c041006bc1a79e2c7bf9bf0 WatchSource:0}: Error finding container 7a6d9dd97d9663665bfb39c9c5c234d7a8ed3cbd1c041006bc1a79e2c7bf9bf0: Status 404 returned error can't find the container with id 7a6d9dd97d9663665bfb39c9c5c234d7a8ed3cbd1c041006bc1a79e2c7bf9bf0
Sep 08 15:36:49.483366 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:49.483328    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:49.536741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:49.536713    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:36:50.115683 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:50.114096    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499" event={"ID":"c0cda06a-9555-442e-a557-df603b152cda","Type":"ContainerStarted","Data":"7a6d9dd97d9663665bfb39c9c5c234d7a8ed3cbd1c041006bc1a79e2c7bf9bf0"}
Sep 08 15:36:56.129216 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:56.129182    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0cda06a-9555-442e-a557-df603b152cda" containerID="cc879330d80c46338088ee9549aa6c85911b27110a4bc75c593c4416a5ea127e" exitCode=0
Sep 08 15:36:56.129579 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:56.129250    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499" event={"ID":"c0cda06a-9555-442e-a557-df603b152cda","Type":"ContainerDied","Data":"cc879330d80c46338088ee9549aa6c85911b27110a4bc75c593c4416a5ea127e"}
Sep 08 15:36:59.142307 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:59.142268    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0cda06a-9555-442e-a557-df603b152cda" containerID="a28164d65f8d8e8554b1f8ee8648f6e07bbd5fbdf396bd8180a3994a4aafef64" exitCode=0
Sep 08 15:36:59.142749 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:36:59.142339    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499" event={"ID":"c0cda06a-9555-442e-a557-df603b152cda","Type":"ContainerDied","Data":"a28164d65f8d8e8554b1f8ee8648f6e07bbd5fbdf396bd8180a3994a4aafef64"}
Sep 08 15:37:06.170902 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:06.170864    2579 generic.go:356] "Generic (PLEG): container finished" podID="c0cda06a-9555-442e-a557-df603b152cda" containerID="d3f6328b9c5060210183670b7b1d606b1336ca6fb4bb9262da0fd24840eaef20" exitCode=0
Sep 08 15:37:06.171283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:06.170947    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499" event={"ID":"c0cda06a-9555-442e-a557-df603b152cda","Type":"ContainerDied","Data":"d3f6328b9c5060210183670b7b1d606b1336ca6fb4bb9262da0fd24840eaef20"}
Sep 08 15:37:07.298769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.298735    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:37:07.391742 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.391695    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-bundle\") pod \"c0cda06a-9555-442e-a557-df603b152cda\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") "
Sep 08 15:37:07.391907 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.391769    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s7fkw\" (UniqueName: \"kubernetes.io/projected/c0cda06a-9555-442e-a557-df603b152cda-kube-api-access-s7fkw\") pod \"c0cda06a-9555-442e-a557-df603b152cda\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") "
Sep 08 15:37:07.391907 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.391814    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-util\") pod \"c0cda06a-9555-442e-a557-df603b152cda\" (UID: \"c0cda06a-9555-442e-a557-df603b152cda\") "
Sep 08 15:37:07.392461 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.392425    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-bundle" (OuterVolumeSpecName: "bundle") pod "c0cda06a-9555-442e-a557-df603b152cda" (UID: "c0cda06a-9555-442e-a557-df603b152cda"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:07.393969 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.393940    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c0cda06a-9555-442e-a557-df603b152cda-kube-api-access-s7fkw" (OuterVolumeSpecName: "kube-api-access-s7fkw") pod "c0cda06a-9555-442e-a557-df603b152cda" (UID: "c0cda06a-9555-442e-a557-df603b152cda"). InnerVolumeSpecName "kube-api-access-s7fkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:07.396004 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.395974    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-util" (OuterVolumeSpecName: "util") pod "c0cda06a-9555-442e-a557-df603b152cda" (UID: "c0cda06a-9555-442e-a557-df603b152cda"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:07.492820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.492723    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-util\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:37:07.492820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.492760    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c0cda06a-9555-442e-a557-df603b152cda-bundle\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:37:07.492820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:07.492769    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s7fkw\" (UniqueName: \"kubernetes.io/projected/c0cda06a-9555-442e-a557-df603b152cda-kube-api-access-s7fkw\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:37:08.180498 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:08.180470    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499"
Sep 08 15:37:08.180655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:08.180470    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540df499" event={"ID":"c0cda06a-9555-442e-a557-df603b152cda","Type":"ContainerDied","Data":"7a6d9dd97d9663665bfb39c9c5c234d7a8ed3cbd1c041006bc1a79e2c7bf9bf0"}
Sep 08 15:37:08.180655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:08.180589    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a6d9dd97d9663665bfb39c9c5c234d7a8ed3cbd1c041006bc1a79e2c7bf9bf0"
Sep 08 15:37:08.943573 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:08.943520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:09.816918 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:09.816881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:10.667021 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:10.666985    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:11.762205 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.762173    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"]
Sep 08 15:37:11.762571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.762403    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cda06a-9555-442e-a557-df603b152cda" containerName="pull"
Sep 08 15:37:11.762571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.762414    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cda06a-9555-442e-a557-df603b152cda" containerName="pull"
Sep 08 15:37:11.762571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.762432    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cda06a-9555-442e-a557-df603b152cda" containerName="extract"
Sep 08 15:37:11.762571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.762438    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cda06a-9555-442e-a557-df603b152cda" containerName="extract"
Sep 08 15:37:11.762571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.762447    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c0cda06a-9555-442e-a557-df603b152cda" containerName="util"
Sep 08 15:37:11.762571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.762452    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c0cda06a-9555-442e-a557-df603b152cda" containerName="util"
Sep 08 15:37:11.762571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.762492    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c0cda06a-9555-442e-a557-df603b152cda" containerName="extract"
Sep 08 15:37:11.774155 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.774130    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"
Sep 08 15:37:11.778538 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.778511    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Sep 08 15:37:11.778696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.778666    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-jw889\""
Sep 08 15:37:11.778810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.778786    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:37:11.781530 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.781508    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"]
Sep 08 15:37:11.823876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.823846    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8bzf9\" (UniqueName: \"kubernetes.io/projected/a62ee0df-bf53-472d-b7f4-9341cfecc81c-kube-api-access-8bzf9\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg57s\" (UID: \"a62ee0df-bf53-472d-b7f4-9341cfecc81c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"
Sep 08 15:37:11.824072 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.823897    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a62ee0df-bf53-472d-b7f4-9341cfecc81c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg57s\" (UID: \"a62ee0df-bf53-472d-b7f4-9341cfecc81c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"
Sep 08 15:37:11.925002 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.924939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a62ee0df-bf53-472d-b7f4-9341cfecc81c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg57s\" (UID: \"a62ee0df-bf53-472d-b7f4-9341cfecc81c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"
Sep 08 15:37:11.925171 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.925043    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8bzf9\" (UniqueName: \"kubernetes.io/projected/a62ee0df-bf53-472d-b7f4-9341cfecc81c-kube-api-access-8bzf9\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg57s\" (UID: \"a62ee0df-bf53-472d-b7f4-9341cfecc81c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"
Sep 08 15:37:11.928904 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.928880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a62ee0df-bf53-472d-b7f4-9341cfecc81c-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg57s\" (UID: \"a62ee0df-bf53-472d-b7f4-9341cfecc81c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"
Sep 08 15:37:11.950128 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:11.950096    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8bzf9\" (UniqueName: \"kubernetes.io/projected/a62ee0df-bf53-472d-b7f4-9341cfecc81c-kube-api-access-8bzf9\") pod \"cert-manager-operator-controller-manager-55c444bf86-zg57s\" (UID: \"a62ee0df-bf53-472d-b7f4-9341cfecc81c\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"
Sep 08 15:37:12.083812 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:12.083775    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"
Sep 08 15:37:12.394302 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:12.394228    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s"]
Sep 08 15:37:12.397492 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:37:12.397461    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda62ee0df_bf53_472d_b7f4_9341cfecc81c.slice/crio-70b62c0b6f6c1fc4d9266f2548e590c233aed85a8e45c24f5c71d56d3dcbf033 WatchSource:0}: Error finding container 70b62c0b6f6c1fc4d9266f2548e590c233aed85a8e45c24f5c71d56d3dcbf033: Status 404 returned error can't find the container with id 70b62c0b6f6c1fc4d9266f2548e590c233aed85a8e45c24f5c71d56d3dcbf033
Sep 08 15:37:13.199052 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:13.199013    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s" event={"ID":"a62ee0df-bf53-472d-b7f4-9341cfecc81c","Type":"ContainerStarted","Data":"70b62c0b6f6c1fc4d9266f2548e590c233aed85a8e45c24f5c71d56d3dcbf033"}
Sep 08 15:37:13.634872 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:13.634833    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:13.735283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:13.735250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:15.208734 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.208696    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s" event={"ID":"a62ee0df-bf53-472d-b7f4-9341cfecc81c","Type":"ContainerStarted","Data":"0c77a222dbc9ea86619ef25fddec614d802ab1bfba653b040d856730b8e6f39a"}
Sep 08 15:37:15.235689 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.235636    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-zg57s" podStartSLOduration=2.1291141 podStartE2EDuration="4.235614714s" totalImagesPullingTime="2.106500614s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:15.233477322 +0000 UTC m=+295.594020084" watchObservedRunningTime="2026-09-08 15:37:15.235614714 +0000 UTC m=+295.596157480"
Sep 08 15:37:15.247810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.247777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:15.342693 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.342656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:15.610225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.610183    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:15.681070 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.681035    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nl8bq"]
Sep 08 15:37:15.702548 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.702518    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nl8bq"]
Sep 08 15:37:15.702702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.702608    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:15.705534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.705508    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Sep 08 15:37:15.706643 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.706626    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Sep 08 15:37:15.706737 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.706673    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gmh5b\""
Sep 08 15:37:15.736799 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.736758    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:15.752739 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.752701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6f25632-b904-42be-869f-cd9567d6f789-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nl8bq\" (UID: \"a6f25632-b904-42be-869f-cd9567d6f789\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:15.752881 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.752777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kq88\" (UniqueName: \"kubernetes.io/projected/a6f25632-b904-42be-869f-cd9567d6f789-kube-api-access-9kq88\") pod \"cert-manager-webhook-6486ffd997-nl8bq\" (UID: \"a6f25632-b904-42be-869f-cd9567d6f789\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:15.853802 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.853763    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kq88\" (UniqueName: \"kubernetes.io/projected/a6f25632-b904-42be-869f-cd9567d6f789-kube-api-access-9kq88\") pod \"cert-manager-webhook-6486ffd997-nl8bq\" (UID: \"a6f25632-b904-42be-869f-cd9567d6f789\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:15.853988 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.853815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6f25632-b904-42be-869f-cd9567d6f789-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nl8bq\" (UID: \"a6f25632-b904-42be-869f-cd9567d6f789\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:15.867865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.867806    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kq88\" (UniqueName: \"kubernetes.io/projected/a6f25632-b904-42be-869f-cd9567d6f789-kube-api-access-9kq88\") pod \"cert-manager-webhook-6486ffd997-nl8bq\" (UID: \"a6f25632-b904-42be-869f-cd9567d6f789\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:15.868021 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:15.868001    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a6f25632-b904-42be-869f-cd9567d6f789-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-nl8bq\" (UID: \"a6f25632-b904-42be-869f-cd9567d6f789\") " pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:16.012279 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:16.012242    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:16.305885 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:16.305856    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-nl8bq"]
Sep 08 15:37:16.307090 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:37:16.307059    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda6f25632_b904_42be_869f_cd9567d6f789.slice/crio-37281367b9393112c737cc2ef58012862f9d7b503990d30f9060c5eefa4220ce WatchSource:0}: Error finding container 37281367b9393112c737cc2ef58012862f9d7b503990d30f9060c5eefa4220ce: Status 404 returned error can't find the container with id 37281367b9393112c737cc2ef58012862f9d7b503990d30f9060c5eefa4220ce
Sep 08 15:37:17.219652 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:17.219613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq" event={"ID":"a6f25632-b904-42be-869f-cd9567d6f789","Type":"ContainerStarted","Data":"37281367b9393112c737cc2ef58012862f9d7b503990d30f9060c5eefa4220ce"}
Sep 08 15:37:17.282382 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:17.282346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:17.662407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:17.662364    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:20.010270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:20.010242    2579 kubelet.go:1648] "Image garbage collection succeeded"
Sep 08 15:37:20.422184 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:20.422136    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:20.522274 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:20.522235    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:22.240984 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:22.240937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq" event={"ID":"a6f25632-b904-42be-869f-cd9567d6f789","Type":"ContainerStarted","Data":"ae771f2f2fa756335e063e3667c96e33bad9390edcb27356e721c1f5883bcd69"}
Sep 08 15:37:22.241436 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:22.241006    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:22.257139 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:22.257089    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq" podStartSLOduration=1.888255366 podStartE2EDuration="7.257072537s" totalImagesPullingTime="5.368817171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:22.256403051 +0000 UTC m=+302.616945813" watchObservedRunningTime="2026-09-08 15:37:22.257072537 +0000 UTC m=+302.617615351"
Sep 08 15:37:23.713466 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:23.713428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:25.857758 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:25.857720    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:27.108260 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:27.108220    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:27.161291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:27.161257    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:28.247590 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:28.247562    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-nl8bq"
Sep 08 15:37:38.950872 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:38.950829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:39.049206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:39.049170    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:40.305840 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.305803    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"]
Sep 08 15:37:40.307782 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.307764    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"
Sep 08 15:37:40.310478 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.310453    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Sep 08 15:37:40.311768 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.311740    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-wbhqp\""
Sep 08 15:37:40.312159 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.311825    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Sep 08 15:37:40.317999 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.317950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"]
Sep 08 15:37:40.440859 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.440818    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c60c4dfa-79a0-4aa7-a460-f4bfef54410c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-j74rv\" (UID: \"c60c4dfa-79a0-4aa7-a460-f4bfef54410c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"
Sep 08 15:37:40.440859 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.440857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6kqb\" (UniqueName: \"kubernetes.io/projected/c60c4dfa-79a0-4aa7-a460-f4bfef54410c-kube-api-access-w6kqb\") pod \"openshift-lws-operator-fd8ccff4c-j74rv\" (UID: \"c60c4dfa-79a0-4aa7-a460-f4bfef54410c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"
Sep 08 15:37:40.541531 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.541489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c60c4dfa-79a0-4aa7-a460-f4bfef54410c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-j74rv\" (UID: \"c60c4dfa-79a0-4aa7-a460-f4bfef54410c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"
Sep 08 15:37:40.541531 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.541531    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6kqb\" (UniqueName: \"kubernetes.io/projected/c60c4dfa-79a0-4aa7-a460-f4bfef54410c-kube-api-access-w6kqb\") pod \"openshift-lws-operator-fd8ccff4c-j74rv\" (UID: \"c60c4dfa-79a0-4aa7-a460-f4bfef54410c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"
Sep 08 15:37:40.541983 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.541942    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c60c4dfa-79a0-4aa7-a460-f4bfef54410c-tmp\") pod \"openshift-lws-operator-fd8ccff4c-j74rv\" (UID: \"c60c4dfa-79a0-4aa7-a460-f4bfef54410c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"
Sep 08 15:37:40.551502 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.551479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6kqb\" (UniqueName: \"kubernetes.io/projected/c60c4dfa-79a0-4aa7-a460-f4bfef54410c-kube-api-access-w6kqb\") pod \"openshift-lws-operator-fd8ccff4c-j74rv\" (UID: \"c60c4dfa-79a0-4aa7-a460-f4bfef54410c\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"
Sep 08 15:37:40.622649 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.622603    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"
Sep 08 15:37:40.897708 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.897626    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv"]
Sep 08 15:37:40.900687 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:37:40.900652    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc60c4dfa_79a0_4aa7_a460_f4bfef54410c.slice/crio-60d95d4ed7defa070c1c47b8f9ad3e3ab0860e90c0838beaed96581978032f9a WatchSource:0}: Error finding container 60d95d4ed7defa070c1c47b8f9ad3e3ab0860e90c0838beaed96581978032f9a: Status 404 returned error can't find the container with id 60d95d4ed7defa070c1c47b8f9ad3e3ab0860e90c0838beaed96581978032f9a
Sep 08 15:37:40.902337 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:40.902318    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:37:41.316371 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:41.316283    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv" event={"ID":"c60c4dfa-79a0-4aa7-a460-f4bfef54410c","Type":"ContainerStarted","Data":"60d95d4ed7defa070c1c47b8f9ad3e3ab0860e90c0838beaed96581978032f9a"}
Sep 08 15:37:44.330326 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:44.330284    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv" event={"ID":"c60c4dfa-79a0-4aa7-a460-f4bfef54410c","Type":"ContainerStarted","Data":"75f0c4aa5cee04d2999ecbf151748bbe8e5105f55569ad25525ce61dbee5a527"}
Sep 08 15:37:44.346809 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:44.346755    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-j74rv" podStartSLOduration=1.689641382 podStartE2EDuration="4.346738946s" totalImagesPullingTime="2.657097564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:37:44.345283494 +0000 UTC m=+324.705826266" watchObservedRunningTime="2026-09-08 15:37:44.346738946 +0000 UTC m=+324.707281710"
Sep 08 15:37:45.067131 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:45.067092    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:45.168484 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:45.168448    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:46.705268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.705221    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"]
Sep 08 15:37:46.708519 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.708503    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:46.711115 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.711092    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:37:46.711249 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.711130    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qc6rj\""
Sep 08 15:37:46.712378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.712361    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:37:46.716580 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.716555    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"]
Sep 08 15:37:46.891158 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.891105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:46.891346 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.891178    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wbbgk\" (UniqueName: \"kubernetes.io/projected/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-kube-api-access-wbbgk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:46.891346 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.891200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:46.992494 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.992406    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:46.992494 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.992457    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wbbgk\" (UniqueName: \"kubernetes.io/projected/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-kube-api-access-wbbgk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:46.992682 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.992570    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:46.992827 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.992807    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:46.992864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:46.992848    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:47.003380 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:47.003352    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wbbgk\" (UniqueName: \"kubernetes.io/projected/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-kube-api-access-wbbgk\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:47.018299 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:47.018273    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:47.297083 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:47.296981    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"]
Sep 08 15:37:47.299146 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:37:47.299116    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c7550c6_06ef_4492_b1d5_c22fbe6632a8.slice/crio-a7a79c75afd6e8727256802b8047f067bbdcb8acf084671e5f4f321aa297198b WatchSource:0}: Error finding container a7a79c75afd6e8727256802b8047f067bbdcb8acf084671e5f4f321aa297198b: Status 404 returned error can't find the container with id a7a79c75afd6e8727256802b8047f067bbdcb8acf084671e5f4f321aa297198b
Sep 08 15:37:47.319440 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:47.319416    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:37:47.347867 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:47.347841    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt" event={"ID":"6c7550c6-06ef-4492-b1d5-c22fbe6632a8","Type":"ContainerStarted","Data":"a7a79c75afd6e8727256802b8047f067bbdcb8acf084671e5f4f321aa297198b"}
Sep 08 15:37:48.353154 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:48.353118    2579 generic.go:356] "Generic (PLEG): container finished" podID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerID="8a11365334cd10475f77453da3847369e091849f52118cd527d21ef40fe3698d" exitCode=0
Sep 08 15:37:48.353626 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:48.353192    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt" event={"ID":"6c7550c6-06ef-4492-b1d5-c22fbe6632a8","Type":"ContainerDied","Data":"8a11365334cd10475f77453da3847369e091849f52118cd527d21ef40fe3698d"}
Sep 08 15:37:49.358370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:49.358334    2579 generic.go:356] "Generic (PLEG): container finished" podID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerID="8440f1e589d603f07ce6f30c216347b6fb495742142b8e732a60fbc8ee324a10" exitCode=0
Sep 08 15:37:49.358771 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:49.358408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt" event={"ID":"6c7550c6-06ef-4492-b1d5-c22fbe6632a8","Type":"ContainerDied","Data":"8440f1e589d603f07ce6f30c216347b6fb495742142b8e732a60fbc8ee324a10"}
Sep 08 15:37:50.364411 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:50.364371    2579 generic.go:356] "Generic (PLEG): container finished" podID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerID="93bb5d3fcbda3587b4658e89b226f31a02046f4edbbd3aaeb14dfd2f72f8c2dd" exitCode=0
Sep 08 15:37:50.364828 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:50.364427    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt" event={"ID":"6c7550c6-06ef-4492-b1d5-c22fbe6632a8","Type":"ContainerDied","Data":"93bb5d3fcbda3587b4658e89b226f31a02046f4edbbd3aaeb14dfd2f72f8c2dd"}
Sep 08 15:37:51.492814 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.492789    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:51.628004 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.627875    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-bundle\") pod \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") "
Sep 08 15:37:51.628004 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.627937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wbbgk\" (UniqueName: \"kubernetes.io/projected/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-kube-api-access-wbbgk\") pod \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") "
Sep 08 15:37:51.628004 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.628006    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-util\") pod \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\" (UID: \"6c7550c6-06ef-4492-b1d5-c22fbe6632a8\") "
Sep 08 15:37:51.628680 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.628652    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-bundle" (OuterVolumeSpecName: "bundle") pod "6c7550c6-06ef-4492-b1d5-c22fbe6632a8" (UID: "6c7550c6-06ef-4492-b1d5-c22fbe6632a8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:51.630137 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.630109    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-kube-api-access-wbbgk" (OuterVolumeSpecName: "kube-api-access-wbbgk") pod "6c7550c6-06ef-4492-b1d5-c22fbe6632a8" (UID: "6c7550c6-06ef-4492-b1d5-c22fbe6632a8"). InnerVolumeSpecName "kube-api-access-wbbgk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:37:51.633830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.633674    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-util" (OuterVolumeSpecName: "util") pod "6c7550c6-06ef-4492-b1d5-c22fbe6632a8" (UID: "6c7550c6-06ef-4492-b1d5-c22fbe6632a8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:37:51.729074 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.729033    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-bundle\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:37:51.729074 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.729065    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wbbgk\" (UniqueName: \"kubernetes.io/projected/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-kube-api-access-wbbgk\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:37:51.729074 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:51.729076    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6c7550c6-06ef-4492-b1d5-c22fbe6632a8-util\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:37:52.374316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:52.374233    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt" event={"ID":"6c7550c6-06ef-4492-b1d5-c22fbe6632a8","Type":"ContainerDied","Data":"a7a79c75afd6e8727256802b8047f067bbdcb8acf084671e5f4f321aa297198b"}
Sep 08 15:37:52.374316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:52.374270    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afsrtqt"
Sep 08 15:37:52.374316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:37:52.374282    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7a79c75afd6e8727256802b8047f067bbdcb8acf084671e5f4f321aa297198b"
Sep 08 15:38:00.333779 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.333739    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"]
Sep 08 15:38:00.334213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.334006    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerName="pull"
Sep 08 15:38:00.334213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.334018    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerName="pull"
Sep 08 15:38:00.334213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.334028    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerName="extract"
Sep 08 15:38:00.334213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.334033    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerName="extract"
Sep 08 15:38:00.334213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.334043    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerName="util"
Sep 08 15:38:00.334213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.334049    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerName="util"
Sep 08 15:38:00.334213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.334107    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6c7550c6-06ef-4492-b1d5-c22fbe6632a8" containerName="extract"
Sep 08 15:38:00.336477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.336459    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.339117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.339087    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:38:00.339117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.339105    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:38:00.340197 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.340176    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qc6rj\""
Sep 08 15:38:00.346269 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.346246    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"]
Sep 08 15:38:00.391149 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.391100    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nlfn\" (UniqueName: \"kubernetes.io/projected/57c93b7a-6d99-4d94-9f19-607933445a97-kube-api-access-4nlfn\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.391333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.391199    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.391333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.391222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.492264 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.492218    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.492264 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.492260    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.492485 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.492278    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nlfn\" (UniqueName: \"kubernetes.io/projected/57c93b7a-6d99-4d94-9f19-607933445a97-kube-api-access-4nlfn\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.492631 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.492610    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-util\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.492674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.492649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-bundle\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.514105 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.514070    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nlfn\" (UniqueName: \"kubernetes.io/projected/57c93b7a-6d99-4d94-9f19-607933445a97-kube-api-access-4nlfn\") pod \"8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") " pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.645168 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.645073    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:00.928174 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:00.928084    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"]
Sep 08 15:38:00.931954 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:38:00.931912    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57c93b7a_6d99_4d94_9f19_607933445a97.slice/crio-4d86985c77a4cc93151b254d98788c3eacc17c9c8f939728733e7cf490cdf2b8 WatchSource:0}: Error finding container 4d86985c77a4cc93151b254d98788c3eacc17c9c8f939728733e7cf490cdf2b8: Status 404 returned error can't find the container with id 4d86985c77a4cc93151b254d98788c3eacc17c9c8f939728733e7cf490cdf2b8
Sep 08 15:38:01.411842 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:01.411805    2579 generic.go:356] "Generic (PLEG): container finished" podID="57c93b7a-6d99-4d94-9f19-607933445a97" containerID="a88b6b2877aa1f19b52a64ad62606ce570aa8a3813be06b067509f2226d1d086" exitCode=0
Sep 08 15:38:01.412350 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:01.411848    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9" event={"ID":"57c93b7a-6d99-4d94-9f19-607933445a97","Type":"ContainerDied","Data":"a88b6b2877aa1f19b52a64ad62606ce570aa8a3813be06b067509f2226d1d086"}
Sep 08 15:38:01.412350 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:01.411900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9" event={"ID":"57c93b7a-6d99-4d94-9f19-607933445a97","Type":"ContainerStarted","Data":"4d86985c77a4cc93151b254d98788c3eacc17c9c8f939728733e7cf490cdf2b8"}
Sep 08 15:38:01.512276 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:01.512230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:01.613696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:01.613660    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:02.208011 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.207940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:02.417617 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.417582    2579 generic.go:356] "Generic (PLEG): container finished" podID="57c93b7a-6d99-4d94-9f19-607933445a97" containerID="e52922be759c8ac1a844e8a0a019f1cfc57df424c48619871c32cd46962eb945" exitCode=0
Sep 08 15:38:02.418120 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.417655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9" event={"ID":"57c93b7a-6d99-4d94-9f19-607933445a97","Type":"ContainerDied","Data":"e52922be759c8ac1a844e8a0a019f1cfc57df424c48619871c32cd46962eb945"}
Sep 08 15:38:02.644336 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.644270    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:02.845927 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.845890    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:02.902955 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.902922    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"]
Sep 08 15:38:02.904895 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.904871    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:02.907654 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.907625    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Sep 08 15:38:02.907975 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.907936    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Sep 08 15:38:02.908256 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.908240    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Sep 08 15:38:02.908314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.908268    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pvhm4\""
Sep 08 15:38:02.908393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.908377    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Sep 08 15:38:02.911914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.911893    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bad74b12-756d-4ee7-b686-84dc940a2b88-webhook-cert\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:02.912025 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.911925    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bad74b12-756d-4ee7-b686-84dc940a2b88-manifests\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:02.912025 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.911989    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bad74b12-756d-4ee7-b686-84dc940a2b88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:02.912109 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.912052    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bad74b12-756d-4ee7-b686-84dc940a2b88-tmp\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:02.912109 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.912085    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2kpc\" (UniqueName: \"kubernetes.io/projected/bad74b12-756d-4ee7-b686-84dc940a2b88-kube-api-access-q2kpc\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:02.951499 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:02.951465    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"]
Sep 08 15:38:03.013217 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.013172    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bad74b12-756d-4ee7-b686-84dc940a2b88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.013395 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.013231    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bad74b12-756d-4ee7-b686-84dc940a2b88-tmp\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.013395 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.013261    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2kpc\" (UniqueName: \"kubernetes.io/projected/bad74b12-756d-4ee7-b686-84dc940a2b88-kube-api-access-q2kpc\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.013395 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.013303    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bad74b12-756d-4ee7-b686-84dc940a2b88-webhook-cert\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.013395 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.013327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bad74b12-756d-4ee7-b686-84dc940a2b88-manifests\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.013752 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.013730    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bad74b12-756d-4ee7-b686-84dc940a2b88-manifests\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.015693 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.015662    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bad74b12-756d-4ee7-b686-84dc940a2b88-tmp\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.015852 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.015830    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bad74b12-756d-4ee7-b686-84dc940a2b88-webhook-cert\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.015915 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.015878    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bad74b12-756d-4ee7-b686-84dc940a2b88-apiservice-cert\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.023243 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.023222    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2kpc\" (UniqueName: \"kubernetes.io/projected/bad74b12-756d-4ee7-b686-84dc940a2b88-kube-api-access-q2kpc\") pod \"opendatahub-operator-controller-manager-84d887cf8-nd9pl\" (UID: \"bad74b12-756d-4ee7-b686-84dc940a2b88\") " pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.112929 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.112833    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:03.214036 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.214003    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:03.214243 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.214173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:03.319012 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.318950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:03.429412 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.429319    2579 generic.go:356] "Generic (PLEG): container finished" podID="57c93b7a-6d99-4d94-9f19-607933445a97" containerID="1e07b8b458a6f0f4f2a7caacae189d859f533efc35ad0f5d48474146fe20f6b3" exitCode=0
Sep 08 15:38:03.429412 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.429374    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9" event={"ID":"57c93b7a-6d99-4d94-9f19-607933445a97","Type":"ContainerDied","Data":"1e07b8b458a6f0f4f2a7caacae189d859f533efc35ad0f5d48474146fe20f6b3"}
Sep 08 15:38:03.470183 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.470143    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:03.497254 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.497229    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"]
Sep 08 15:38:03.499251 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:38:03.499230    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbad74b12_756d_4ee7_b686_84dc940a2b88.slice/crio-f4368fd0c016e80230cb76d2bd25397813da29411c8a6e3e6435c5f5fef06cf6 WatchSource:0}: Error finding container f4368fd0c016e80230cb76d2bd25397813da29411c8a6e3e6435c5f5fef06cf6: Status 404 returned error can't find the container with id f4368fd0c016e80230cb76d2bd25397813da29411c8a6e3e6435c5f5fef06cf6
Sep 08 15:38:03.579172 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.579137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:03.717345 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:03.717253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:04.437339 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.437252    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl" event={"ID":"bad74b12-756d-4ee7-b686-84dc940a2b88","Type":"ContainerStarted","Data":"f4368fd0c016e80230cb76d2bd25397813da29411c8a6e3e6435c5f5fef06cf6"}
Sep 08 15:38:04.577318 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.577288    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:04.627047 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.627009    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4nlfn\" (UniqueName: \"kubernetes.io/projected/57c93b7a-6d99-4d94-9f19-607933445a97-kube-api-access-4nlfn\") pod \"57c93b7a-6d99-4d94-9f19-607933445a97\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") "
Sep 08 15:38:04.627222 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.627163    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-bundle\") pod \"57c93b7a-6d99-4d94-9f19-607933445a97\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") "
Sep 08 15:38:04.627222 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.627195    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-util\") pod \"57c93b7a-6d99-4d94-9f19-607933445a97\" (UID: \"57c93b7a-6d99-4d94-9f19-607933445a97\") "
Sep 08 15:38:04.628083 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.628043    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-bundle" (OuterVolumeSpecName: "bundle") pod "57c93b7a-6d99-4d94-9f19-607933445a97" (UID: "57c93b7a-6d99-4d94-9f19-607933445a97"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:38:04.630708 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.630679    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57c93b7a-6d99-4d94-9f19-607933445a97-kube-api-access-4nlfn" (OuterVolumeSpecName: "kube-api-access-4nlfn") pod "57c93b7a-6d99-4d94-9f19-607933445a97" (UID: "57c93b7a-6d99-4d94-9f19-607933445a97"). InnerVolumeSpecName "kube-api-access-4nlfn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:38:04.635929 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.635881    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-util" (OuterVolumeSpecName: "util") pod "57c93b7a-6d99-4d94-9f19-607933445a97" (UID: "57c93b7a-6d99-4d94-9f19-607933445a97"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:38:04.728393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.728297    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4nlfn\" (UniqueName: \"kubernetes.io/projected/57c93b7a-6d99-4d94-9f19-607933445a97-kube-api-access-4nlfn\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:04.728393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.728345    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-bundle\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:04.728393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:04.728360    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/57c93b7a-6d99-4d94-9f19-607933445a97-util\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:05.443209 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:05.443169    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9" event={"ID":"57c93b7a-6d99-4d94-9f19-607933445a97","Type":"ContainerDied","Data":"4d86985c77a4cc93151b254d98788c3eacc17c9c8f939728733e7cf490cdf2b8"}
Sep 08 15:38:05.443209 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:05.443206    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/8e0ea019126e0c85f070b2014e3108eef38b84ccf513200a96dc7d56b0ng6c9"
Sep 08 15:38:05.443636 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:05.443226    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d86985c77a4cc93151b254d98788c3eacc17c9c8f939728733e7cf490cdf2b8"
Sep 08 15:38:05.705977 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:05.705868    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:05.913158 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:05.913114    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:06.448865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:06.448831    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl" event={"ID":"bad74b12-756d-4ee7-b686-84dc940a2b88","Type":"ContainerStarted","Data":"ba0ed25bb6a83eaddadf8495c8f1f67b5a2b289f59fbc119adcfe8594dd844ba"}
Sep 08 15:38:08.459282 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:08.459245    2579 generic.go:356] "Generic (PLEG): container finished" podID="bad74b12-756d-4ee7-b686-84dc940a2b88" containerID="ba0ed25bb6a83eaddadf8495c8f1f67b5a2b289f59fbc119adcfe8594dd844ba" exitCode=0
Sep 08 15:38:08.459678 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:08.459310    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl" event={"ID":"bad74b12-756d-4ee7-b686-84dc940a2b88","Type":"ContainerDied","Data":"ba0ed25bb6a83eaddadf8495c8f1f67b5a2b289f59fbc119adcfe8594dd844ba"}
Sep 08 15:38:11.474526 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:11.474489    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl" event={"ID":"bad74b12-756d-4ee7-b686-84dc940a2b88","Type":"ContainerStarted","Data":"4a6dd527a2bf9b093eaba690846ca0bfff9ad66cf7b5e0b2edced06cc58c8d37"}
Sep 08 15:38:11.474944 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:11.474720    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:11.519273 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:11.519217    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl" podStartSLOduration=3.613381907 podStartE2EDuration="9.519201525s" totalImagesPullingTime="4.862658957s" totalInitContainerRuntime="1.043160661s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:11.51703221 +0000 UTC m=+351.877574975" watchObservedRunningTime="2026-09-08 15:38:11.519201525 +0000 UTC m=+351.879744290"
Sep 08 15:38:16.778568 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:16.778483    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:22.480851 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:22.480812    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-84d887cf8-nd9pl"
Sep 08 15:38:24.265749 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:24.265714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:24.433526 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:24.433485    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:35.164922 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.164870    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:35.252897 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.252864    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6995f664-h9784"]
Sep 08 15:38:35.253156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.253143    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c93b7a-6d99-4d94-9f19-607933445a97" containerName="pull"
Sep 08 15:38:35.253206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.253158    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c93b7a-6d99-4d94-9f19-607933445a97" containerName="pull"
Sep 08 15:38:35.253206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.253166    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c93b7a-6d99-4d94-9f19-607933445a97" containerName="extract"
Sep 08 15:38:35.253206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.253172    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c93b7a-6d99-4d94-9f19-607933445a97" containerName="extract"
Sep 08 15:38:35.253206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.253183    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57c93b7a-6d99-4d94-9f19-607933445a97" containerName="util"
Sep 08 15:38:35.253206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.253188    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="57c93b7a-6d99-4d94-9f19-607933445a97" containerName="util"
Sep 08 15:38:35.253393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.253236    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="57c93b7a-6d99-4d94-9f19-607933445a97" containerName="extract"
Sep 08 15:38:35.260254 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.260229    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.264377 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.264355    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-qwbpn\""
Sep 08 15:38:35.265149 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.265132    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Sep 08 15:38:35.265217 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.265189    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Sep 08 15:38:35.265439 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.265416    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Sep 08 15:38:35.265596 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.265576    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Sep 08 15:38:35.281028 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.281002    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6995f664-h9784"]
Sep 08 15:38:35.344398 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.344366    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:35.362440 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.362411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a31d0753-34ed-4036-9a1c-347b04b47b19-tmp\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.362585 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.362469    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a31d0753-34ed-4036-9a1c-347b04b47b19-tls-certs\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.362585 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.362509    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tx97\" (UniqueName: \"kubernetes.io/projected/a31d0753-34ed-4036-9a1c-347b04b47b19-kube-api-access-9tx97\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.445386 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.445308    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nwbc7"]
Sep 08 15:38:35.448514 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.448498    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:35.452936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.452909    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\""
Sep 08 15:38:35.453155 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.453133    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-fqdjh\""
Sep 08 15:38:35.463418 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.463392    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a31d0753-34ed-4036-9a1c-347b04b47b19-tls-certs\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.463520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.463424    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tx97\" (UniqueName: \"kubernetes.io/projected/a31d0753-34ed-4036-9a1c-347b04b47b19-kube-api-access-9tx97\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.463520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.463468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a31d0753-34ed-4036-9a1c-347b04b47b19-tmp\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.466337 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.466302    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a31d0753-34ed-4036-9a1c-347b04b47b19-tmp\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.466512 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.466490    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/a31d0753-34ed-4036-9a1c-347b04b47b19-tls-certs\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.467062 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.467044    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nwbc7"]
Sep 08 15:38:35.473072 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.473051    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tx97\" (UniqueName: \"kubernetes.io/projected/a31d0753-34ed-4036-9a1c-347b04b47b19-kube-api-access-9tx97\") pod \"kube-auth-proxy-7c6995f664-h9784\" (UID: \"a31d0753-34ed-4036-9a1c-347b04b47b19\") " pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.483613 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.483585    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:35.550391 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.550356    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:35.564123 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.564095    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gm2xp\" (UniqueName: \"kubernetes.io/projected/19426fb2-40b1-4aed-8565-d77c5e28907b-kube-api-access-gm2xp\") pod \"odh-model-controller-7998c67dc4-nwbc7\" (UID: \"19426fb2-40b1-4aed-8565-d77c5e28907b\") " pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:35.564217 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.564152    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19426fb2-40b1-4aed-8565-d77c5e28907b-cert\") pod \"odh-model-controller-7998c67dc4-nwbc7\" (UID: \"19426fb2-40b1-4aed-8565-d77c5e28907b\") " pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:35.569145 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.569126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784"
Sep 08 15:38:35.665451 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.665416    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19426fb2-40b1-4aed-8565-d77c5e28907b-cert\") pod \"odh-model-controller-7998c67dc4-nwbc7\" (UID: \"19426fb2-40b1-4aed-8565-d77c5e28907b\") " pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:35.665624 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.665515    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gm2xp\" (UniqueName: \"kubernetes.io/projected/19426fb2-40b1-4aed-8565-d77c5e28907b-kube-api-access-gm2xp\") pod \"odh-model-controller-7998c67dc4-nwbc7\" (UID: \"19426fb2-40b1-4aed-8565-d77c5e28907b\") " pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:35.665624 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:38:35.665583    2579 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found
Sep 08 15:38:35.665694 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:38:35.665663    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19426fb2-40b1-4aed-8565-d77c5e28907b-cert podName:19426fb2-40b1-4aed-8565-d77c5e28907b nodeName:}" failed. No retries permitted until 2026-09-08 15:38:36.165641888 +0000 UTC m=+376.526184645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19426fb2-40b1-4aed-8565-d77c5e28907b-cert") pod "odh-model-controller-7998c67dc4-nwbc7" (UID: "19426fb2-40b1-4aed-8565-d77c5e28907b") : secret "odh-model-controller-webhook-cert" not found
Sep 08 15:38:35.674767 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.674731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gm2xp\" (UniqueName: \"kubernetes.io/projected/19426fb2-40b1-4aed-8565-d77c5e28907b-kube-api-access-gm2xp\") pod \"odh-model-controller-7998c67dc4-nwbc7\" (UID: \"19426fb2-40b1-4aed-8565-d77c5e28907b\") " pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:35.782378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.782294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:35.848200 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:35.848127    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7c6995f664-h9784"]
Sep 08 15:38:35.850389 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:38:35.850355    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda31d0753_34ed_4036_9a1c_347b04b47b19.slice/crio-a91ee00806fcf84a142f8cce91a1e8b5175933e8660c490deccb9ac0c26ea443 WatchSource:0}: Error finding container a91ee00806fcf84a142f8cce91a1e8b5175933e8660c490deccb9ac0c26ea443: Status 404 returned error can't find the container with id a91ee00806fcf84a142f8cce91a1e8b5175933e8660c490deccb9ac0c26ea443
Sep 08 15:38:36.088289 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.088256    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:36.169688 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.169646    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19426fb2-40b1-4aed-8565-d77c5e28907b-cert\") pod \"odh-model-controller-7998c67dc4-nwbc7\" (UID: \"19426fb2-40b1-4aed-8565-d77c5e28907b\") " pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:36.172002 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.171980    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19426fb2-40b1-4aed-8565-d77c5e28907b-cert\") pod \"odh-model-controller-7998c67dc4-nwbc7\" (UID: \"19426fb2-40b1-4aed-8565-d77c5e28907b\") " pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:36.295597 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.295562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:36.359677 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.359577    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:36.577730 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.577697    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784" event={"ID":"a31d0753-34ed-4036-9a1c-347b04b47b19","Type":"ContainerStarted","Data":"a91ee00806fcf84a142f8cce91a1e8b5175933e8660c490deccb9ac0c26ea443"}
Sep 08 15:38:36.640744 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.640467    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nwbc7"]
Sep 08 15:38:36.643099 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:38:36.643073    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19426fb2_40b1_4aed_8565_d77c5e28907b.slice/crio-85aa5743c3cdf00d964afbe550b62fa8287c059d07af17e0f03551dfb3796bac WatchSource:0}: Error finding container 85aa5743c3cdf00d964afbe550b62fa8287c059d07af17e0f03551dfb3796bac: Status 404 returned error can't find the container with id 85aa5743c3cdf00d964afbe550b62fa8287c059d07af17e0f03551dfb3796bac
Sep 08 15:38:36.695428 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.695390    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"]
Sep 08 15:38:36.701609 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.701589    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.705368 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.705343    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Sep 08 15:38:36.705492 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.705417    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Sep 08 15:38:36.705492 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.705417    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:38:36.705577 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.705547    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-krbl7\""
Sep 08 15:38:36.705728 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.705707    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Sep 08 15:38:36.707808 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.707783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:36.715002 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.714980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"]
Sep 08 15:38:36.774362 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.774327    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.774362 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.774377    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.774579 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.774398    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.774579 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.774485    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.774579 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.774532    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pk9pg\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-kube-api-access-pk9pg\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.774673 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.774590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/82867ee4-c895-49e4-a340-dae61e920819-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.774673 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.774618    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.820991 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.820928    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:36.875777 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.875733    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.875777 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.875782    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.876030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.875806    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.876030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.875844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pk9pg\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-kube-api-access-pk9pg\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.876030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.875868    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/82867ee4-c895-49e4-a340-dae61e920819-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.876030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.875884    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.876030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.875920    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.876482 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.876452    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.878405 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.878380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.878482 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.878379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.878482 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.878389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/82867ee4-c895-49e4-a340-dae61e920819-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.878549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.878503    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.892460 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.892401    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:36.892697 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:36.892675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pk9pg\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-kube-api-access-pk9pg\") pod \"istiod-openshift-gateway-7b7995d5cd-nkwp8\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:37.011815 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:37.011777    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:37.296064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:37.296042    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"]
Sep 08 15:38:37.298274 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:38:37.298249    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82867ee4_c895_49e4_a340_dae61e920819.slice/crio-ad289c09683d36d2020e61fff5f1447b975a474eabdbb082e542524fb6ee4b3b WatchSource:0}: Error finding container ad289c09683d36d2020e61fff5f1447b975a474eabdbb082e542524fb6ee4b3b: Status 404 returned error can't find the container with id ad289c09683d36d2020e61fff5f1447b975a474eabdbb082e542524fb6ee4b3b
Sep 08 15:38:37.582947 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:37.582911    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8" event={"ID":"82867ee4-c895-49e4-a340-dae61e920819","Type":"ContainerStarted","Data":"ad289c09683d36d2020e61fff5f1447b975a474eabdbb082e542524fb6ee4b3b"}
Sep 08 15:38:37.584100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:37.584077    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7" event={"ID":"19426fb2-40b1-4aed-8565-d77c5e28907b","Type":"ContainerStarted","Data":"85aa5743c3cdf00d964afbe550b62fa8287c059d07af17e0f03551dfb3796bac"}
Sep 08 15:38:37.854087 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:37.853870    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:42.293871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.293836    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:38:42.294205 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.293901    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:38:42.611018 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.610978    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7" event={"ID":"19426fb2-40b1-4aed-8565-d77c5e28907b","Type":"ContainerStarted","Data":"b2721fd68cf745dee2553e41dfb23fbd8f7c6cd2b04358c5e39ff87690a287a1"}
Sep 08 15:38:42.611286 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.611264    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:38:42.612986 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.612946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784" event={"ID":"a31d0753-34ed-4036-9a1c-347b04b47b19","Type":"ContainerStarted","Data":"5c102545742d74fed2c68c14b16e09e24e5c12af31ebc6640f57854ca6f15a61"}
Sep 08 15:38:42.614538 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.614518    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8" event={"ID":"82867ee4-c895-49e4-a340-dae61e920819","Type":"ContainerStarted","Data":"36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d"}
Sep 08 15:38:42.614647 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.614634    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:42.654312 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.654257    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7" podStartSLOduration=2.01731453 podStartE2EDuration="7.654237705s" totalImagesPullingTime="5.636923175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:42.652718197 +0000 UTC m=+383.013260988" watchObservedRunningTime="2026-09-08 15:38:42.654237705 +0000 UTC m=+383.014780475"
Sep 08 15:38:42.683649 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.683581    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7c6995f664-h9784" podStartSLOduration=1.196969428 podStartE2EDuration="7.6835599s" totalImagesPullingTime="6.486590472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:42.681525659 +0000 UTC m=+383.042068425" watchObservedRunningTime="2026-09-08 15:38:42.6835599 +0000 UTC m=+383.044102665"
Sep 08 15:38:42.723645 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:42.723595    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8" podStartSLOduration=1.730115609 podStartE2EDuration="6.723578998s" totalImagesPullingTime="4.993463389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:42.721995046 +0000 UTC m=+383.082537817" watchObservedRunningTime="2026-09-08 15:38:42.723578998 +0000 UTC m=+383.084121762"
Sep 08 15:38:43.621511 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:43.621478    2579 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-nkwp8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 15:38:43.621860 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:43.621534    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8" podUID="82867ee4-c895-49e4-a340-dae61e920819" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 15:38:43.832133 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:43.832088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:43.927849 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:43.927756    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:44.875560 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:44.875521    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:45.201781 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:45.201697    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:45.700501 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:45.700457    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:46.620762 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:46.620727    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:47.967439 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:47.967393    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:48.268124 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.268034    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"]
Sep 08 15:38:48.271281 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.271254    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:48.271604 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.271574    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:48.277629 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.277605    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Sep 08 15:38:48.277754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.277690    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4p6cn\""
Sep 08 15:38:48.297598 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.297561    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"]
Sep 08 15:38:48.371605 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.371570    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b6r6g\" (UID: \"c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:48.371791 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.371620    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vt7xb\" (UniqueName: \"kubernetes.io/projected/c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97-kube-api-access-vt7xb\") pod \"llmisvc-controller-manager-777c6bd7d5-b6r6g\" (UID: \"c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:48.472102 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.472067    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vt7xb\" (UniqueName: \"kubernetes.io/projected/c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97-kube-api-access-vt7xb\") pod \"llmisvc-controller-manager-777c6bd7d5-b6r6g\" (UID: \"c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:48.472272 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.472167    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b6r6g\" (UID: \"c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:48.474606 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.474576    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-b6r6g\" (UID: \"c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:48.493011 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.492982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:48.515620 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.515584    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vt7xb\" (UniqueName: \"kubernetes.io/projected/c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97-kube-api-access-vt7xb\") pod \"llmisvc-controller-manager-777c6bd7d5-b6r6g\" (UID: \"c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:48.581292 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.581257    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:48.714520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.714488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:48.884860 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.884768    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"]
Sep 08 15:38:48.888605 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:38:48.888577    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podc9a19fd1_2d9d_4185_ae2f_2c3d4f589d97.slice/crio-d10ee40b9ffe8144a3fb589b01e8dc7f8f080a4d6e5101933c1c1907a0d5d629 WatchSource:0}: Error finding container d10ee40b9ffe8144a3fb589b01e8dc7f8f080a4d6e5101933c1c1907a0d5d629: Status 404 returned error can't find the container with id d10ee40b9ffe8144a3fb589b01e8dc7f8f080a4d6e5101933c1c1907a0d5d629
Sep 08 15:38:48.911078 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:48.911045    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:38:49.650153 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:49.650103    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g" event={"ID":"c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97","Type":"ContainerStarted","Data":"d10ee40b9ffe8144a3fb589b01e8dc7f8f080a4d6e5101933c1c1907a0d5d629"}
Sep 08 15:38:51.100935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.100899    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"]
Sep 08 15:38:51.101376 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.101157    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8" podUID="82867ee4-c895-49e4-a340-dae61e920819" containerName="discovery" containerID="cri-o://36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d" gracePeriod=30
Sep 08 15:38:51.345706 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.345679    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:51.499255 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.499159    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-kubeconfig\") pod \"82867ee4-c895-49e4-a340-dae61e920819\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") "
Sep 08 15:38:51.499255 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.499216    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-dns-cert\") pod \"82867ee4-c895-49e4-a340-dae61e920819\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") "
Sep 08 15:38:51.499468 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.499258    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-ca-configmap\") pod \"82867ee4-c895-49e4-a340-dae61e920819\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") "
Sep 08 15:38:51.499468 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.499284    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-cacerts\") pod \"82867ee4-c895-49e4-a340-dae61e920819\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") "
Sep 08 15:38:51.499468 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.499305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pk9pg\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-kube-api-access-pk9pg\") pod \"82867ee4-c895-49e4-a340-dae61e920819\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") "
Sep 08 15:38:51.499468 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.499357    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-istio-token\") pod \"82867ee4-c895-49e4-a340-dae61e920819\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") "
Sep 08 15:38:51.499468 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.499404    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/82867ee4-c895-49e4-a340-dae61e920819-local-certs\") pod \"82867ee4-c895-49e4-a340-dae61e920819\" (UID: \"82867ee4-c895-49e4-a340-dae61e920819\") "
Sep 08 15:38:51.499792 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.499736    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "82867ee4-c895-49e4-a340-dae61e920819" (UID: "82867ee4-c895-49e4-a340-dae61e920819"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:38:51.501986 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.501927    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-cacerts" (OuterVolumeSpecName: "cacerts") pod "82867ee4-c895-49e4-a340-dae61e920819" (UID: "82867ee4-c895-49e4-a340-dae61e920819"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:38:51.502082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.501950    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "82867ee4-c895-49e4-a340-dae61e920819" (UID: "82867ee4-c895-49e4-a340-dae61e920819"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:38:51.502152 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.502108    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82867ee4-c895-49e4-a340-dae61e920819-local-certs" (OuterVolumeSpecName: "local-certs") pod "82867ee4-c895-49e4-a340-dae61e920819" (UID: "82867ee4-c895-49e4-a340-dae61e920819"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:38:51.502152 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.502128    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-istio-token" (OuterVolumeSpecName: "istio-token") pod "82867ee4-c895-49e4-a340-dae61e920819" (UID: "82867ee4-c895-49e4-a340-dae61e920819"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:38:51.502261 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.502128    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-kube-api-access-pk9pg" (OuterVolumeSpecName: "kube-api-access-pk9pg") pod "82867ee4-c895-49e4-a340-dae61e920819" (UID: "82867ee4-c895-49e4-a340-dae61e920819"). InnerVolumeSpecName "kube-api-access-pk9pg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:38:51.502261 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.502180    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "82867ee4-c895-49e4-a340-dae61e920819" (UID: "82867ee4-c895-49e4-a340-dae61e920819"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:38:51.600780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.600726    2579 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/82867ee4-c895-49e4-a340-dae61e920819-local-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:51.600780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.600754    2579 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-kubeconfig\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:51.600780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.600763    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-dns-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:51.600780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.600772    2579 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/82867ee4-c895-49e4-a340-dae61e920819-istio-csr-ca-configmap\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:51.600780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.600782    2579 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/82867ee4-c895-49e4-a340-dae61e920819-cacerts\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:51.600780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.600791    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pk9pg\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-kube-api-access-pk9pg\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:51.600780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.600800    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82867ee4-c895-49e4-a340-dae61e920819-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:38:51.660750 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.660714    2579 generic.go:356] "Generic (PLEG): container finished" podID="82867ee4-c895-49e4-a340-dae61e920819" containerID="36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d" exitCode=0
Sep 08 15:38:51.660936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.660764    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"
Sep 08 15:38:51.660936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.660793    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8" event={"ID":"82867ee4-c895-49e4-a340-dae61e920819","Type":"ContainerDied","Data":"36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d"}
Sep 08 15:38:51.660936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.660855    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8" event={"ID":"82867ee4-c895-49e4-a340-dae61e920819","Type":"ContainerDied","Data":"ad289c09683d36d2020e61fff5f1447b975a474eabdbb082e542524fb6ee4b3b"}
Sep 08 15:38:51.660936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.660883    2579 scope.go:117] "RemoveContainer" containerID="36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d"
Sep 08 15:38:51.697610 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.697435    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"]
Sep 08 15:38:51.699014 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:51.698985    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-nkwp8"]
Sep 08 15:38:52.115320 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:52.115280    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82867ee4-c895-49e4-a340-dae61e920819" path="/var/lib/kubelet/pods/82867ee4-c895-49e4-a340-dae61e920819/volumes"
Sep 08 15:38:52.177316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:52.177203    2579 scope.go:117] "RemoveContainer" containerID="36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d"
Sep 08 15:38:52.177617 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:38:52.177595    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d\": container with ID starting with 36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d not found: ID does not exist" containerID="36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d"
Sep 08 15:38:52.177705 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:52.177627    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d"} err="failed to get container status \"36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d\": rpc error: code = NotFound desc = could not find container \"36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d\": container with ID starting with 36b8ef0e0e7c0ecc88298d3b3c9026739815f4773c8750fbfca7bc8c299b5e3d not found: ID does not exist"
Sep 08 15:38:52.667510 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:52.667476    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g" event={"ID":"c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97","Type":"ContainerStarted","Data":"42c20be150d5964659c5694926b0673dcd20e966cac065b0d245d8ca6ce1fc00"}
Sep 08 15:38:52.667795 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:52.667769    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:38:52.698184 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:52.698130    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g" podStartSLOduration=1.3619320990000001 podStartE2EDuration="4.698112246s" totalImagesPullingTime="3.336180147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:38:52.696209276 +0000 UTC m=+393.056752042" watchObservedRunningTime="2026-09-08 15:38:52.698112246 +0000 UTC m=+393.058655011"
Sep 08 15:38:53.621942 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:38:53.621910    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nwbc7"
Sep 08 15:39:23.681215 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:23.681179    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-b6r6g"
Sep 08 15:39:36.458601 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:36.458562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:36.550464 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:36.550427    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:40.584877 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.584835    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"]
Sep 08 15:39:40.585265 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.585135    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82867ee4-c895-49e4-a340-dae61e920819" containerName="discovery"
Sep 08 15:39:40.585265 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.585147    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="82867ee4-c895-49e4-a340-dae61e920819" containerName="discovery"
Sep 08 15:39:40.585265 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.585192    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="82867ee4-c895-49e4-a340-dae61e920819" containerName="discovery"
Sep 08 15:39:40.598852 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.598825    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"]
Sep 08 15:39:40.599013 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.598918    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.602078 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.602052    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Sep 08 15:39:40.603152 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.603131    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Sep 08 15:39:40.603271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.603155    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-qc6rj\""
Sep 08 15:39:40.665199 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.665164    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.665199 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.665206    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.665410 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.665231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjq5w\" (UniqueName: \"kubernetes.io/projected/a91d8e2f-bd62-42a5-a1c1-6139b6176869-kube-api-access-mjq5w\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.681553 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.681526    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"]
Sep 08 15:39:40.684760 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.684743    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.694845 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.694817    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"]
Sep 08 15:39:40.766303 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.766263    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.766477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.766318    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.766477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.766373    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.766477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.766404    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6kb98\" (UniqueName: \"kubernetes.io/projected/cefa621f-72b0-42f3-b05d-41a473999156-kube-api-access-6kb98\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.766477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.766438    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.766477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.766468    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjq5w\" (UniqueName: \"kubernetes.io/projected/a91d8e2f-bd62-42a5-a1c1-6139b6176869-kube-api-access-mjq5w\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.766757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.766739    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-bundle\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.766829 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.766810    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-util\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.777655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.777632    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjq5w\" (UniqueName: \"kubernetes.io/projected/a91d8e2f-bd62-42a5-a1c1-6139b6176869-kube-api-access-mjq5w\") pod \"cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") " pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.781693 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.781667    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"]
Sep 08 15:39:40.785215 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.785195    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.794280 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.794258    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"]
Sep 08 15:39:40.867117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.867028    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.867117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.867083    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.867333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.867148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6kb98\" (UniqueName: \"kubernetes.io/projected/cefa621f-72b0-42f3-b05d-41a473999156-kube-api-access-6kb98\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.867333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.867214    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dcqj\" (UniqueName: \"kubernetes.io/projected/c186eb0e-163e-4079-9f74-e3f5bb07c980-kube-api-access-6dcqj\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.867333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.867256    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.867333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.867290    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.867498 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.867482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-util\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.867565 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.867543    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-bundle\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.875910 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.875880    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6kb98\" (UniqueName: \"kubernetes.io/projected/cefa621f-72b0-42f3-b05d-41a473999156-kube-api-access-6kb98\") pod \"eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") " pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:40.890685 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.890654    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"]
Sep 08 15:39:40.894048 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.894033    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:40.902657 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.902634    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"]
Sep 08 15:39:40.908833 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.908809    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:40.967790 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.967746    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dcqj\" (UniqueName: \"kubernetes.io/projected/c186eb0e-163e-4079-9f74-e3f5bb07c980-kube-api-access-6dcqj\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.967907 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.967813    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:40.967907 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.967861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.967907 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.967890    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.968258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.967919    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:40.968258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.967949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zdfg\" (UniqueName: \"kubernetes.io/projected/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-kube-api-access-6zdfg\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:40.968429 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.968391    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-bundle\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.968506 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.968433    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-util\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.977258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.977149    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dcqj\" (UniqueName: \"kubernetes.io/projected/c186eb0e-163e-4079-9f74-e3f5bb07c980-kube-api-access-6dcqj\") pod \"71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") " pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:40.993722 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:40.993693    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:41.068529 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.068489    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:41.068695 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.068544    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:41.068695 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.068575    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zdfg\" (UniqueName: \"kubernetes.io/projected/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-kube-api-access-6zdfg\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:41.068909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.068887    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-util\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:41.069008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.068954    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-bundle\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:41.077929 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.077907    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zdfg\" (UniqueName: \"kubernetes.io/projected/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-kube-api-access-6zdfg\") pod \"aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") " pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:41.093750 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.093726    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:41.182173 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.182119    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"]
Sep 08 15:39:41.184233 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:39:41.184204    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda91d8e2f_bd62_42a5_a1c1_6139b6176869.slice/crio-882f96f3961cfb4dc1845af55cf7fb3d5ffa1fdc036277594033bffe739fd662 WatchSource:0}: Error finding container 882f96f3961cfb4dc1845af55cf7fb3d5ffa1fdc036277594033bffe739fd662: Status 404 returned error can't find the container with id 882f96f3961cfb4dc1845af55cf7fb3d5ffa1fdc036277594033bffe739fd662
Sep 08 15:39:41.203748 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.203724    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:41.272531 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.272497    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"]
Sep 08 15:39:41.276788 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:39:41.276755    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcefa621f_72b0_42f3_b05d_41a473999156.slice/crio-51f8fcb03f2d2f44f3907ca4d3997f18e1a0ef95def3f6df0cf6a778338c66a8 WatchSource:0}: Error finding container 51f8fcb03f2d2f44f3907ca4d3997f18e1a0ef95def3f6df0cf6a778338c66a8: Status 404 returned error can't find the container with id 51f8fcb03f2d2f44f3907ca4d3997f18e1a0ef95def3f6df0cf6a778338c66a8
Sep 08 15:39:41.365956 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.365927    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"]
Sep 08 15:39:41.368403 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:39:41.368363    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc186eb0e_163e_4079_9f74_e3f5bb07c980.slice/crio-4a640a1ad48d10827fe4deda7c138cded7bf78dc4e0939a3d2cf9996dd6a9c8c WatchSource:0}: Error finding container 4a640a1ad48d10827fe4deda7c138cded7bf78dc4e0939a3d2cf9996dd6a9c8c: Status 404 returned error can't find the container with id 4a640a1ad48d10827fe4deda7c138cded7bf78dc4e0939a3d2cf9996dd6a9c8c
Sep 08 15:39:41.481870 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.481836    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"]
Sep 08 15:39:41.540922 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:39:41.540885    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a57490f_11c1_4844_9c91_5ce44fbfe7c3.slice/crio-096d98bdad36b836bb619e0628eae25ac847b2aa5c4dc04cdbc79dc4f1b5719c WatchSource:0}: Error finding container 096d98bdad36b836bb619e0628eae25ac847b2aa5c4dc04cdbc79dc4f1b5719c: Status 404 returned error can't find the container with id 096d98bdad36b836bb619e0628eae25ac847b2aa5c4dc04cdbc79dc4f1b5719c
Sep 08 15:39:41.885796 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.885737    2579 generic.go:356] "Generic (PLEG): container finished" podID="cefa621f-72b0-42f3-b05d-41a473999156" containerID="2ba246dde1ca18bbb7af15353dd8230982e75e70504d98af9ff9b08f57214d51" exitCode=0
Sep 08 15:39:41.886295 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.885828    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv" event={"ID":"cefa621f-72b0-42f3-b05d-41a473999156","Type":"ContainerDied","Data":"2ba246dde1ca18bbb7af15353dd8230982e75e70504d98af9ff9b08f57214d51"}
Sep 08 15:39:41.886295 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.885887    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv" event={"ID":"cefa621f-72b0-42f3-b05d-41a473999156","Type":"ContainerStarted","Data":"51f8fcb03f2d2f44f3907ca4d3997f18e1a0ef95def3f6df0cf6a778338c66a8"}
Sep 08 15:39:41.887711 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.887646    2579 generic.go:356] "Generic (PLEG): container finished" podID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerID="6d021189bf5de98202d34d7b70bd21323fbabdae494268f23ff558fe1c3c0ee1" exitCode=0
Sep 08 15:39:41.887804 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.887738    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4" event={"ID":"c186eb0e-163e-4079-9f74-e3f5bb07c980","Type":"ContainerDied","Data":"6d021189bf5de98202d34d7b70bd21323fbabdae494268f23ff558fe1c3c0ee1"}
Sep 08 15:39:41.887804 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.887792    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4" event={"ID":"c186eb0e-163e-4079-9f74-e3f5bb07c980","Type":"ContainerStarted","Data":"4a640a1ad48d10827fe4deda7c138cded7bf78dc4e0939a3d2cf9996dd6a9c8c"}
Sep 08 15:39:41.889597 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.889574    2579 generic.go:356] "Generic (PLEG): container finished" podID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerID="488b439f406aaec7c627a8ea9f7546afacbd72570b039b08066867ea25b408d7" exitCode=0
Sep 08 15:39:41.889698 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.889600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92" event={"ID":"a91d8e2f-bd62-42a5-a1c1-6139b6176869","Type":"ContainerDied","Data":"488b439f406aaec7c627a8ea9f7546afacbd72570b039b08066867ea25b408d7"}
Sep 08 15:39:41.889698 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.889636    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92" event={"ID":"a91d8e2f-bd62-42a5-a1c1-6139b6176869","Type":"ContainerStarted","Data":"882f96f3961cfb4dc1845af55cf7fb3d5ffa1fdc036277594033bffe739fd662"}
Sep 08 15:39:41.891761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.891534    2579 generic.go:356] "Generic (PLEG): container finished" podID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerID="fbb2d9f5fb22349c8a2903d41597b8f0463a524dbc4b87083cfec55fd3eba197" exitCode=0
Sep 08 15:39:41.891761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.891563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb" event={"ID":"0a57490f-11c1-4844-9c91-5ce44fbfe7c3","Type":"ContainerDied","Data":"fbb2d9f5fb22349c8a2903d41597b8f0463a524dbc4b87083cfec55fd3eba197"}
Sep 08 15:39:41.891761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:41.891597    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb" event={"ID":"0a57490f-11c1-4844-9c91-5ce44fbfe7c3","Type":"ContainerStarted","Data":"096d98bdad36b836bb619e0628eae25ac847b2aa5c4dc04cdbc79dc4f1b5719c"}
Sep 08 15:39:42.899473 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:42.899439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4" event={"ID":"c186eb0e-163e-4079-9f74-e3f5bb07c980","Type":"ContainerStarted","Data":"495833a71f3362b4121816f5788400a1f5d5ce5fb86519689d9c3005411d6dd1"}
Sep 08 15:39:42.902622 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:42.902436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb" event={"ID":"0a57490f-11c1-4844-9c91-5ce44fbfe7c3","Type":"ContainerStarted","Data":"f2c8849f9b8d0f5ccc50e88ed1217c9483e89a85657678298609d9037d7bb12e"}
Sep 08 15:39:43.908305 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:43.908270    2579 generic.go:356] "Generic (PLEG): container finished" podID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerID="71d5b7372a2b4944a8430cf7b7cd51b872519c0ff084430a2dfff9e299ae9e1e" exitCode=0
Sep 08 15:39:43.908718 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:43.908359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92" event={"ID":"a91d8e2f-bd62-42a5-a1c1-6139b6176869","Type":"ContainerDied","Data":"71d5b7372a2b4944a8430cf7b7cd51b872519c0ff084430a2dfff9e299ae9e1e"}
Sep 08 15:39:43.910333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:43.910313    2579 generic.go:356] "Generic (PLEG): container finished" podID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerID="f2c8849f9b8d0f5ccc50e88ed1217c9483e89a85657678298609d9037d7bb12e" exitCode=0
Sep 08 15:39:43.910495 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:43.910403    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb" event={"ID":"0a57490f-11c1-4844-9c91-5ce44fbfe7c3","Type":"ContainerDied","Data":"f2c8849f9b8d0f5ccc50e88ed1217c9483e89a85657678298609d9037d7bb12e"}
Sep 08 15:39:43.912636 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:43.912611    2579 generic.go:356] "Generic (PLEG): container finished" podID="cefa621f-72b0-42f3-b05d-41a473999156" containerID="a8be2f54617bbaac14271d1c8c36570187cc9c8e0d9a1703a995a79a73085fbd" exitCode=0
Sep 08 15:39:43.912714 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:43.912693    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv" event={"ID":"cefa621f-72b0-42f3-b05d-41a473999156","Type":"ContainerDied","Data":"a8be2f54617bbaac14271d1c8c36570187cc9c8e0d9a1703a995a79a73085fbd"}
Sep 08 15:39:43.914918 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:43.914890    2579 generic.go:356] "Generic (PLEG): container finished" podID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerID="495833a71f3362b4121816f5788400a1f5d5ce5fb86519689d9c3005411d6dd1" exitCode=0
Sep 08 15:39:43.915076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:43.914920    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4" event={"ID":"c186eb0e-163e-4079-9f74-e3f5bb07c980","Type":"ContainerDied","Data":"495833a71f3362b4121816f5788400a1f5d5ce5fb86519689d9c3005411d6dd1"}
Sep 08 15:39:44.921692 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:44.921650    2579 generic.go:356] "Generic (PLEG): container finished" podID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerID="0e41d8495284a3804950a4cc44dc8553cf42f2aa365d15548c4f00d584e4e6f4" exitCode=0
Sep 08 15:39:44.922082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:44.921732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4" event={"ID":"c186eb0e-163e-4079-9f74-e3f5bb07c980","Type":"ContainerDied","Data":"0e41d8495284a3804950a4cc44dc8553cf42f2aa365d15548c4f00d584e4e6f4"}
Sep 08 15:39:44.923766 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:44.923744    2579 generic.go:356] "Generic (PLEG): container finished" podID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerID="a746dc325a748715be4f932228bf3f24d7582ec956a4f1499f5b6de5f007c910" exitCode=0
Sep 08 15:39:44.923871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:44.923815    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92" event={"ID":"a91d8e2f-bd62-42a5-a1c1-6139b6176869","Type":"ContainerDied","Data":"a746dc325a748715be4f932228bf3f24d7582ec956a4f1499f5b6de5f007c910"}
Sep 08 15:39:44.925876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:44.925854    2579 generic.go:356] "Generic (PLEG): container finished" podID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerID="928001f8df2de98201ca56a8b8cc3212ad5943a29d51a10305acf0511c5bcd6e" exitCode=0
Sep 08 15:39:44.925991 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:44.925946    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb" event={"ID":"0a57490f-11c1-4844-9c91-5ce44fbfe7c3","Type":"ContainerDied","Data":"928001f8df2de98201ca56a8b8cc3212ad5943a29d51a10305acf0511c5bcd6e"}
Sep 08 15:39:44.927986 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:44.927941    2579 generic.go:356] "Generic (PLEG): container finished" podID="cefa621f-72b0-42f3-b05d-41a473999156" containerID="50ee0cad02de9d4a72ec0dd1047ee98421695c4810f4483973676a7cf2c477b0" exitCode=0
Sep 08 15:39:44.928065 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:44.928001    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv" event={"ID":"cefa621f-72b0-42f3-b05d-41a473999156","Type":"ContainerDied","Data":"50ee0cad02de9d4a72ec0dd1047ee98421695c4810f4483973676a7cf2c477b0"}
Sep 08 15:39:46.070134 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.070104    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:46.112807 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.112776    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-util\") pod \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") "
Sep 08 15:39:46.112951 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.112828    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-bundle\") pod \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") "
Sep 08 15:39:46.112951 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.112923    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zdfg\" (UniqueName: \"kubernetes.io/projected/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-kube-api-access-6zdfg\") pod \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\" (UID: \"0a57490f-11c1-4844-9c91-5ce44fbfe7c3\") "
Sep 08 15:39:46.113362 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.113332    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-bundle" (OuterVolumeSpecName: "bundle") pod "0a57490f-11c1-4844-9c91-5ce44fbfe7c3" (UID: "0a57490f-11c1-4844-9c91-5ce44fbfe7c3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:39:46.113603 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.113552    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:46.116707 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.116678    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-kube-api-access-6zdfg" (OuterVolumeSpecName: "kube-api-access-6zdfg") pod "0a57490f-11c1-4844-9c91-5ce44fbfe7c3" (UID: "0a57490f-11c1-4844-9c91-5ce44fbfe7c3"). InnerVolumeSpecName "kube-api-access-6zdfg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:39:46.118485 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.118448    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-util" (OuterVolumeSpecName: "util") pod "0a57490f-11c1-4844-9c91-5ce44fbfe7c3" (UID: "0a57490f-11c1-4844-9c91-5ce44fbfe7c3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:39:46.133133 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.133111    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:46.137368 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.137347    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:46.214246 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214151    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-bundle\") pod \"cefa621f-72b0-42f3-b05d-41a473999156\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") "
Sep 08 15:39:46.214246 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214196    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6kb98\" (UniqueName: \"kubernetes.io/projected/cefa621f-72b0-42f3-b05d-41a473999156-kube-api-access-6kb98\") pod \"cefa621f-72b0-42f3-b05d-41a473999156\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") "
Sep 08 15:39:46.214246 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214221    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dcqj\" (UniqueName: \"kubernetes.io/projected/c186eb0e-163e-4079-9f74-e3f5bb07c980-kube-api-access-6dcqj\") pod \"c186eb0e-163e-4079-9f74-e3f5bb07c980\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") "
Sep 08 15:39:46.214246 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214244    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-util\") pod \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") "
Sep 08 15:39:46.214563 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214269    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-util\") pod \"cefa621f-72b0-42f3-b05d-41a473999156\" (UID: \"cefa621f-72b0-42f3-b05d-41a473999156\") "
Sep 08 15:39:46.214563 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214297    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjq5w\" (UniqueName: \"kubernetes.io/projected/a91d8e2f-bd62-42a5-a1c1-6139b6176869-kube-api-access-mjq5w\") pod \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") "
Sep 08 15:39:46.214563 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214355    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-bundle\") pod \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\" (UID: \"a91d8e2f-bd62-42a5-a1c1-6139b6176869\") "
Sep 08 15:39:46.214563 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214385    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-bundle\") pod \"c186eb0e-163e-4079-9f74-e3f5bb07c980\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") "
Sep 08 15:39:46.214563 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214430    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-util\") pod \"c186eb0e-163e-4079-9f74-e3f5bb07c980\" (UID: \"c186eb0e-163e-4079-9f74-e3f5bb07c980\") "
Sep 08 15:39:46.214810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214675    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-util\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.214810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214694    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-bundle\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.214810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.214706    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zdfg\" (UniqueName: \"kubernetes.io/projected/0a57490f-11c1-4844-9c91-5ce44fbfe7c3-kube-api-access-6zdfg\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.215227 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.215193    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-bundle" (OuterVolumeSpecName: "bundle") pod "cefa621f-72b0-42f3-b05d-41a473999156" (UID: "cefa621f-72b0-42f3-b05d-41a473999156"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:39:46.215336 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.215285    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-bundle" (OuterVolumeSpecName: "bundle") pod "a91d8e2f-bd62-42a5-a1c1-6139b6176869" (UID: "a91d8e2f-bd62-42a5-a1c1-6139b6176869"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:39:46.215710 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.215680    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-bundle" (OuterVolumeSpecName: "bundle") pod "c186eb0e-163e-4079-9f74-e3f5bb07c980" (UID: "c186eb0e-163e-4079-9f74-e3f5bb07c980"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:39:46.216878 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.216846    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cefa621f-72b0-42f3-b05d-41a473999156-kube-api-access-6kb98" (OuterVolumeSpecName: "kube-api-access-6kb98") pod "cefa621f-72b0-42f3-b05d-41a473999156" (UID: "cefa621f-72b0-42f3-b05d-41a473999156"). InnerVolumeSpecName "kube-api-access-6kb98". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:39:46.216878 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.216853    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c186eb0e-163e-4079-9f74-e3f5bb07c980-kube-api-access-6dcqj" (OuterVolumeSpecName: "kube-api-access-6dcqj") pod "c186eb0e-163e-4079-9f74-e3f5bb07c980" (UID: "c186eb0e-163e-4079-9f74-e3f5bb07c980"). InnerVolumeSpecName "kube-api-access-6dcqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:39:46.217092 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.217074    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a91d8e2f-bd62-42a5-a1c1-6139b6176869-kube-api-access-mjq5w" (OuterVolumeSpecName: "kube-api-access-mjq5w") pod "a91d8e2f-bd62-42a5-a1c1-6139b6176869" (UID: "a91d8e2f-bd62-42a5-a1c1-6139b6176869"). InnerVolumeSpecName "kube-api-access-mjq5w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:39:46.220260 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.220235    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-util" (OuterVolumeSpecName: "util") pod "cefa621f-72b0-42f3-b05d-41a473999156" (UID: "cefa621f-72b0-42f3-b05d-41a473999156"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:39:46.221066 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.221047    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-util" (OuterVolumeSpecName: "util") pod "a91d8e2f-bd62-42a5-a1c1-6139b6176869" (UID: "a91d8e2f-bd62-42a5-a1c1-6139b6176869"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:39:46.221116 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.221074    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-util" (OuterVolumeSpecName: "util") pod "c186eb0e-163e-4079-9f74-e3f5bb07c980" (UID: "c186eb0e-163e-4079-9f74-e3f5bb07c980"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:39:46.315910 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315873    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-bundle\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.315910 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315904    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6kb98\" (UniqueName: \"kubernetes.io/projected/cefa621f-72b0-42f3-b05d-41a473999156-kube-api-access-6kb98\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.315910 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315915    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dcqj\" (UniqueName: \"kubernetes.io/projected/c186eb0e-163e-4079-9f74-e3f5bb07c980-kube-api-access-6dcqj\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.316138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315925    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-util\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.316138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315933    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cefa621f-72b0-42f3-b05d-41a473999156-util\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.316138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315942    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjq5w\" (UniqueName: \"kubernetes.io/projected/a91d8e2f-bd62-42a5-a1c1-6139b6176869-kube-api-access-mjq5w\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.316138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315950    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a91d8e2f-bd62-42a5-a1c1-6139b6176869-bundle\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.316138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315975    2579 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-bundle\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.316138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.315991    2579 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c186eb0e-163e-4079-9f74-e3f5bb07c980-util\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:39:46.939729 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.939697    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92" event={"ID":"a91d8e2f-bd62-42a5-a1c1-6139b6176869","Type":"ContainerDied","Data":"882f96f3961cfb4dc1845af55cf7fb3d5ffa1fdc036277594033bffe739fd662"}
Sep 08 15:39:46.939923 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.939752    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="882f96f3961cfb4dc1845af55cf7fb3d5ffa1fdc036277594033bffe739fd662"
Sep 08 15:39:46.939923 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.939706    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/cd2c7243cb31b10fd1249163c10d5ea652384acf3e15d0664e86d7183cnct92"
Sep 08 15:39:46.941747 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.941720    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb"
Sep 08 15:39:46.941747 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.941741    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/aa4484d327db8038362a08ac827b2b7d95fdfb52c243a86a3fcc5d78bbbnjsb" event={"ID":"0a57490f-11c1-4844-9c91-5ce44fbfe7c3","Type":"ContainerDied","Data":"096d98bdad36b836bb619e0628eae25ac847b2aa5c4dc04cdbc79dc4f1b5719c"}
Sep 08 15:39:46.941926 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.941777    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="096d98bdad36b836bb619e0628eae25ac847b2aa5c4dc04cdbc79dc4f1b5719c"
Sep 08 15:39:46.943701 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.943678    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv"
Sep 08 15:39:46.943811 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.943675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/eb753013ef17676ca428dee58520cdfd0d566802382f786ec048d87053htwnv" event={"ID":"cefa621f-72b0-42f3-b05d-41a473999156","Type":"ContainerDied","Data":"51f8fcb03f2d2f44f3907ca4d3997f18e1a0ef95def3f6df0cf6a778338c66a8"}
Sep 08 15:39:46.943811 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.943794    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="51f8fcb03f2d2f44f3907ca4d3997f18e1a0ef95def3f6df0cf6a778338c66a8"
Sep 08 15:39:46.945618 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.945598    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4" event={"ID":"c186eb0e-163e-4079-9f74-e3f5bb07c980","Type":"ContainerDied","Data":"4a640a1ad48d10827fe4deda7c138cded7bf78dc4e0939a3d2cf9996dd6a9c8c"}
Sep 08 15:39:46.945717 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.945629    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4a640a1ad48d10827fe4deda7c138cded7bf78dc4e0939a3d2cf9996dd6a9c8c"
Sep 08 15:39:46.945717 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:46.945629    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/71cfa9a46429353ffda10db9087bedfaf65d54e1add7115bd006bed3a0hg9b4"
Sep 08 15:39:51.534572 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:51.534541    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:53.573434 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573391    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"]
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573782    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerName="pull"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573799    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerName="pull"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573811    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cefa621f-72b0-42f3-b05d-41a473999156" containerName="extract"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573820    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cefa621f-72b0-42f3-b05d-41a473999156" containerName="extract"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573837    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerName="extract"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573845    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerName="extract"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573855    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerName="util"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573862    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerName="util"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573869    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerName="pull"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573876    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerName="pull"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573886    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerName="extract"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573893    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerName="extract"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573905    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerName="util"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573913    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerName="util"
Sep 08 15:39:53.573914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573921    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerName="pull"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573929    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerName="pull"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573945    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cefa621f-72b0-42f3-b05d-41a473999156" containerName="pull"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573953    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cefa621f-72b0-42f3-b05d-41a473999156" containerName="pull"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573984    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerName="util"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.573992    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerName="util"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.574001    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerName="extract"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.574008    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerName="extract"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.574024    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cefa621f-72b0-42f3-b05d-41a473999156" containerName="util"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.574031    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cefa621f-72b0-42f3-b05d-41a473999156" containerName="util"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.574110    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a91d8e2f-bd62-42a5-a1c1-6139b6176869" containerName="extract"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.574123    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cefa621f-72b0-42f3-b05d-41a473999156" containerName="extract"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.574131    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a57490f-11c1-4844-9c91-5ce44fbfe7c3" containerName="extract"
Sep 08 15:39:53.574602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.574144    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c186eb0e-163e-4079-9f74-e3f5bb07c980" containerName="extract"
Sep 08 15:39:53.576739 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.576719    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:39:53.579513 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.579493    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Sep 08 15:39:53.579513 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.579506    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-v7pb9\""
Sep 08 15:39:53.580614 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.580595    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Sep 08 15:39:53.585948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.585925    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"]
Sep 08 15:39:53.676391 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.676350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8gf9\" (UniqueName: \"kubernetes.io/projected/1ea383d8-a1d0-45b3-b53e-308b733425e7-kube-api-access-l8gf9\") pod \"limitador-operator-controller-manager-6c549b6d85-4rb8s\" (UID: \"1ea383d8-a1d0-45b3-b53e-308b733425e7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:39:53.777343 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.777304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gf9\" (UniqueName: \"kubernetes.io/projected/1ea383d8-a1d0-45b3-b53e-308b733425e7-kube-api-access-l8gf9\") pod \"limitador-operator-controller-manager-6c549b6d85-4rb8s\" (UID: \"1ea383d8-a1d0-45b3-b53e-308b733425e7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:39:53.792805 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.792769    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8gf9\" (UniqueName: \"kubernetes.io/projected/1ea383d8-a1d0-45b3-b53e-308b733425e7-kube-api-access-l8gf9\") pod \"limitador-operator-controller-manager-6c549b6d85-4rb8s\" (UID: \"1ea383d8-a1d0-45b3-b53e-308b733425e7\") " pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:39:53.832838 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.832804    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:53.887161 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.887126    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:39:53.932575 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:53.932492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:54.128213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:54.128125    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:54.157513 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:54.157449    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"]
Sep 08 15:39:54.159781 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:39:54.159755    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ea383d8_a1d0_45b3_b53e_308b733425e7.slice/crio-745593c782ce7a3d180bc0b39f5022a9a764cb2922794e5acac0068dab4e84ac WatchSource:0}: Error finding container 745593c782ce7a3d180bc0b39f5022a9a764cb2922794e5acac0068dab4e84ac: Status 404 returned error can't find the container with id 745593c782ce7a3d180bc0b39f5022a9a764cb2922794e5acac0068dab4e84ac
Sep 08 15:39:54.543031 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:54.542934    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:54.947112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:54.947080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:54.982762 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:54.982721    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s" event={"ID":"1ea383d8-a1d0-45b3-b53e-308b733425e7","Type":"ContainerStarted","Data":"745593c782ce7a3d180bc0b39f5022a9a764cb2922794e5acac0068dab4e84ac"}
Sep 08 15:39:55.690874 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.690832    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:55.814651 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.814617    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ccbc7cdd8-zzsgl"]
Sep 08 15:39:55.817110 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.817092    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:55.820627 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.820606    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Sep 08 15:39:55.821068 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.821054    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Sep 08 15:39:55.821812 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.821793    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Sep 08 15:39:55.821909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.821806    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Sep 08 15:39:55.821909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.821859    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7kl9k\""
Sep 08 15:39:55.821909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.821890    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Sep 08 15:39:55.823284 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.823262    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Sep 08 15:39:55.823503 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.823478    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Sep 08 15:39:55.828474 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.828455    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Sep 08 15:39:55.835851 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.835828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:55.837637 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.837616    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ccbc7cdd8-zzsgl"]
Sep 08 15:39:55.899126 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.899083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6b69r\" (UniqueName: \"kubernetes.io/projected/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-kube-api-access-6b69r\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:55.899126 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.899131    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-service-ca\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:55.899327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.899156    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-trusted-ca-bundle\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:55.899327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.899241    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-oauth-config\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:55.899327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.899288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-serving-cert\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:55.899447 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.899336    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-oauth-serving-cert\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:55.899447 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.899373    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-config\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:55.932288 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:55.932254    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:56.000619 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.000533    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-config\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.000619 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.000567    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6b69r\" (UniqueName: \"kubernetes.io/projected/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-kube-api-access-6b69r\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.000619 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.000586    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-service-ca\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.000619 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.000610    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-trusted-ca-bundle\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.001259 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.000650    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-oauth-config\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.001259 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.000685    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-serving-cert\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.001259 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.000721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-oauth-serving-cert\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.001539 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.001502    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-service-ca\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.001612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.001514    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-oauth-serving-cert\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.001612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.001556    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-config\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.001686 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.001636    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-trusted-ca-bundle\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.003179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.003158    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-oauth-config\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.003484 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.003464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-console-serving-cert\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.011865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.011845    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6b69r\" (UniqueName: \"kubernetes.io/projected/7046d96c-c2f6-4a45-b9e9-d95e1980ada1-kube-api-access-6b69r\") pod \"console-ccbc7cdd8-zzsgl\" (UID: \"7046d96c-c2f6-4a45-b9e9-d95e1980ada1\") " pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.126584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.126550    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:39:56.404640 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.404612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ccbc7cdd8-zzsgl"]
Sep 08 15:39:56.406924 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:39:56.406894    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7046d96c_c2f6_4a45_b9e9_d95e1980ada1.slice/crio-2d9f5994ace99031072b2fdca1fcf3bd9e20ec1dfcf1f8fcde4930194e19176a WatchSource:0}: Error finding container 2d9f5994ace99031072b2fdca1fcf3bd9e20ec1dfcf1f8fcde4930194e19176a: Status 404 returned error can't find the container with id 2d9f5994ace99031072b2fdca1fcf3bd9e20ec1dfcf1f8fcde4930194e19176a
Sep 08 15:39:56.995911 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:56.995871    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccbc7cdd8-zzsgl" event={"ID":"7046d96c-c2f6-4a45-b9e9-d95e1980ada1","Type":"ContainerStarted","Data":"2d9f5994ace99031072b2fdca1fcf3bd9e20ec1dfcf1f8fcde4930194e19176a"}
Sep 08 15:39:57.850912 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:57.850871    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:57.890917 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:57.890832    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"]
Sep 08 15:39:57.896475 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:57.896444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:39:57.900425 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:57.900398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pmd7w\""
Sep 08 15:39:57.914447 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:57.914420    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"]
Sep 08 15:39:58.018780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.018735    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" (UID: \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:39:58.018951 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.018885    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnghc\" (UniqueName: \"kubernetes.io/projected/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-kube-api-access-bnghc\") pod \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" (UID: \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:39:58.119727 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.119691    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" (UID: \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:39:58.119912 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.119808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnghc\" (UniqueName: \"kubernetes.io/projected/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-kube-api-access-bnghc\") pod \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" (UID: \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:39:58.120184 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.120152    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" (UID: \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:39:58.146830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.146757    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnghc\" (UniqueName: \"kubernetes.io/projected/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-kube-api-access-bnghc\") pod \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" (UID: \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:39:58.210999 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.210948    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:39:58.577660 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.577620    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:58.848184 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.848080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:39:58.960587 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:39:58.960519    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:00.015233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.015196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccbc7cdd8-zzsgl" event={"ID":"7046d96c-c2f6-4a45-b9e9-d95e1980ada1","Type":"ContainerStarted","Data":"ca6c5105f4895b2c8f2274e351aaccaa0d3269ec94df0287a3ee7eb0c22de595"}
Sep 08 15:40:00.017111 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.017085    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s" event={"ID":"1ea383d8-a1d0-45b3-b53e-308b733425e7","Type":"ContainerStarted","Data":"3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7"}
Sep 08 15:40:00.017215 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.017163    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:40:00.067517 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.067465    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ccbc7cdd8-zzsgl" podStartSLOduration=1.582060699 podStartE2EDuration="5.067445177s" totalImagesPullingTime="3.485384478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:39:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:00.066625992 +0000 UTC m=+460.427168756" watchObservedRunningTime="2026-09-08 15:40:00.067445177 +0000 UTC m=+460.427987943"
Sep 08 15:40:00.114599 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.114542    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s" podStartSLOduration=1.385503569 podStartE2EDuration="7.114526667s" totalImagesPullingTime="5.729023098s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:39:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:00.11359119 +0000 UTC m=+460.474133956" watchObservedRunningTime="2026-09-08 15:40:00.114526667 +0000 UTC m=+460.475069431"
Sep 08 15:40:00.171259 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.171177    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"]
Sep 08 15:40:00.174182 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:40:00.174156    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2a8fa99e_4f61_466d_9eaa_fafcd64b24a3.slice/crio-1444bafa1947fbf03f5b458511866565fe75e68d92de963c72d0b62eda65c114 WatchSource:0}: Error finding container 1444bafa1947fbf03f5b458511866565fe75e68d92de963c72d0b62eda65c114: Status 404 returned error can't find the container with id 1444bafa1947fbf03f5b458511866565fe75e68d92de963c72d0b62eda65c114
Sep 08 15:40:00.358019 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.357983    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"]
Sep 08 15:40:00.361539 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.361523    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:40:00.365041 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.365014    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-skph5\""
Sep 08 15:40:00.365181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.365147    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Sep 08 15:40:00.377010 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.376983    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"]
Sep 08 15:40:00.394384 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.394358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:00.438668 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.438590    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6cb6\" (UniqueName: \"kubernetes.io/projected/f6d111e5-0008-4732-b38c-076d1ebcc88b-kube-api-access-d6cb6\") pod \"dns-operator-controller-manager-5985564776-f68xm\" (UID: \"f6d111e5-0008-4732-b38c-076d1ebcc88b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:40:00.509724 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.509686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:00.539668 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.539635    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6cb6\" (UniqueName: \"kubernetes.io/projected/f6d111e5-0008-4732-b38c-076d1ebcc88b-kube-api-access-d6cb6\") pod \"dns-operator-controller-manager-5985564776-f68xm\" (UID: \"f6d111e5-0008-4732-b38c-076d1ebcc88b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:40:00.558015 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.557987    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6cb6\" (UniqueName: \"kubernetes.io/projected/f6d111e5-0008-4732-b38c-076d1ebcc88b-kube-api-access-d6cb6\") pod \"dns-operator-controller-manager-5985564776-f68xm\" (UID: \"f6d111e5-0008-4732-b38c-076d1ebcc88b\") " pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:40:00.675806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.675770    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:40:00.960681 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.960645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:00.961542 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:00.961523    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"]
Sep 08 15:40:00.963647 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:40:00.963617    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6d111e5_0008_4732_b38c_076d1ebcc88b.slice/crio-d2c6181e132ee1989b38ab003a327c85245d7263d8041869f1e4d40d62c1c13f WatchSource:0}: Error finding container d2c6181e132ee1989b38ab003a327c85245d7263d8041869f1e4d40d62c1c13f: Status 404 returned error can't find the container with id d2c6181e132ee1989b38ab003a327c85245d7263d8041869f1e4d40d62c1c13f
Sep 08 15:40:01.023645 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:01.023557    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm" event={"ID":"f6d111e5-0008-4732-b38c-076d1ebcc88b","Type":"ContainerStarted","Data":"d2c6181e132ee1989b38ab003a327c85245d7263d8041869f1e4d40d62c1c13f"}
Sep 08 15:40:01.024939 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:01.024914    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds" event={"ID":"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3","Type":"ContainerStarted","Data":"1444bafa1947fbf03f5b458511866565fe75e68d92de963c72d0b62eda65c114"}
Sep 08 15:40:01.082046 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:01.082007    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:01.673477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:01.673442    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:03.040304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.040265    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm" event={"ID":"f6d111e5-0008-4732-b38c-076d1ebcc88b","Type":"ContainerStarted","Data":"f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd"}
Sep 08 15:40:03.040663 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.040372    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:40:03.058036 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.057986    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm" podStartSLOduration=1.054897743 podStartE2EDuration="3.057955812s" totalImagesPullingTime="2.003058069s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:40:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:03.057061105 +0000 UTC m=+463.417603866" watchObservedRunningTime="2026-09-08 15:40:03.057955812 +0000 UTC m=+463.418498577"
Sep 08 15:40:03.146180 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.146143    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vbf66"]
Sep 08 15:40:03.149536 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.149509    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:40:03.152413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.152391    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-sjv2h\""
Sep 08 15:40:03.163853 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.163826    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vbf66"]
Sep 08 15:40:03.265803 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.265715    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxtxw\" (UniqueName: \"kubernetes.io/projected/7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b-kube-api-access-gxtxw\") pod \"authorino-operator-68d88948d8-vbf66\" (UID: \"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b\") " pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:40:03.367158 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.367124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxtxw\" (UniqueName: \"kubernetes.io/projected/7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b-kube-api-access-gxtxw\") pod \"authorino-operator-68d88948d8-vbf66\" (UID: \"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b\") " pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:40:03.382229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.382191    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxtxw\" (UniqueName: \"kubernetes.io/projected/7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b-kube-api-access-gxtxw\") pod \"authorino-operator-68d88948d8-vbf66\" (UID: \"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b\") " pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:40:03.459297 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.459250    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:40:03.730126 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:03.730100    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vbf66"]
Sep 08 15:40:03.732198 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:40:03.732171    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5b8fd0_23f6_4e7c_a0f4_2b6f8b4e756b.slice/crio-9a25da2dd226b340a70ddfaa20ff57fdb0e207a38daed66dcc1abc0ebd29ae4b WatchSource:0}: Error finding container 9a25da2dd226b340a70ddfaa20ff57fdb0e207a38daed66dcc1abc0ebd29ae4b: Status 404 returned error can't find the container with id 9a25da2dd226b340a70ddfaa20ff57fdb0e207a38daed66dcc1abc0ebd29ae4b
Sep 08 15:40:04.046429 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:04.046338    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66" event={"ID":"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b","Type":"ContainerStarted","Data":"9a25da2dd226b340a70ddfaa20ff57fdb0e207a38daed66dcc1abc0ebd29ae4b"}
Sep 08 15:40:04.355701 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:04.355673    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:04.527428 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:04.527383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:06.126938 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:06.126907    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:40:06.127410 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:06.126982    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:40:06.132117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:06.132094    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:40:07.065640 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:07.065609    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ccbc7cdd8-zzsgl"
Sep 08 15:40:07.275480 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:07.275387    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:07.371532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:07.371484    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:07.471039 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:07.470997    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:08.070193 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.070095    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66" event={"ID":"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b","Type":"ContainerStarted","Data":"cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5"}
Sep 08 15:40:08.070373 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.070196    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:40:08.089741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.089675    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66" podStartSLOduration=1.271393943 podStartE2EDuration="5.089652145s" totalImagesPullingTime="3.818258202s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:40:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:08.089085879 +0000 UTC m=+468.449628687" watchObservedRunningTime="2026-09-08 15:40:08.089652145 +0000 UTC m=+468.450194913"
Sep 08 15:40:08.150695 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.150637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:08.252237 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.252198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:08.544716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.544667    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:08.621146 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.621104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:08.775492 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.775422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:08.877189 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:08.877155    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:10.083109 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:10.083076    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds" event={"ID":"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3","Type":"ContainerStarted","Data":"ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23"}
Sep 08 15:40:10.083495 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:10.083221    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:10.106142 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:10.105486    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds" podStartSLOduration=3.798475645 podStartE2EDuration="13.105467525s" totalImagesPullingTime="9.30699188s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:10.103749613 +0000 UTC m=+470.464292380" watchObservedRunningTime="2026-09-08 15:40:10.105467525 +0000 UTC m=+470.466010290"
Sep 08 15:40:11.028101 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:11.028069    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:40:12.104823 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.104788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:12.105276 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.104930    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"]
Sep 08 15:40:12.108471 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.108451    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.110972 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.110933    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Sep 08 15:40:12.110972 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.110935    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Sep 08 15:40:12.111131 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.110936    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g8pqv\""
Sep 08 15:40:12.116945 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.116924    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"]
Sep 08 15:40:12.241595 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.241563    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.241595 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.241599    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.241817 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.241638    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xn9km\" (UniqueName: \"kubernetes.io/projected/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-kube-api-access-xn9km\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.268562 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.268523    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:12.342860 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.342824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xn9km\" (UniqueName: \"kubernetes.io/projected/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-kube-api-access-xn9km\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.343075 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.342893    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.343075 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.342913    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.343540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.343508    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-nginx-conf\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.345333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.345308    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-plugin-serving-cert\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.351235 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.351210    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xn9km\" (UniqueName: \"kubernetes.io/projected/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-kube-api-access-xn9km\") pod \"kuadrant-console-plugin-598f86468b-mkbz9\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") " pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.418979 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.418877    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 15:40:12.695041 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:12.694938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"]
Sep 08 15:40:12.699323 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:40:12.699299    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa46a3da_3121_4db0_b7ff_0016ee0bfd28.slice/crio-560d505ffadd6c2b50f6853edbdb866d965528a63311df5ecdfe1bb85898d569 WatchSource:0}: Error finding container 560d505ffadd6c2b50f6853edbdb866d965528a63311df5ecdfe1bb85898d569: Status 404 returned error can't find the container with id 560d505ffadd6c2b50f6853edbdb866d965528a63311df5ecdfe1bb85898d569
Sep 08 15:40:13.100223 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:13.100185    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9" event={"ID":"aa46a3da-3121-4db0-b7ff-0016ee0bfd28","Type":"ContainerStarted","Data":"560d505ffadd6c2b50f6853edbdb866d965528a63311df5ecdfe1bb85898d569"}
Sep 08 15:40:14.048566 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:14.048534    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:40:14.421575 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:14.421538    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:14.557624 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:14.557589    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:19.080055 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:19.079690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:40:20.946209 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:20.946163    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:21.048413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:21.048378    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:21.092225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:21.092181    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:23.154087 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.154049    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9" event={"ID":"aa46a3da-3121-4db0-b7ff-0016ee0bfd28","Type":"ContainerStarted","Data":"6bb8783b289b1aef43dc4d1af0f017209adeceb7adea3a300c6d05c476f73ebc"}
Sep 08 15:40:23.171575 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.171530    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9" podStartSLOduration=1.38330843 podStartE2EDuration="11.171514986s" totalImagesPullingTime="9.788206556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:40:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:23.170680245 +0000 UTC m=+483.531223009" watchObservedRunningTime="2026-09-08 15:40:23.171514986 +0000 UTC m=+483.532057751"
Sep 08 15:40:23.286455 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.286424    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"]
Sep 08 15:40:23.286663 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.286629    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" containerName="manager" containerID="cri-o://ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23" gracePeriod=2
Sep 08 15:40:23.300348 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.300321    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"]
Sep 08 15:40:23.309893 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:23.309744    2579 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-58fc56757c-8hxds\": pods \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:23.335032 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.334996    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"]
Sep 08 15:40:23.335504 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.335484    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" containerName="manager"
Sep 08 15:40:23.335546 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.335509    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" containerName="manager"
Sep 08 15:40:23.335603 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.335592    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" containerName="manager"
Sep 08 15:40:23.338941 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.338919    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:23.353769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.353746    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"]
Sep 08 15:40:23.357245 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.357226    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:23.357359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.357341    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"]
Sep 08 15:40:23.379766 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.379733    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"]
Sep 08 15:40:23.381563 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.381538    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"]
Sep 08 15:40:23.381787 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.381751    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s" podUID="1ea383d8-a1d0-45b3-b53e-308b733425e7" containerName="manager" containerID="cri-o://3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7" gracePeriod=2
Sep 08 15:40:23.392673 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.392648    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"]
Sep 08 15:40:23.398024 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:23.397993    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" is forbidden: User \"system:node:ip-10-0-134-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-78.ec2.internal' and this object" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:23.401489 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:23.401454    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4rb8s\" is forbidden: User \"system:node:ip-10-0-134-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-78.ec2.internal' and this object" podUID="1ea383d8-a1d0-45b3-b53e-308b733425e7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:40:23.403668 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:23.403641    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" is forbidden: User \"system:node:ip-10-0-134-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-78.ec2.internal' and this object" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:23.431943 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.431854    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-jh9rq\" (UID: \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:23.432110 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.432021    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8n4n\" (UniqueName: \"kubernetes.io/projected/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-kube-api-access-s8n4n\") pod \"kuadrant-operator-controller-manager-68cf589589-jh9rq\" (UID: \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:23.533386 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.533332    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7wqs8\" (UID: \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:23.533547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.533449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-jh9rq\" (UID: \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:23.533547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.533497    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l656w\" (UniqueName: \"kubernetes.io/projected/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-kube-api-access-l656w\") pod \"kuadrant-operator-controller-manager-58fc56757c-7wqs8\" (UID: \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:23.533628 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.533554    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8n4n\" (UniqueName: \"kubernetes.io/projected/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-kube-api-access-s8n4n\") pod \"kuadrant-operator-controller-manager-68cf589589-jh9rq\" (UID: \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:23.533887 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.533861    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-68cf589589-jh9rq\" (UID: \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:23.544513 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.544481    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8n4n\" (UniqueName: \"kubernetes.io/projected/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-kube-api-access-s8n4n\") pod \"kuadrant-operator-controller-manager-68cf589589-jh9rq\" (UID: \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\") " pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:23.620661 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.620598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:23.621711 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.621689    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:23.624126 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:23.624099    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4rb8s\" is forbidden: User \"system:node:ip-10-0-134-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-78.ec2.internal' and this object" podUID="1ea383d8-a1d0-45b3-b53e-308b733425e7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:40:23.624504 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.624488    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:40:23.626665 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:23.626640    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" is forbidden: User \"system:node:ip-10-0-134-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-78.ec2.internal' and this object" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:23.628719 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:23.628694    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-58fc56757c-8hxds\" is forbidden: User \"system:node:ip-10-0-134-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-78.ec2.internal' and this object" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:23.630850 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:23.630830    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-6c549b6d85-4rb8s\" is forbidden: User \"system:node:ip-10-0-134-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-78.ec2.internal' and this object" podUID="1ea383d8-a1d0-45b3-b53e-308b733425e7" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:40:23.634126 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.634103    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-extensions-socket-volume\") pod \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\" (UID: \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\") "
Sep 08 15:40:23.634220 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.634184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8gf9\" (UniqueName: \"kubernetes.io/projected/1ea383d8-a1d0-45b3-b53e-308b733425e7-kube-api-access-l8gf9\") pod \"1ea383d8-a1d0-45b3-b53e-308b733425e7\" (UID: \"1ea383d8-a1d0-45b3-b53e-308b733425e7\") "
Sep 08 15:40:23.634275 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.634228    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnghc\" (UniqueName: \"kubernetes.io/projected/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-kube-api-access-bnghc\") pod \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\" (UID: \"2a8fa99e-4f61-466d-9eaa-fafcd64b24a3\") "
Sep 08 15:40:23.634382 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.634365    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l656w\" (UniqueName: \"kubernetes.io/projected/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-kube-api-access-l656w\") pod \"kuadrant-operator-controller-manager-58fc56757c-7wqs8\" (UID: \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:23.634482 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.634466    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7wqs8\" (UID: \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:23.634540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.634480    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" (UID: "2a8fa99e-4f61-466d-9eaa-fafcd64b24a3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:40:23.634594 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.634568    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-extensions-socket-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:40:23.634799 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.634781    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-58fc56757c-7wqs8\" (UID: \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:23.636397 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.636367    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-kube-api-access-bnghc" (OuterVolumeSpecName: "kube-api-access-bnghc") pod "2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" (UID: "2a8fa99e-4f61-466d-9eaa-fafcd64b24a3"). InnerVolumeSpecName "kube-api-access-bnghc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:23.636467 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.636392    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ea383d8-a1d0-45b3-b53e-308b733425e7-kube-api-access-l8gf9" (OuterVolumeSpecName: "kube-api-access-l8gf9") pod "1ea383d8-a1d0-45b3-b53e-308b733425e7" (UID: "1ea383d8-a1d0-45b3-b53e-308b733425e7"). InnerVolumeSpecName "kube-api-access-l8gf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:23.644767 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.644745    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l656w\" (UniqueName: \"kubernetes.io/projected/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-kube-api-access-l656w\") pod \"kuadrant-operator-controller-manager-58fc56757c-7wqs8\" (UID: \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:23.675499 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.675477    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:23.683078 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.683026    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:23.722830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.722744    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:23.735834 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.735804    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8gf9\" (UniqueName: \"kubernetes.io/projected/1ea383d8-a1d0-45b3-b53e-308b733425e7-kube-api-access-l8gf9\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:40:23.735942 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.735841    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnghc\" (UniqueName: \"kubernetes.io/projected/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3-kube-api-access-bnghc\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:40:23.963538 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.963514    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"]
Sep 08 15:40:23.965355 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:40:23.965335    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc0bc6cd_3b83_448f_a4ec_39504e7596c7.slice/crio-17827eb4372789a00fcc722147875829d1b4488b5fd25a781eb32d34ed8babe4 WatchSource:0}: Error finding container 17827eb4372789a00fcc722147875829d1b4488b5fd25a781eb32d34ed8babe4: Status 404 returned error can't find the container with id 17827eb4372789a00fcc722147875829d1b4488b5fd25a781eb32d34ed8babe4
Sep 08 15:40:23.974930 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:23.974906    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"]
Sep 08 15:40:23.978651 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:40:23.978628    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode395e1aa_ee23_4fbc_a3ec_99147b5cbe15.slice/crio-e7099a13030befba2ceb89911d9124b7e292a2e77e931935a1b45d76576e4d6b WatchSource:0}: Error finding container e7099a13030befba2ceb89911d9124b7e292a2e77e931935a1b45d76576e4d6b: Status 404 returned error can't find the container with id e7099a13030befba2ceb89911d9124b7e292a2e77e931935a1b45d76576e4d6b
Sep 08 15:40:24.116929 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.116896    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ea383d8-a1d0-45b3-b53e-308b733425e7" path="/var/lib/kubelet/pods/1ea383d8-a1d0-45b3-b53e-308b733425e7/volumes"
Sep 08 15:40:24.117313 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.117299    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" path="/var/lib/kubelet/pods/2a8fa99e-4f61-466d-9eaa-fafcd64b24a3/volumes"
Sep 08 15:40:24.161012 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.160977    2579 generic.go:356] "Generic (PLEG): container finished" podID="2a8fa99e-4f61-466d-9eaa-fafcd64b24a3" containerID="ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23" exitCode=0
Sep 08 15:40:24.161409 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.161025    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-8hxds"
Sep 08 15:40:24.161409 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.161066    2579 scope.go:117] "RemoveContainer" containerID="ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23"
Sep 08 15:40:24.163042 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.162881    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8" event={"ID":"bc0bc6cd-3b83-448f-a4ec-39504e7596c7","Type":"ContainerStarted","Data":"1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653"}
Sep 08 15:40:24.163042 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.162950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8" event={"ID":"bc0bc6cd-3b83-448f-a4ec-39504e7596c7","Type":"ContainerStarted","Data":"17827eb4372789a00fcc722147875829d1b4488b5fd25a781eb32d34ed8babe4"}
Sep 08 15:40:24.163042 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.163089    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:24.164671 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.164645    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ea383d8-a1d0-45b3-b53e-308b733425e7" containerID="3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7" exitCode=0
Sep 08 15:40:24.164782 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.164752    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-6c549b6d85-4rb8s"
Sep 08 15:40:24.166606 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.166577    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq" event={"ID":"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15","Type":"ContainerStarted","Data":"bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70"}
Sep 08 15:40:24.166718 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.166629    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq" event={"ID":"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15","Type":"ContainerStarted","Data":"e7099a13030befba2ceb89911d9124b7e292a2e77e931935a1b45d76576e4d6b"}
Sep 08 15:40:24.173578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.173557    2579 scope.go:117] "RemoveContainer" containerID="ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23"
Sep 08 15:40:24.173901 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:24.173876    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23\": container with ID starting with ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23 not found: ID does not exist" containerID="ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23"
Sep 08 15:40:24.174017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.173911    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23"} err="failed to get container status \"ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23\": rpc error: code = NotFound desc = could not find container \"ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23\": container with ID starting with ae7be4e8384f32d5ed9a3d6586881e6e30c3a1e595745574947bafa77ae6bf23 not found: ID does not exist"
Sep 08 15:40:24.174017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.173933    2579 scope.go:117] "RemoveContainer" containerID="3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7"
Sep 08 15:40:24.182553 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.182531    2579 scope.go:117] "RemoveContainer" containerID="3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7"
Sep 08 15:40:24.182816 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:24.182798    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7\": container with ID starting with 3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7 not found: ID does not exist" containerID="3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7"
Sep 08 15:40:24.182866 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.182823    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7"} err="failed to get container status \"3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7\": rpc error: code = NotFound desc = could not find container \"3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7\": container with ID starting with 3f03e7eb1991f1ff2a5af2275c07a32bbd17cbf75ad8687d9b9640be23a665f7 not found: ID does not exist"
Sep 08 15:40:24.202381 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.202335    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8" podStartSLOduration=1.202319464 podStartE2EDuration="1.202319464s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:24.201073383 +0000 UTC m=+484.561616147" watchObservedRunningTime="2026-09-08 15:40:24.202319464 +0000 UTC m=+484.562862229"
Sep 08 15:40:24.222038 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:24.221946    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq" podStartSLOduration=1.221930469 podStartE2EDuration="1.221930469s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:24.219502078 +0000 UTC m=+484.580044843" watchObservedRunningTime="2026-09-08 15:40:24.221930469 +0000 UTC m=+484.582473234"
Sep 08 15:40:25.176316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:25.176278    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:29.761473 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:29.761437    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:29.855839 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:29.855802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:33.820893 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:33.820854    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:33.921469 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:33.921429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:35.178939 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:35.178906    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:36.183865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.183836    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:36.244770 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.244734    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"]
Sep 08 15:40:36.245000 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.244955    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8" podUID="bc0bc6cd-3b83-448f-a4ec-39504e7596c7" containerName="manager" containerID="cri-o://1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653" gracePeriod=10
Sep 08 15:40:36.486175 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.486151    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:36.529926 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.529901    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-extensions-socket-volume\") pod \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\" (UID: \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\") "
Sep 08 15:40:36.530109 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.530001    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l656w\" (UniqueName: \"kubernetes.io/projected/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-kube-api-access-l656w\") pod \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\" (UID: \"bc0bc6cd-3b83-448f-a4ec-39504e7596c7\") "
Sep 08 15:40:36.530293 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.530270    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bc0bc6cd-3b83-448f-a4ec-39504e7596c7" (UID: "bc0bc6cd-3b83-448f-a4ec-39504e7596c7"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:40:36.531997 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.531936    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-kube-api-access-l656w" (OuterVolumeSpecName: "kube-api-access-l656w") pod "bc0bc6cd-3b83-448f-a4ec-39504e7596c7" (UID: "bc0bc6cd-3b83-448f-a4ec-39504e7596c7"). InnerVolumeSpecName "kube-api-access-l656w". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:36.630861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.630825    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-extensions-socket-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:40:36.630861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.630860    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l656w\" (UniqueName: \"kubernetes.io/projected/bc0bc6cd-3b83-448f-a4ec-39504e7596c7-kube-api-access-l656w\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:40:36.635284 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.635255    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"]
Sep 08 15:40:36.635620 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.635602    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ea383d8-a1d0-45b3-b53e-308b733425e7" containerName="manager"
Sep 08 15:40:36.635697 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.635626    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ea383d8-a1d0-45b3-b53e-308b733425e7" containerName="manager"
Sep 08 15:40:36.635697 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.635652    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc0bc6cd-3b83-448f-a4ec-39504e7596c7" containerName="manager"
Sep 08 15:40:36.635697 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.635662    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc0bc6cd-3b83-448f-a4ec-39504e7596c7" containerName="manager"
Sep 08 15:40:36.635847 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.635749    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc0bc6cd-3b83-448f-a4ec-39504e7596c7" containerName="manager"
Sep 08 15:40:36.635847 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.635763    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ea383d8-a1d0-45b3-b53e-308b733425e7" containerName="manager"
Sep 08 15:40:36.638078 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.638054    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:36.661876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.661843    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"]
Sep 08 15:40:36.732199 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.732107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bztqj\" (UniqueName: \"kubernetes.io/projected/15f75a79-8e08-4552-a0a4-193ca2931ec2-kube-api-access-bztqj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qd4d4\" (UID: \"15f75a79-8e08-4552-a0a4-193ca2931ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:36.732199 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.732182    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15f75a79-8e08-4552-a0a4-193ca2931ec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qd4d4\" (UID: \"15f75a79-8e08-4552-a0a4-193ca2931ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:36.833465 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.833421    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15f75a79-8e08-4552-a0a4-193ca2931ec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qd4d4\" (UID: \"15f75a79-8e08-4552-a0a4-193ca2931ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:36.833627 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.833485    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bztqj\" (UniqueName: \"kubernetes.io/projected/15f75a79-8e08-4552-a0a4-193ca2931ec2-kube-api-access-bztqj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qd4d4\" (UID: \"15f75a79-8e08-4552-a0a4-193ca2931ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:36.833943 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.833923    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15f75a79-8e08-4552-a0a4-193ca2931ec2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qd4d4\" (UID: \"15f75a79-8e08-4552-a0a4-193ca2931ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:36.851712 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.851687    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bztqj\" (UniqueName: \"kubernetes.io/projected/15f75a79-8e08-4552-a0a4-193ca2931ec2-kube-api-access-bztqj\") pod \"kuadrant-operator-controller-manager-5b65f94d4c-qd4d4\" (UID: \"15f75a79-8e08-4552-a0a4-193ca2931ec2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:36.948039 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:36.947995    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:37.225719 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.225695    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"]
Sep 08 15:40:37.227862 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:40:37.227837    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f75a79_8e08_4552_a0a4_193ca2931ec2.slice/crio-e5337c6e696dedb9ad280b65bcbd022c732973b81e597fb84375d6f49aabcbc5 WatchSource:0}: Error finding container e5337c6e696dedb9ad280b65bcbd022c732973b81e597fb84375d6f49aabcbc5: Status 404 returned error can't find the container with id e5337c6e696dedb9ad280b65bcbd022c732973b81e597fb84375d6f49aabcbc5
Sep 08 15:40:37.240874 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.240846    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4" event={"ID":"15f75a79-8e08-4552-a0a4-193ca2931ec2","Type":"ContainerStarted","Data":"e5337c6e696dedb9ad280b65bcbd022c732973b81e597fb84375d6f49aabcbc5"}
Sep 08 15:40:37.242276 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.242254    2579 generic.go:356] "Generic (PLEG): container finished" podID="bc0bc6cd-3b83-448f-a4ec-39504e7596c7" containerID="1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653" exitCode=0
Sep 08 15:40:37.242358 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.242311    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"
Sep 08 15:40:37.242358 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.242321    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8" event={"ID":"bc0bc6cd-3b83-448f-a4ec-39504e7596c7","Type":"ContainerDied","Data":"1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653"}
Sep 08 15:40:37.242428 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.242360    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8" event={"ID":"bc0bc6cd-3b83-448f-a4ec-39504e7596c7","Type":"ContainerDied","Data":"17827eb4372789a00fcc722147875829d1b4488b5fd25a781eb32d34ed8babe4"}
Sep 08 15:40:37.242428 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.242384    2579 scope.go:117] "RemoveContainer" containerID="1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653"
Sep 08 15:40:37.252539 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.252406    2579 scope.go:117] "RemoveContainer" containerID="1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653"
Sep 08 15:40:37.252691 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:37.252673    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653\": container with ID starting with 1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653 not found: ID does not exist" containerID="1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653"
Sep 08 15:40:37.252738 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.252700    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653"} err="failed to get container status \"1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653\": rpc error: code = NotFound desc = could not find container \"1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653\": container with ID starting with 1a98dd3e4b4bdd486b8e0e092ef18e08092f62043a3ac58cd8dff2d85df03653 not found: ID does not exist"
Sep 08 15:40:37.276760 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.276732    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"]
Sep 08 15:40:37.283940 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:37.283916    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-58fc56757c-7wqs8"]
Sep 08 15:40:38.113734 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:38.113696    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc0bc6cd-3b83-448f-a4ec-39504e7596c7" path="/var/lib/kubelet/pods/bc0bc6cd-3b83-448f-a4ec-39504e7596c7/volumes"
Sep 08 15:40:38.248954 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:38.248915    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4" event={"ID":"15f75a79-8e08-4552-a0a4-193ca2931ec2","Type":"ContainerStarted","Data":"257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee"}
Sep 08 15:40:38.249426 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:38.249000    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:38.273455 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:38.273400    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4" podStartSLOduration=2.273384781 podStartE2EDuration="2.273384781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:40:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:40:38.270224023 +0000 UTC m=+498.630766788" watchObservedRunningTime="2026-09-08 15:40:38.273384781 +0000 UTC m=+498.633927546"
Sep 08 15:40:40.612889 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:40.612852    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:40.713749 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:40.713710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:41.014534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:41.014459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:41.114735 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:41.114678    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:44.084440 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:44.084399    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:44.139672 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:44.139635    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:49.257345 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.257311    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:40:49.313692 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.313655    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"]
Sep 08 15:40:49.313935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.313909    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq" podUID="e395e1aa-ee23-4fbc-a3ec-99147b5cbe15" containerName="manager" containerID="cri-o://bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70" gracePeriod=10
Sep 08 15:40:49.553907 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.553879    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:49.642217 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.642184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-extensions-socket-volume\") pod \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\" (UID: \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\") "
Sep 08 15:40:49.642217 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.642222    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s8n4n\" (UniqueName: \"kubernetes.io/projected/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-kube-api-access-s8n4n\") pod \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\" (UID: \"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15\") "
Sep 08 15:40:49.642597 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.642571    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e395e1aa-ee23-4fbc-a3ec-99147b5cbe15" (UID: "e395e1aa-ee23-4fbc-a3ec-99147b5cbe15"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:40:49.644292 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.644270    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-kube-api-access-s8n4n" (OuterVolumeSpecName: "kube-api-access-s8n4n") pod "e395e1aa-ee23-4fbc-a3ec-99147b5cbe15" (UID: "e395e1aa-ee23-4fbc-a3ec-99147b5cbe15"). InnerVolumeSpecName "kube-api-access-s8n4n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:40:49.742844 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.742803    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-extensions-socket-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:40:49.742844 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:49.742834    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s8n4n\" (UniqueName: \"kubernetes.io/projected/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15-kube-api-access-s8n4n\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:40:50.313166 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.313131    2579 generic.go:356] "Generic (PLEG): container finished" podID="e395e1aa-ee23-4fbc-a3ec-99147b5cbe15" containerID="bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70" exitCode=0
Sep 08 15:40:50.313641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.313178    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"
Sep 08 15:40:50.313641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.313218    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq" event={"ID":"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15","Type":"ContainerDied","Data":"bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70"}
Sep 08 15:40:50.313641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.313268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq" event={"ID":"e395e1aa-ee23-4fbc-a3ec-99147b5cbe15","Type":"ContainerDied","Data":"e7099a13030befba2ceb89911d9124b7e292a2e77e931935a1b45d76576e4d6b"}
Sep 08 15:40:50.313641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.313290    2579 scope.go:117] "RemoveContainer" containerID="bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70"
Sep 08 15:40:50.322235 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.322024    2579 scope.go:117] "RemoveContainer" containerID="bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70"
Sep 08 15:40:50.322367 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:40:50.322348    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70\": container with ID starting with bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70 not found: ID does not exist" containerID="bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70"
Sep 08 15:40:50.322411 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.322375    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70"} err="failed to get container status \"bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70\": rpc error: code = NotFound desc = could not find container \"bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70\": container with ID starting with bb4d1b1618ed7842f19e7c575681cb7ee2c33931fdb0f5d29a55f88e24097d70 not found: ID does not exist"
Sep 08 15:40:50.338312 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.338282    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"]
Sep 08 15:40:50.342824 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:50.342801    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-68cf589589-jh9rq"]
Sep 08 15:40:52.113687 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:52.113655    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e395e1aa-ee23-4fbc-a3ec-99147b5cbe15" path="/var/lib/kubelet/pods/e395e1aa-ee23-4fbc-a3ec-99147b5cbe15/volumes"
Sep 08 15:40:52.633156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:52.633122    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:40:52.729053 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:40:52.729017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:11.201216 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.201180    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gqplf"]
Sep 08 15:41:11.201673 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.201482    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e395e1aa-ee23-4fbc-a3ec-99147b5cbe15" containerName="manager"
Sep 08 15:41:11.201673 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.201494    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e395e1aa-ee23-4fbc-a3ec-99147b5cbe15" containerName="manager"
Sep 08 15:41:11.201673 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.201553    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e395e1aa-ee23-4fbc-a3ec-99147b5cbe15" containerName="manager"
Sep 08 15:41:11.205138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.205108    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:11.216801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.216772    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gqplf"]
Sep 08 15:41:11.216940 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.216893    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:11.219731 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.219709    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Sep 08 15:41:11.292921 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.292889    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gqplf"]
Sep 08 15:41:11.297800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.297765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:11.331769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.331740    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0418d6d3-87ec-4511-88bb-ddf25845a963-config-file\") pod \"limitador-limitador-859c4d96d6-gqplf\" (UID: \"0418d6d3-87ec-4511-88bb-ddf25845a963\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:11.331953 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.331794    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dj4m\" (UniqueName: \"kubernetes.io/projected/0418d6d3-87ec-4511-88bb-ddf25845a963-kube-api-access-5dj4m\") pod \"limitador-limitador-859c4d96d6-gqplf\" (UID: \"0418d6d3-87ec-4511-88bb-ddf25845a963\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:11.360491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.360458    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:11.432524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.432473    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dj4m\" (UniqueName: \"kubernetes.io/projected/0418d6d3-87ec-4511-88bb-ddf25845a963-kube-api-access-5dj4m\") pod \"limitador-limitador-859c4d96d6-gqplf\" (UID: \"0418d6d3-87ec-4511-88bb-ddf25845a963\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:11.432699 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.432553    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0418d6d3-87ec-4511-88bb-ddf25845a963-config-file\") pod \"limitador-limitador-859c4d96d6-gqplf\" (UID: \"0418d6d3-87ec-4511-88bb-ddf25845a963\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:11.433292 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.433271    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0418d6d3-87ec-4511-88bb-ddf25845a963-config-file\") pod \"limitador-limitador-859c4d96d6-gqplf\" (UID: \"0418d6d3-87ec-4511-88bb-ddf25845a963\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:11.440640 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.440612    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dj4m\" (UniqueName: \"kubernetes.io/projected/0418d6d3-87ec-4511-88bb-ddf25845a963-kube-api-access-5dj4m\") pod \"limitador-limitador-859c4d96d6-gqplf\" (UID: \"0418d6d3-87ec-4511-88bb-ddf25845a963\") " pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:11.534291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.534184    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:11.568404 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.568374    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:41:11.570996 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.570949    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:11.580753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.580731    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:41:11.607907 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.607867    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:41:11.735297 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.735260    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-config-file\") pod \"limitador-limitador-85d9db4d5d-kv5fk\" (UID: \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:11.735498 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.735334    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jck8g\" (UniqueName: \"kubernetes.io/projected/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-kube-api-access-jck8g\") pod \"limitador-limitador-85d9db4d5d-kv5fk\" (UID: \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:11.835869 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.835815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-config-file\") pod \"limitador-limitador-85d9db4d5d-kv5fk\" (UID: \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:11.836077 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.835895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jck8g\" (UniqueName: \"kubernetes.io/projected/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-kube-api-access-jck8g\") pod \"limitador-limitador-85d9db4d5d-kv5fk\" (UID: \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:11.836578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.836554    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-config-file\") pod \"limitador-limitador-85d9db4d5d-kv5fk\" (UID: \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:11.837798 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.837779    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gqplf"]
Sep 08 15:41:11.840114 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:41:11.840080    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0418d6d3_87ec_4511_88bb_ddf25845a963.slice/crio-d4a98f2778e11dd4dd72cce501bccb29df5c133e61ded49b240f09199c01e6c2 WatchSource:0}: Error finding container d4a98f2778e11dd4dd72cce501bccb29df5c133e61ded49b240f09199c01e6c2: Status 404 returned error can't find the container with id d4a98f2778e11dd4dd72cce501bccb29df5c133e61ded49b240f09199c01e6c2
Sep 08 15:41:11.851148 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.851122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jck8g\" (UniqueName: \"kubernetes.io/projected/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-kube-api-access-jck8g\") pod \"limitador-limitador-85d9db4d5d-kv5fk\" (UID: \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\") " pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:11.884871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:11.884825    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:12.090878 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.090772    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:12.158890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.158857    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:41:12.160858 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:41:12.160826    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb02fb12b_aaeb_4e3d_8e56_03c7a546ab1e.slice/crio-33cf1ac3557346826dd31cc8b009e0f9b8e04ecfb576a1b23cbab76ed692c15f WatchSource:0}: Error finding container 33cf1ac3557346826dd31cc8b009e0f9b8e04ecfb576a1b23cbab76ed692c15f: Status 404 returned error can't find the container with id 33cf1ac3557346826dd31cc8b009e0f9b8e04ecfb576a1b23cbab76ed692c15f
Sep 08 15:41:12.161328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.161300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:12.165349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.165330    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c548b5d7d-lvbbk"]
Sep 08 15:41:12.168059 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.168040    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-lvbbk"
Sep 08 15:41:12.170772 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.170753    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2r4ms\""
Sep 08 15:41:12.179007 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.178984    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-lvbbk"]
Sep 08 15:41:12.340307 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.340271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fssrc\" (UniqueName: \"kubernetes.io/projected/ee4959c9-88f1-44b6-af57-2609a03c4084-kube-api-access-fssrc\") pod \"authorino-c548b5d7d-lvbbk\" (UID: \"ee4959c9-88f1-44b6-af57-2609a03c4084\") " pod="kuadrant-system/authorino-c548b5d7d-lvbbk"
Sep 08 15:41:12.432254 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.432162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk" event={"ID":"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e","Type":"ContainerStarted","Data":"33cf1ac3557346826dd31cc8b009e0f9b8e04ecfb576a1b23cbab76ed692c15f"}
Sep 08 15:41:12.433355 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.433333    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf" event={"ID":"0418d6d3-87ec-4511-88bb-ddf25845a963","Type":"ContainerStarted","Data":"d4a98f2778e11dd4dd72cce501bccb29df5c133e61ded49b240f09199c01e6c2"}
Sep 08 15:41:12.440645 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.440619    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fssrc\" (UniqueName: \"kubernetes.io/projected/ee4959c9-88f1-44b6-af57-2609a03c4084-kube-api-access-fssrc\") pod \"authorino-c548b5d7d-lvbbk\" (UID: \"ee4959c9-88f1-44b6-af57-2609a03c4084\") " pod="kuadrant-system/authorino-c548b5d7d-lvbbk"
Sep 08 15:41:12.449767 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.449742    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fssrc\" (UniqueName: \"kubernetes.io/projected/ee4959c9-88f1-44b6-af57-2609a03c4084-kube-api-access-fssrc\") pod \"authorino-c548b5d7d-lvbbk\" (UID: \"ee4959c9-88f1-44b6-af57-2609a03c4084\") " pod="kuadrant-system/authorino-c548b5d7d-lvbbk"
Sep 08 15:41:12.477217 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.477194    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-lvbbk"
Sep 08 15:41:12.746343 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:12.746313    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-lvbbk"]
Sep 08 15:41:12.748047 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:41:12.748021    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podee4959c9_88f1_44b6_af57_2609a03c4084.slice/crio-e5d2e2790a6695c45e6644d0822030f9392582b2a7610f848722b0c2fcf6590c WatchSource:0}: Error finding container e5d2e2790a6695c45e6644d0822030f9392582b2a7610f848722b0c2fcf6590c: Status 404 returned error can't find the container with id e5d2e2790a6695c45e6644d0822030f9392582b2a7610f848722b0c2fcf6590c
Sep 08 15:41:13.440346 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:13.440312    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk" event={"ID":"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e","Type":"ContainerStarted","Data":"b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83"}
Sep 08 15:41:13.440805 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:13.440419    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:13.441634 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:13.441606    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-lvbbk" event={"ID":"ee4959c9-88f1-44b6-af57-2609a03c4084","Type":"ContainerStarted","Data":"e5d2e2790a6695c45e6644d0822030f9392582b2a7610f848722b0c2fcf6590c"}
Sep 08 15:41:13.443248 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:13.443223    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf" event={"ID":"0418d6d3-87ec-4511-88bb-ddf25845a963","Type":"ContainerStarted","Data":"a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab"}
Sep 08 15:41:13.443375 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:13.443354    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:13.459034 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:13.458988    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk" podStartSLOduration=1.3092287360000001 podStartE2EDuration="2.458973599s" totalImagesPullingTime="1.149744863s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:41:13.456938893 +0000 UTC m=+533.817481667" watchObservedRunningTime="2026-09-08 15:41:13.458973599 +0000 UTC m=+533.819516355"
Sep 08 15:41:13.475464 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:13.475415    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf" podStartSLOduration=1.004094395 podStartE2EDuration="2.475401391s" totalImagesPullingTime="1.471306996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:41:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:41:13.472354835 +0000 UTC m=+533.832897602" watchObservedRunningTime="2026-09-08 15:41:13.475401391 +0000 UTC m=+533.835944158"
Sep 08 15:41:15.456530 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:15.456492    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-lvbbk" event={"ID":"ee4959c9-88f1-44b6-af57-2609a03c4084","Type":"ContainerStarted","Data":"5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9"}
Sep 08 15:41:15.472410 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:15.472362    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c548b5d7d-lvbbk" podStartSLOduration=1.479005851 podStartE2EDuration="3.472344701s" totalImagesPullingTime="1.99333885s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:41:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:41:15.472157174 +0000 UTC m=+535.832699939" watchObservedRunningTime="2026-09-08 15:41:15.472344701 +0000 UTC m=+535.832887466"
Sep 08 15:41:24.451468 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:24.451432    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:24.451845 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:24.451507    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:41:24.517906 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:24.517874    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gqplf"]
Sep 08 15:41:24.518179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:24.518152    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf" podUID="0418d6d3-87ec-4511-88bb-ddf25845a963" containerName="limitador" containerID="cri-o://a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab" gracePeriod=30
Sep 08 15:41:25.056433 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.056408    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:25.130136 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.130050    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0418d6d3-87ec-4511-88bb-ddf25845a963-config-file\") pod \"0418d6d3-87ec-4511-88bb-ddf25845a963\" (UID: \"0418d6d3-87ec-4511-88bb-ddf25845a963\") "
Sep 08 15:41:25.130136 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.130130    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5dj4m\" (UniqueName: \"kubernetes.io/projected/0418d6d3-87ec-4511-88bb-ddf25845a963-kube-api-access-5dj4m\") pod \"0418d6d3-87ec-4511-88bb-ddf25845a963\" (UID: \"0418d6d3-87ec-4511-88bb-ddf25845a963\") "
Sep 08 15:41:25.130453 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.130428    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0418d6d3-87ec-4511-88bb-ddf25845a963-config-file" (OuterVolumeSpecName: "config-file") pod "0418d6d3-87ec-4511-88bb-ddf25845a963" (UID: "0418d6d3-87ec-4511-88bb-ddf25845a963"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:41:25.132151 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.132126    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0418d6d3-87ec-4511-88bb-ddf25845a963-kube-api-access-5dj4m" (OuterVolumeSpecName: "kube-api-access-5dj4m") pod "0418d6d3-87ec-4511-88bb-ddf25845a963" (UID: "0418d6d3-87ec-4511-88bb-ddf25845a963"). InnerVolumeSpecName "kube-api-access-5dj4m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:25.231379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.231345    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/0418d6d3-87ec-4511-88bb-ddf25845a963-config-file\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:41:25.231379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.231371    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5dj4m\" (UniqueName: \"kubernetes.io/projected/0418d6d3-87ec-4511-88bb-ddf25845a963-kube-api-access-5dj4m\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:41:25.510203 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.510112    2579 generic.go:356] "Generic (PLEG): container finished" podID="0418d6d3-87ec-4511-88bb-ddf25845a963" containerID="a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab" exitCode=0
Sep 08 15:41:25.510203 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.510163    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf"
Sep 08 15:41:25.510203 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.510196    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf" event={"ID":"0418d6d3-87ec-4511-88bb-ddf25845a963","Type":"ContainerDied","Data":"a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab"}
Sep 08 15:41:25.510760 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.510247    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-859c4d96d6-gqplf" event={"ID":"0418d6d3-87ec-4511-88bb-ddf25845a963","Type":"ContainerDied","Data":"d4a98f2778e11dd4dd72cce501bccb29df5c133e61ded49b240f09199c01e6c2"}
Sep 08 15:41:25.510760 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.510270    2579 scope.go:117] "RemoveContainer" containerID="a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab"
Sep 08 15:41:25.519313 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.519176    2579 scope.go:117] "RemoveContainer" containerID="a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab"
Sep 08 15:41:25.519468 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:41:25.519445    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab\": container with ID starting with a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab not found: ID does not exist" containerID="a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab"
Sep 08 15:41:25.519506 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.519478    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab"} err="failed to get container status \"a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab\": rpc error: code = NotFound desc = could not find container \"a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab\": container with ID starting with a43d2a8b8691c5188f6cfd1d68f41531747ced0803a30183ea304e65b5d028ab not found: ID does not exist"
Sep 08 15:41:25.533932 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.533883    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gqplf"]
Sep 08 15:41:25.537535 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:25.537504    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-859c4d96d6-gqplf"]
Sep 08 15:41:26.113279 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:26.113248    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0418d6d3-87ec-4511-88bb-ddf25845a963" path="/var/lib/kubelet/pods/0418d6d3-87ec-4511-88bb-ddf25845a963/volumes"
Sep 08 15:41:26.797819 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:26.797783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:26.892999 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:26.892938    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:27.265644 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:27.265611    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:39.808520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:39.808488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:40.013769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.013734    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:40.027178 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.027143    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-pxwm8"]
Sep 08 15:41:40.027512 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.027495    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0418d6d3-87ec-4511-88bb-ddf25845a963" containerName="limitador"
Sep 08 15:41:40.027512 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.027512    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0418d6d3-87ec-4511-88bb-ddf25845a963" containerName="limitador"
Sep 08 15:41:40.027644 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.027585    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0418d6d3-87ec-4511-88bb-ddf25845a963" containerName="limitador"
Sep 08 15:41:40.029809 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.029792    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-pxwm8"
Sep 08 15:41:40.040149 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.040125    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-pxwm8"]
Sep 08 15:41:40.050103 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.050077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw789\" (UniqueName: \"kubernetes.io/projected/a67f8293-0278-4019-811a-e912af8679b9-kube-api-access-pw789\") pod \"authorino-5dc7ccb5f-pxwm8\" (UID: \"a67f8293-0278-4019-811a-e912af8679b9\") " pod="kuadrant-system/authorino-5dc7ccb5f-pxwm8"
Sep 08 15:41:40.077128 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.077095    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-pxwm8"]
Sep 08 15:41:40.077557 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:41:40.077398    2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pw789], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5dc7ccb5f-pxwm8" podUID="a67f8293-0278-4019-811a-e912af8679b9"
Sep 08 15:41:40.150950 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.150911    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw789\" (UniqueName: \"kubernetes.io/projected/a67f8293-0278-4019-811a-e912af8679b9-kube-api-access-pw789\") pod \"authorino-5dc7ccb5f-pxwm8\" (UID: \"a67f8293-0278-4019-811a-e912af8679b9\") " pod="kuadrant-system/authorino-5dc7ccb5f-pxwm8"
Sep 08 15:41:40.159501 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.159467    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw789\" (UniqueName: \"kubernetes.io/projected/a67f8293-0278-4019-811a-e912af8679b9-kube-api-access-pw789\") pod \"authorino-5dc7ccb5f-pxwm8\" (UID: \"a67f8293-0278-4019-811a-e912af8679b9\") " pod="kuadrant-system/authorino-5dc7ccb5f-pxwm8"
Sep 08 15:41:40.303536 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.303503    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56977c4db8-4htzj"]
Sep 08 15:41:40.305674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.305656    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:41:40.308467 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.308450    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Sep 08 15:41:40.314728 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.314707    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56977c4db8-4htzj"]
Sep 08 15:41:40.353443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.353364    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-52vpq\" (UniqueName: \"kubernetes.io/projected/5471bd49-5a13-4465-8ff2-88c682544568-kube-api-access-52vpq\") pod \"authorino-56977c4db8-4htzj\" (UID: \"5471bd49-5a13-4465-8ff2-88c682544568\") " pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:41:40.353443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.353416    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5471bd49-5a13-4465-8ff2-88c682544568-tls-cert\") pod \"authorino-56977c4db8-4htzj\" (UID: \"5471bd49-5a13-4465-8ff2-88c682544568\") " pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:41:40.454136 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.454098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-52vpq\" (UniqueName: \"kubernetes.io/projected/5471bd49-5a13-4465-8ff2-88c682544568-kube-api-access-52vpq\") pod \"authorino-56977c4db8-4htzj\" (UID: \"5471bd49-5a13-4465-8ff2-88c682544568\") " pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:41:40.454317 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.454158    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5471bd49-5a13-4465-8ff2-88c682544568-tls-cert\") pod \"authorino-56977c4db8-4htzj\" (UID: \"5471bd49-5a13-4465-8ff2-88c682544568\") " pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:41:40.456713 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.456688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5471bd49-5a13-4465-8ff2-88c682544568-tls-cert\") pod \"authorino-56977c4db8-4htzj\" (UID: \"5471bd49-5a13-4465-8ff2-88c682544568\") " pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:41:40.462565 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.462544    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-52vpq\" (UniqueName: \"kubernetes.io/projected/5471bd49-5a13-4465-8ff2-88c682544568-kube-api-access-52vpq\") pod \"authorino-56977c4db8-4htzj\" (UID: \"5471bd49-5a13-4465-8ff2-88c682544568\") " pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:41:40.589562 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.589531    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-pxwm8"
Sep 08 15:41:40.595808 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.595786    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-pxwm8"
Sep 08 15:41:40.615975 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.615903    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:41:40.656023 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.655987    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw789\" (UniqueName: \"kubernetes.io/projected/a67f8293-0278-4019-811a-e912af8679b9-kube-api-access-pw789\") pod \"a67f8293-0278-4019-811a-e912af8679b9\" (UID: \"a67f8293-0278-4019-811a-e912af8679b9\") "
Sep 08 15:41:40.657977 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.657938    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a67f8293-0278-4019-811a-e912af8679b9-kube-api-access-pw789" (OuterVolumeSpecName: "kube-api-access-pw789") pod "a67f8293-0278-4019-811a-e912af8679b9" (UID: "a67f8293-0278-4019-811a-e912af8679b9"). InnerVolumeSpecName "kube-api-access-pw789". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:40.756488 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.756452    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw789\" (UniqueName: \"kubernetes.io/projected/a67f8293-0278-4019-811a-e912af8679b9-kube-api-access-pw789\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:41:40.886528 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:40.886503    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56977c4db8-4htzj"]
Sep 08 15:41:40.888594 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:41:40.888557    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5471bd49_5a13_4465_8ff2_88c682544568.slice/crio-2ab7ad96bdb99253a7048b9329ad410ccf1d435170b0fa9aca6065547dd40535 WatchSource:0}: Error finding container 2ab7ad96bdb99253a7048b9329ad410ccf1d435170b0fa9aca6065547dd40535: Status 404 returned error can't find the container with id 2ab7ad96bdb99253a7048b9329ad410ccf1d435170b0fa9aca6065547dd40535
Sep 08 15:41:41.596307 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.596271    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56977c4db8-4htzj" event={"ID":"5471bd49-5a13-4465-8ff2-88c682544568","Type":"ContainerStarted","Data":"019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2"}
Sep 08 15:41:41.596501 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.596328    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56977c4db8-4htzj" event={"ID":"5471bd49-5a13-4465-8ff2-88c682544568","Type":"ContainerStarted","Data":"2ab7ad96bdb99253a7048b9329ad410ccf1d435170b0fa9aca6065547dd40535"}
Sep 08 15:41:41.596501 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.596290    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5dc7ccb5f-pxwm8"
Sep 08 15:41:41.614028 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.613985    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56977c4db8-4htzj" podStartSLOduration=1.076699986 podStartE2EDuration="1.613946997s" totalImagesPullingTime="537.247011ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:41:41.611646124 +0000 UTC m=+561.972188889" watchObservedRunningTime="2026-09-08 15:41:41.613946997 +0000 UTC m=+561.974489783"
Sep 08 15:41:41.639175 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.639143    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-pxwm8"]
Sep 08 15:41:41.645611 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.645578    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-lvbbk"]
Sep 08 15:41:41.646061 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.646014    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-c548b5d7d-lvbbk" podUID="ee4959c9-88f1-44b6-af57-2609a03c4084" containerName="authorino" containerID="cri-o://5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9" gracePeriod=30
Sep 08 15:41:41.652005 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.650861    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5dc7ccb5f-pxwm8"]
Sep 08 15:41:41.883724 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.883697    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-lvbbk"
Sep 08 15:41:41.966352 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.966314    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fssrc\" (UniqueName: \"kubernetes.io/projected/ee4959c9-88f1-44b6-af57-2609a03c4084-kube-api-access-fssrc\") pod \"ee4959c9-88f1-44b6-af57-2609a03c4084\" (UID: \"ee4959c9-88f1-44b6-af57-2609a03c4084\") "
Sep 08 15:41:41.968359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:41.968334    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ee4959c9-88f1-44b6-af57-2609a03c4084-kube-api-access-fssrc" (OuterVolumeSpecName: "kube-api-access-fssrc") pod "ee4959c9-88f1-44b6-af57-2609a03c4084" (UID: "ee4959c9-88f1-44b6-af57-2609a03c4084"). InnerVolumeSpecName "kube-api-access-fssrc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:41:42.067569 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.067481    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fssrc\" (UniqueName: \"kubernetes.io/projected/ee4959c9-88f1-44b6-af57-2609a03c4084-kube-api-access-fssrc\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:41:42.113224 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.113191    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a67f8293-0278-4019-811a-e912af8679b9" path="/var/lib/kubelet/pods/a67f8293-0278-4019-811a-e912af8679b9/volumes"
Sep 08 15:41:42.601977 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.601938    2579 generic.go:356] "Generic (PLEG): container finished" podID="ee4959c9-88f1-44b6-af57-2609a03c4084" containerID="5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9" exitCode=0
Sep 08 15:41:42.602179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.601995    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c548b5d7d-lvbbk"
Sep 08 15:41:42.602179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.602026    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-lvbbk" event={"ID":"ee4959c9-88f1-44b6-af57-2609a03c4084","Type":"ContainerDied","Data":"5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9"}
Sep 08 15:41:42.602179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.602081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c548b5d7d-lvbbk" event={"ID":"ee4959c9-88f1-44b6-af57-2609a03c4084","Type":"ContainerDied","Data":"e5d2e2790a6695c45e6644d0822030f9392582b2a7610f848722b0c2fcf6590c"}
Sep 08 15:41:42.602179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.602106    2579 scope.go:117] "RemoveContainer" containerID="5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9"
Sep 08 15:41:42.610581 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.610562    2579 scope.go:117] "RemoveContainer" containerID="5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9"
Sep 08 15:41:42.610834 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:41:42.610814    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9\": container with ID starting with 5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9 not found: ID does not exist" containerID="5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9"
Sep 08 15:41:42.610880 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.610841    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9"} err="failed to get container status \"5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9\": rpc error: code = NotFound desc = could not find container \"5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9\": container with ID starting with 5c8a16a56e64080285297902b14898d1a834869d83da768e2becac7150de65c9 not found: ID does not exist"
Sep 08 15:41:42.618472 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.618447    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-lvbbk"]
Sep 08 15:41:42.622468 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:42.622446    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c548b5d7d-lvbbk"]
Sep 08 15:41:44.113910 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:44.113877    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ee4959c9-88f1-44b6-af57-2609a03c4084" path="/var/lib/kubelet/pods/ee4959c9-88f1-44b6-af57-2609a03c4084/volumes"
Sep 08 15:41:46.364825 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.364794    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:46.456406 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.456371    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:46.526266 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.526231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:46.580545 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.580511    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74dcff4f44-95sj5"]
Sep 08 15:41:46.580856 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.580844    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ee4959c9-88f1-44b6-af57-2609a03c4084" containerName="authorino"
Sep 08 15:41:46.580905 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.580859    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ee4959c9-88f1-44b6-af57-2609a03c4084" containerName="authorino"
Sep 08 15:41:46.580939 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.580926    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ee4959c9-88f1-44b6-af57-2609a03c4084" containerName="authorino"
Sep 08 15:41:46.585643 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.585627    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.590046 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.590018    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 15:41:46.590046 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.590022    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 15:41:46.590230 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.590053    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 15:41:46.590230 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.590022    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qvnl7\""
Sep 08 15:41:46.597097 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.597075    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-95sj5"]
Sep 08 15:41:46.628435 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.628346    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:46.707201 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.707166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-metrics-certs\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.707328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.707218    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9w4wx\" (UniqueName: \"kubernetes.io/projected/2d99fef5-d96d-4f40-8122-0576c5066f9d-kube-api-access-9w4wx\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.707328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.707274    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-webhook-cert\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.808491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.808449    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9w4wx\" (UniqueName: \"kubernetes.io/projected/2d99fef5-d96d-4f40-8122-0576c5066f9d-kube-api-access-9w4wx\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.808491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.808500    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-webhook-cert\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.808661 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.808555    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-metrics-certs\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.811042 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.811014    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-metrics-certs\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.811165 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.811145    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-webhook-cert\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.819643 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.819620    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9w4wx\" (UniqueName: \"kubernetes.io/projected/2d99fef5-d96d-4f40-8122-0576c5066f9d-kube-api-access-9w4wx\") pod \"maas-controller-74dcff4f44-95sj5\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") " pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:46.895667 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:46.895584    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:47.170895 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:47.170870    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-95sj5"]
Sep 08 15:41:47.172738 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:41:47.172713    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d99fef5_d96d_4f40_8122_0576c5066f9d.slice/crio-199c070f39c8bba8d99e8234f5abe8b65f0d33d3302c5116b7043c2fe0d96b0e WatchSource:0}: Error finding container 199c070f39c8bba8d99e8234f5abe8b65f0d33d3302c5116b7043c2fe0d96b0e: Status 404 returned error can't find the container with id 199c070f39c8bba8d99e8234f5abe8b65f0d33d3302c5116b7043c2fe0d96b0e
Sep 08 15:41:47.630435 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:47.630398    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-95sj5" event={"ID":"2d99fef5-d96d-4f40-8122-0576c5066f9d","Type":"ContainerStarted","Data":"199c070f39c8bba8d99e8234f5abe8b65f0d33d3302c5116b7043c2fe0d96b0e"}
Sep 08 15:41:49.746998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:49.746945    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:49.834677 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:49.834647    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:41:53.662654 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:53.662614    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-95sj5" event={"ID":"2d99fef5-d96d-4f40-8122-0576c5066f9d","Type":"ContainerStarted","Data":"92a70a2f5e51756d7f6df36c24de178984df039701815bf0818730b526066063"}
Sep 08 15:41:53.663082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:53.662714    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:41:53.682349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:41:53.682302    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74dcff4f44-95sj5" podStartSLOduration=2.168968014 podStartE2EDuration="7.682286904s" totalImagesPullingTime="5.51331889s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:41:53.681009653 +0000 UTC m=+574.041552419" watchObservedRunningTime="2026-09-08 15:41:53.682286904 +0000 UTC m=+574.042829669"
Sep 08 15:42:04.670130 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:04.670093    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 15:42:25.260588 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:25.260547    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:25.360302 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:25.360266    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:26.687999 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.687943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:26.787827 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.787788    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:26.828149 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.828112    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"]
Sep 08 15:42:26.833535 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.833512    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.836286 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.836266    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-metrics-tls\""
Sep 08 15:42:26.837422 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.837393    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\""
Sep 08 15:42:26.837525 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.837454    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Sep 08 15:42:26.837742 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.837724    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Sep 08 15:42:26.844933 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.844907    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"]
Sep 08 15:42:26.845947 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.845923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f719e7-e9eb-499c-8cdf-5a3823b84933-openshift-service-ca\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.846108 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.846086    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-maas-api-tls\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.846216 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.846194    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-metrics-certs\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.846343 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.846286    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2x4w9\" (UniqueName: \"kubernetes.io/projected/56f719e7-e9eb-499c-8cdf-5a3823b84933-kube-api-access-2x4w9\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.911898 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.911847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:26.946774 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.946677    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2x4w9\" (UniqueName: \"kubernetes.io/projected/56f719e7-e9eb-499c-8cdf-5a3823b84933-kube-api-access-2x4w9\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.946774 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.946743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f719e7-e9eb-499c-8cdf-5a3823b84933-openshift-service-ca\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.947053 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.946786    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-maas-api-tls\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.947053 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.946827    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-metrics-certs\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.947627 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.947597    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f719e7-e9eb-499c-8cdf-5a3823b84933-openshift-service-ca\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.949572 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.949547    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-maas-api-tls\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.949696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.949554    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-metrics-certs\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:26.955105 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:26.955073    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2x4w9\" (UniqueName: \"kubernetes.io/projected/56f719e7-e9eb-499c-8cdf-5a3823b84933-kube-api-access-2x4w9\") pod \"maas-api-6b689f8c54-chwk4\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") " pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:27.003263 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.003224    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:27.145558 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.145524    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:27.266206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.266175    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:27.358676 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.358641    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:27.363722 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.363698    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"]
Sep 08 15:42:27.366888 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.366870    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:27.369405 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.369386    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-5zp7x\""
Sep 08 15:42:27.369862 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.369842    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Sep 08 15:42:27.378849 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.378828    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"]
Sep 08 15:42:27.427394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.427368    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"]
Sep 08 15:42:27.450591 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.450514    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1519a97f-4c91-46a1-9239-439b8916f2f2-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kkjwl\" (UID: \"1519a97f-4c91-46a1-9239-439b8916f2f2\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:27.450591 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.450567    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2wsp\" (UniqueName: \"kubernetes.io/projected/1519a97f-4c91-46a1-9239-439b8916f2f2-kube-api-access-m2wsp\") pod \"payload-pre-processing-59fbc47bf8-kkjwl\" (UID: \"1519a97f-4c91-46a1-9239-439b8916f2f2\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:27.462866 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.462833    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:42:27.551904 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.551857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1519a97f-4c91-46a1-9239-439b8916f2f2-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kkjwl\" (UID: \"1519a97f-4c91-46a1-9239-439b8916f2f2\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:27.552135 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.551927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2wsp\" (UniqueName: \"kubernetes.io/projected/1519a97f-4c91-46a1-9239-439b8916f2f2-kube-api-access-m2wsp\") pod \"payload-pre-processing-59fbc47bf8-kkjwl\" (UID: \"1519a97f-4c91-46a1-9239-439b8916f2f2\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:27.552894 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.552864    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1519a97f-4c91-46a1-9239-439b8916f2f2-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-kkjwl\" (UID: \"1519a97f-4c91-46a1-9239-439b8916f2f2\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:27.571264 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.571227    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2wsp\" (UniqueName: \"kubernetes.io/projected/1519a97f-4c91-46a1-9239-439b8916f2f2-kube-api-access-m2wsp\") pod \"payload-pre-processing-59fbc47bf8-kkjwl\" (UID: \"1519a97f-4c91-46a1-9239-439b8916f2f2\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:27.678115 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.678075    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:27.837115 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.837076    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4" event={"ID":"56f719e7-e9eb-499c-8cdf-5a3823b84933","Type":"ContainerStarted","Data":"b1bed7de3812644f603d8b824ab247d8108cbb3ac55d6d9a1263baf737ccf636"}
Sep 08 15:42:27.954389 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:27.954358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"]
Sep 08 15:42:27.957533 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:42:27.957492    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1519a97f_4c91_46a1_9239_439b8916f2f2.slice/crio-4f964c777c70b388c6c00877a09a6632a406f8c9b1dbbcabc2a558626886b551 WatchSource:0}: Error finding container 4f964c777c70b388c6c00877a09a6632a406f8c9b1dbbcabc2a558626886b551: Status 404 returned error can't find the container with id 4f964c777c70b388c6c00877a09a6632a406f8c9b1dbbcabc2a558626886b551
Sep 08 15:42:28.848276 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:28.848236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl" event={"ID":"1519a97f-4c91-46a1-9239-439b8916f2f2","Type":"ContainerStarted","Data":"4f964c777c70b388c6c00877a09a6632a406f8c9b1dbbcabc2a558626886b551"}
Sep 08 15:42:30.861686 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:30.861633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4" event={"ID":"56f719e7-e9eb-499c-8cdf-5a3823b84933","Type":"ContainerStarted","Data":"6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3"}
Sep 08 15:42:30.862125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:30.861800    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:30.863223 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:30.863202    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl" event={"ID":"1519a97f-4c91-46a1-9239-439b8916f2f2","Type":"ContainerStarted","Data":"7ac0e2e7a1cc1000e916e47e5fb8d3253a25fc53381e5a23554a4d32756c4097"}
Sep 08 15:42:30.863325 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:30.863259    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:30.881980 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:30.881915    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4" podStartSLOduration=2.506381032 podStartE2EDuration="4.881901331s" totalImagesPullingTime="2.375520299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:42:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:42:30.881858543 +0000 UTC m=+611.242401307" watchObservedRunningTime="2026-09-08 15:42:30.881901331 +0000 UTC m=+611.242444080"
Sep 08 15:42:30.900607 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:30.900547    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl" podStartSLOduration=2.005115477 podStartE2EDuration="3.900528004s" totalImagesPullingTime="1.895412527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:42:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:42:30.898598201 +0000 UTC m=+611.259140967" watchObservedRunningTime="2026-09-08 15:42:30.900528004 +0000 UTC m=+611.261070846"
Sep 08 15:42:36.874309 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:36.874281    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 15:42:37.910306 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:37.910274    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:38.007226 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:38.007196    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:41.871062 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:41.871030    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-kkjwl"
Sep 08 15:42:45.168305 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:45.168259    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:50.673107 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:50.673071    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:42:51.155585 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:42:51.155547    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:43:07.479146 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.479102    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"]
Sep 08 15:43:07.484857 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.484834    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.487662 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.487639    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-przhh\""
Sep 08 15:43:07.487772 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.487677    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Sep 08 15:43:07.488712 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.488693    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Sep 08 15:43:07.488846 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.488825    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Sep 08 15:43:07.496780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.496757    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"]
Sep 08 15:43:07.524237 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.524198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:07.606983 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.606930    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead29dbd-6a33-49e1-9010-dc4e3221212d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.607174 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.607002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.607174 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.607022    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.607174 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.607045    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.607174 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.607126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.607402 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.607203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qkp8\" (UniqueName: \"kubernetes.io/projected/ead29dbd-6a33-49e1-9010-dc4e3221212d-kube-api-access-9qkp8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708141 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708108    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead29dbd-6a33-49e1-9010-dc4e3221212d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708173    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708199    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708240    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708319    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qkp8\" (UniqueName: \"kubernetes.io/projected/ead29dbd-6a33-49e1-9010-dc4e3221212d-kube-api-access-9qkp8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708691 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708626    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708691 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708641    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.708776 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.708694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.710607 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.710582    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead29dbd-6a33-49e1-9010-dc4e3221212d-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.710740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.710694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead29dbd-6a33-49e1-9010-dc4e3221212d-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.716621 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.716594    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qkp8\" (UniqueName: \"kubernetes.io/projected/ead29dbd-6a33-49e1-9010-dc4e3221212d-kube-api-access-9qkp8\") pod \"e2e-distinct-simulated-kserve-59975d69f9-p5n9x\" (UID: \"ead29dbd-6a33-49e1-9010-dc4e3221212d\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.796832 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.796733    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:07.829391 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:07.829356    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:43:08.079306 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:08.079277    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"]
Sep 08 15:43:08.081644 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:43:08.081602    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead29dbd_6a33_49e1_9010_dc4e3221212d.slice/crio-15f14e4e9ff49e7d950edd47a461a6df886ccd01bd1c7a67be977404e3944823 WatchSource:0}: Error finding container 15f14e4e9ff49e7d950edd47a461a6df886ccd01bd1c7a67be977404e3944823: Status 404 returned error can't find the container with id 15f14e4e9ff49e7d950edd47a461a6df886ccd01bd1c7a67be977404e3944823
Sep 08 15:43:08.083179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:08.083157    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:43:09.066016 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:09.065953    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x" event={"ID":"ead29dbd-6a33-49e1-9010-dc4e3221212d","Type":"ContainerStarted","Data":"15f14e4e9ff49e7d950edd47a461a6df886ccd01bd1c7a67be977404e3944823"}
Sep 08 15:43:10.072895 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:10.072861    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x" event={"ID":"ead29dbd-6a33-49e1-9010-dc4e3221212d","Type":"ContainerStarted","Data":"354dde12c2135701ec789018655ce3d2f4578643862bdf040463073c4ab2c3aa"}
Sep 08 15:43:10.091857 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:10.091802    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x" podStartSLOduration=2.019099898 podStartE2EDuration="3.091785921s" totalImagesPullingTime="1.072686023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:43:10.090951524 +0000 UTC m=+650.451494290" watchObservedRunningTime="2026-09-08 15:43:10.091785921 +0000 UTC m=+650.452328686"
Sep 08 15:43:17.796995 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:17.796934    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:17.797409 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:17.797020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:17.809875 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:17.809847    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:18.125138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:18.125108    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-p5n9x"
Sep 08 15:43:24.256176 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:24.256139    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:25.133001 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:25.132950    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:43:34.917527 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:34.917491    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"]
Sep 08 15:43:34.920930 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:34.920908    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:34.924095 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:34.924070    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Sep 08 15:43:34.939800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:34.939767    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"]
Sep 08 15:43:34.973224 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:34.973190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:35.050066 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.050029    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.050251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.050077    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpp4b\" (UniqueName: \"kubernetes.io/projected/18050f2d-bd66-42b2-898b-e365be991325-kube-api-access-zpp4b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.050251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.050109    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.050251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.050195    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18050f2d-bd66-42b2-898b-e365be991325-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.050251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.050216    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.050251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.050243    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.150946    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18050f2d-bd66-42b2-898b-e365be991325-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.151021    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.151063    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.151114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.151149    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpp4b\" (UniqueName: \"kubernetes.io/projected/18050f2d-bd66-42b2-898b-e365be991325-kube-api-access-zpp4b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.151176    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151538 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.151509    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151631 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.151551    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.151631 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.151577    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.153403 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.153375    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/18050f2d-bd66-42b2-898b-e365be991325-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.153699 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.153680    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/18050f2d-bd66-42b2-898b-e365be991325-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.159723 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.159703    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpp4b\" (UniqueName: \"kubernetes.io/projected/18050f2d-bd66-42b2-898b-e365be991325-kube-api-access-zpp4b\") pod \"e2e-trlp-test-simulated-kserve-598466548d-w7pv8\" (UID: \"18050f2d-bd66-42b2-898b-e365be991325\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.232056 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.231945    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:35.510452 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:35.510425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"]
Sep 08 15:43:35.512345 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:43:35.512307    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18050f2d_bd66_42b2_898b_e365be991325.slice/crio-ba33c1aaef652859da48a193ff08546daeb54c46d1b3894f9d0238f907abb4ca WatchSource:0}: Error finding container ba33c1aaef652859da48a193ff08546daeb54c46d1b3894f9d0238f907abb4ca: Status 404 returned error can't find the container with id ba33c1aaef652859da48a193ff08546daeb54c46d1b3894f9d0238f907abb4ca
Sep 08 15:43:36.209244 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:36.209208    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8" event={"ID":"18050f2d-bd66-42b2-898b-e365be991325","Type":"ContainerStarted","Data":"9da0e21e986e45794acc2d2897c7915be79cd9d8a10eb16772ba69ed7f297842"}
Sep 08 15:43:36.209712 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:36.209258    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8" event={"ID":"18050f2d-bd66-42b2-898b-e365be991325","Type":"ContainerStarted","Data":"ba33c1aaef652859da48a193ff08546daeb54c46d1b3894f9d0238f907abb4ca"}
Sep 08 15:43:36.228075 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:36.228026    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8" podStartSLOduration=2.034311027 podStartE2EDuration="2.228011055s" totalImagesPullingTime="193.700028ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:43:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:43:36.225809333 +0000 UTC m=+676.586352099" watchObservedRunningTime="2026-09-08 15:43:36.228011055 +0000 UTC m=+676.588553813"
Sep 08 15:43:36.231679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:36.231654    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:43:45.232416 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:45.232373    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:45.232803 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:45.232439    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:45.245491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:45.245464    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:45.269344 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:45.269316    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-w7pv8"
Sep 08 15:43:53.423479 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:53.423434    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:43:54.827267 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:43:54.827234    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:44:01.223164 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.223132    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"]
Sep 08 15:44:01.226765 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.226735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.229451 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.229426    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Sep 08 15:44:01.236882 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.236857    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"]
Sep 08 15:44:01.250277 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.250252    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:01.277285 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.277255    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.277404 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.277308    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.277404 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.277388    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.277496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.277410    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.277496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.277431    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v25sp\" (UniqueName: \"kubernetes.io/projected/f1a4290b-200b-423e-9903-6a91787ed56c-kube-api-access-v25sp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.277496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.277465    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1a4290b-200b-423e-9903-6a91787ed56c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378435 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378402    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378591 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378440    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378591 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378465    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378685 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378624    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378685 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378659    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v25sp\" (UniqueName: \"kubernetes.io/projected/f1a4290b-200b-423e-9903-6a91787ed56c-kube-api-access-v25sp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378763 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378708    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1a4290b-200b-423e-9903-6a91787ed56c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378815 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378872 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378827    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.378949 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.378930    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.380904 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.380874    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f1a4290b-200b-423e-9903-6a91787ed56c-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.381143 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.381127    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f1a4290b-200b-423e-9903-6a91787ed56c-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.386298 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.386277    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v25sp\" (UniqueName: \"kubernetes.io/projected/f1a4290b-200b-423e-9903-6a91787ed56c-kube-api-access-v25sp\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-cpnkz\" (UID: \"f1a4290b-200b-423e-9903-6a91787ed56c\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.537931 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.537857    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:01.812477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:01.812449    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"]
Sep 08 15:44:01.815019 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:44:01.814985    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1a4290b_200b_423e_9903_6a91787ed56c.slice/crio-86768e3d1fe1dba4d9886cd52eb5a7685621478373cb50f6b12b50b156cfb1ab WatchSource:0}: Error finding container 86768e3d1fe1dba4d9886cd52eb5a7685621478373cb50f6b12b50b156cfb1ab: Status 404 returned error can't find the container with id 86768e3d1fe1dba4d9886cd52eb5a7685621478373cb50f6b12b50b156cfb1ab
Sep 08 15:44:02.346716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:02.346673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz" event={"ID":"f1a4290b-200b-423e-9903-6a91787ed56c","Type":"ContainerStarted","Data":"2db42a6bac433dfafd5f11f7eecc93497801f1e876965e64183effc5a306ebb0"}
Sep 08 15:44:02.347124 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:02.346736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz" event={"ID":"f1a4290b-200b-423e-9903-6a91787ed56c","Type":"ContainerStarted","Data":"86768e3d1fe1dba4d9886cd52eb5a7685621478373cb50f6b12b50b156cfb1ab"}
Sep 08 15:44:02.365370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:02.365314    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz" podStartSLOduration=1.170503989 podStartE2EDuration="1.365294369s" totalImagesPullingTime="194.79038ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:44:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:02.364891081 +0000 UTC m=+702.725433847" watchObservedRunningTime="2026-09-08 15:44:02.365294369 +0000 UTC m=+702.725837135"
Sep 08 15:44:02.924119 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:02.924082    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:44:11.538173 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:11.538135    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:11.538744 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:11.538200    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:11.550437 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:11.550414    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:12.417234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:12.417160    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-cpnkz"
Sep 08 15:44:14.115404 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.115369    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"]
Sep 08 15:44:14.120011 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.119985    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.123055 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.123033    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Sep 08 15:44:14.127123 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.127102    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"]
Sep 08 15:44:14.147388 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.147359    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:14.188932 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.188903    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83ebcf21-fc91-42da-9764-7ff49be23c87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.189086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.188945    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-brrq9\" (UniqueName: \"kubernetes.io/projected/83ebcf21-fc91-42da-9764-7ff49be23c87-kube-api-access-brrq9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.189086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.189002    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.189086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.189036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.189207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.189119    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.189207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.189153    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.290288 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.290249    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.290441 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.290316    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.290441 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.290353    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.290441 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.290432    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83ebcf21-fc91-42da-9764-7ff49be23c87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.290571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.290463    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-brrq9\" (UniqueName: \"kubernetes.io/projected/83ebcf21-fc91-42da-9764-7ff49be23c87-kube-api-access-brrq9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.290629 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.290591    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.290731 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.290709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.290834 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.290799    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-model-cache\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.291025 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.291002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-home\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.292751 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.292728    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/83ebcf21-fc91-42da-9764-7ff49be23c87-dshm\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.292893 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.292877    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/83ebcf21-fc91-42da-9764-7ff49be23c87-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.298714 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.298688    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-brrq9\" (UniqueName: \"kubernetes.io/projected/83ebcf21-fc91-42da-9764-7ff49be23c87-kube-api-access-brrq9\") pod \"premium-simulated-simulated-premium-kserve-57fc66f697-qspjf\" (UID: \"83ebcf21-fc91-42da-9764-7ff49be23c87\") " pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.431417 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.431330    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:14.705995 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:14.705952    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"]
Sep 08 15:44:14.708380 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:44:14.708357    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod83ebcf21_fc91_42da_9764_7ff49be23c87.slice/crio-def284f203c94ec6b4a7aa3eaf47c48d478a0fde13f6fb996a8f1a20f1688d57 WatchSource:0}: Error finding container def284f203c94ec6b4a7aa3eaf47c48d478a0fde13f6fb996a8f1a20f1688d57: Status 404 returned error can't find the container with id def284f203c94ec6b4a7aa3eaf47c48d478a0fde13f6fb996a8f1a20f1688d57
Sep 08 15:44:15.422383 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:15.422344    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf" event={"ID":"83ebcf21-fc91-42da-9764-7ff49be23c87","Type":"ContainerStarted","Data":"738fb768bb6a9129ab2a58ce8ce6be37659bc8680b381a1443bb6108a6b736a0"}
Sep 08 15:44:15.422751 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:15.422393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf" event={"ID":"83ebcf21-fc91-42da-9764-7ff49be23c87","Type":"ContainerStarted","Data":"def284f203c94ec6b4a7aa3eaf47c48d478a0fde13f6fb996a8f1a20f1688d57"}
Sep 08 15:44:15.440967 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:15.440912    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf" podStartSLOduration=1.252253357 podStartE2EDuration="1.440898378s" totalImagesPullingTime="188.645021ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:44:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:44:15.439465217 +0000 UTC m=+715.800007984" watchObservedRunningTime="2026-09-08 15:44:15.440898378 +0000 UTC m=+715.801441142"
Sep 08 15:44:16.731143 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:16.731101    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:44:24.432316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:24.432272    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:24.432759 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:24.432334    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:24.445211 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:24.445181    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:24.482475 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:24.482445    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-57fc66f697-qspjf"
Sep 08 15:44:41.765531 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:41.765492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:41.822903 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:41.822871    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:45.318417 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:45.318381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:44:45.419356 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:44:45.419322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:00.853547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:00.853496    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d96b94bbf-86wfx"]
Sep 08 15:45:00.857216 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:00.857195    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:45:00.865387 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:00.865359    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d96b94bbf-86wfx"]
Sep 08 15:45:00.904497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:00.904460    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k4swl\" (UniqueName: \"kubernetes.io/projected/a4ac399a-17a9-4b6a-9ff3-455460342317-kube-api-access-k4swl\") pod \"authorino-6d96b94bbf-86wfx\" (UID: \"a4ac399a-17a9-4b6a-9ff3-455460342317\") " pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:45:00.904668 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:00.904523    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4ac399a-17a9-4b6a-9ff3-455460342317-tls-cert\") pod \"authorino-6d96b94bbf-86wfx\" (UID: \"a4ac399a-17a9-4b6a-9ff3-455460342317\") " pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:45:01.005009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:01.004947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k4swl\" (UniqueName: \"kubernetes.io/projected/a4ac399a-17a9-4b6a-9ff3-455460342317-kube-api-access-k4swl\") pod \"authorino-6d96b94bbf-86wfx\" (UID: \"a4ac399a-17a9-4b6a-9ff3-455460342317\") " pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:45:01.005185 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:01.005052    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4ac399a-17a9-4b6a-9ff3-455460342317-tls-cert\") pod \"authorino-6d96b94bbf-86wfx\" (UID: \"a4ac399a-17a9-4b6a-9ff3-455460342317\") " pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:45:01.007624 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:01.007598    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4ac399a-17a9-4b6a-9ff3-455460342317-tls-cert\") pod \"authorino-6d96b94bbf-86wfx\" (UID: \"a4ac399a-17a9-4b6a-9ff3-455460342317\") " pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:45:01.013233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:01.013213    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k4swl\" (UniqueName: \"kubernetes.io/projected/a4ac399a-17a9-4b6a-9ff3-455460342317-kube-api-access-k4swl\") pod \"authorino-6d96b94bbf-86wfx\" (UID: \"a4ac399a-17a9-4b6a-9ff3-455460342317\") " pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:45:01.167665 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:01.167580    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:45:01.440777 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:01.440750    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d96b94bbf-86wfx"]
Sep 08 15:45:01.443774 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:45:01.443746    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda4ac399a_17a9_4b6a_9ff3_455460342317.slice/crio-038013b9eedc960cd6cfaf3d66b73797035b053a4f197b712f34ea6a4703f1bd WatchSource:0}: Error finding container 038013b9eedc960cd6cfaf3d66b73797035b053a4f197b712f34ea6a4703f1bd: Status 404 returned error can't find the container with id 038013b9eedc960cd6cfaf3d66b73797035b053a4f197b712f34ea6a4703f1bd
Sep 08 15:45:01.689575 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:01.689533    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d96b94bbf-86wfx" event={"ID":"a4ac399a-17a9-4b6a-9ff3-455460342317","Type":"ContainerStarted","Data":"038013b9eedc960cd6cfaf3d66b73797035b053a4f197b712f34ea6a4703f1bd"}
Sep 08 15:45:02.699111 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:02.699022    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d96b94bbf-86wfx" event={"ID":"a4ac399a-17a9-4b6a-9ff3-455460342317","Type":"ContainerStarted","Data":"f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028"}
Sep 08 15:45:02.720904 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:02.720847    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d96b94bbf-86wfx" podStartSLOduration=1.832127484 podStartE2EDuration="2.720829661s" totalImagesPullingTime="888.702177ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:02.718762815 +0000 UTC m=+763.079305584" watchObservedRunningTime="2026-09-08 15:45:02.720829661 +0000 UTC m=+763.081372425"
Sep 08 15:45:02.771104 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:02.771069    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56977c4db8-4htzj"]
Sep 08 15:45:02.771546 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:02.771516    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-56977c4db8-4htzj" podUID="5471bd49-5a13-4465-8ff2-88c682544568" containerName="authorino" containerID="cri-o://019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2" gracePeriod=30
Sep 08 15:45:03.028118 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.028084    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:45:03.123663 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.123622    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-52vpq\" (UniqueName: \"kubernetes.io/projected/5471bd49-5a13-4465-8ff2-88c682544568-kube-api-access-52vpq\") pod \"5471bd49-5a13-4465-8ff2-88c682544568\" (UID: \"5471bd49-5a13-4465-8ff2-88c682544568\") "
Sep 08 15:45:03.123858 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.123674    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5471bd49-5a13-4465-8ff2-88c682544568-tls-cert\") pod \"5471bd49-5a13-4465-8ff2-88c682544568\" (UID: \"5471bd49-5a13-4465-8ff2-88c682544568\") "
Sep 08 15:45:03.125732 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.125701    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5471bd49-5a13-4465-8ff2-88c682544568-kube-api-access-52vpq" (OuterVolumeSpecName: "kube-api-access-52vpq") pod "5471bd49-5a13-4465-8ff2-88c682544568" (UID: "5471bd49-5a13-4465-8ff2-88c682544568"). InnerVolumeSpecName "kube-api-access-52vpq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:45:03.135268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.135229    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5471bd49-5a13-4465-8ff2-88c682544568-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5471bd49-5a13-4465-8ff2-88c682544568" (UID: "5471bd49-5a13-4465-8ff2-88c682544568"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:45:03.224569 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.224527    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5471bd49-5a13-4465-8ff2-88c682544568-tls-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:45:03.224569 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.224557    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-52vpq\" (UniqueName: \"kubernetes.io/projected/5471bd49-5a13-4465-8ff2-88c682544568-kube-api-access-52vpq\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:45:03.370928 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.370885    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:03.483093 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.483058    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:03.709393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.709296    2579 generic.go:356] "Generic (PLEG): container finished" podID="5471bd49-5a13-4465-8ff2-88c682544568" containerID="019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2" exitCode=0
Sep 08 15:45:03.709393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.709364    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56977c4db8-4htzj"
Sep 08 15:45:03.709879 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.709388    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56977c4db8-4htzj" event={"ID":"5471bd49-5a13-4465-8ff2-88c682544568","Type":"ContainerDied","Data":"019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2"}
Sep 08 15:45:03.709879 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.709436    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56977c4db8-4htzj" event={"ID":"5471bd49-5a13-4465-8ff2-88c682544568","Type":"ContainerDied","Data":"2ab7ad96bdb99253a7048b9329ad410ccf1d435170b0fa9aca6065547dd40535"}
Sep 08 15:45:03.709879 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.709458    2579 scope.go:117] "RemoveContainer" containerID="019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2"
Sep 08 15:45:03.720244 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.720222    2579 scope.go:117] "RemoveContainer" containerID="019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2"
Sep 08 15:45:03.720614 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:45:03.720592    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2\": container with ID starting with 019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2 not found: ID does not exist" containerID="019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2"
Sep 08 15:45:03.720681 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.720621    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2"} err="failed to get container status \"019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2\": rpc error: code = NotFound desc = could not find container \"019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2\": container with ID starting with 019d05682d3ca33f72e6eff59d1c8a7e4d49b7c629bdbea1b5fcf7f35ddbcbf2 not found: ID does not exist"
Sep 08 15:45:03.732867 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.732832    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56977c4db8-4htzj"]
Sep 08 15:45:03.736812 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:03.736775    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56977c4db8-4htzj"]
Sep 08 15:45:04.115314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:04.115268    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5471bd49-5a13-4465-8ff2-88c682544568" path="/var/lib/kubelet/pods/5471bd49-5a13-4465-8ff2-88c682544568/volumes"
Sep 08 15:45:04.646010 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:04.645950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:04.747887 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:04.747846    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:18.724478 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:18.724442    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.610161 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:21.610114    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.709725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:21.709686    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:21.951917 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:21.951836    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:22.312674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:22.312583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:23.246582 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.246538    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:23.343503 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.343468    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:23.705117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.705081    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7790-139920034489648"]
Sep 08 15:45:23.705496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.705481    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5471bd49-5a13-4465-8ff2-88c682544568" containerName="authorino"
Sep 08 15:45:23.705546 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.705498    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5471bd49-5a13-4465-8ff2-88c682544568" containerName="authorino"
Sep 08 15:45:23.705581 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.705572    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5471bd49-5a13-4465-8ff2-88c682544568" containerName="authorino"
Sep 08 15:45:23.709892 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.709868    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-139920034489648"
Sep 08 15:45:23.712972 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.712934    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6hc5f\""
Sep 08 15:45:23.716418 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.716386    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7790-139920034489648"]
Sep 08 15:45:23.739276 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.739246    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:23.821080 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.821048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l2ct7\" (UniqueName: \"kubernetes.io/projected/86d46911-21b3-4eb9-9376-312f22ecfd56-kube-api-access-l2ct7\") pod \"test-curl-7790-139920034489648\" (UID: \"86d46911-21b3-4eb9-9376-312f22ecfd56\") " pod="opendatahub/test-curl-7790-139920034489648"
Sep 08 15:45:23.922144 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.922100    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l2ct7\" (UniqueName: \"kubernetes.io/projected/86d46911-21b3-4eb9-9376-312f22ecfd56-kube-api-access-l2ct7\") pod \"test-curl-7790-139920034489648\" (UID: \"86d46911-21b3-4eb9-9376-312f22ecfd56\") " pod="opendatahub/test-curl-7790-139920034489648"
Sep 08 15:45:23.931204 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:23.931171    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l2ct7\" (UniqueName: \"kubernetes.io/projected/86d46911-21b3-4eb9-9376-312f22ecfd56-kube-api-access-l2ct7\") pod \"test-curl-7790-139920034489648\" (UID: \"86d46911-21b3-4eb9-9376-312f22ecfd56\") " pod="opendatahub/test-curl-7790-139920034489648"
Sep 08 15:45:24.020791 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:24.020702    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-139920034489648"
Sep 08 15:45:24.294205 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:24.294171    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7790-139920034489648"]
Sep 08 15:45:24.296036 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:45:24.295995    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod86d46911_21b3_4eb9_9376_312f22ecfd56.slice/crio-9e157f073840977d53b62663b5540c7ef722d4caa62ddf6ea14210a932abaeb1 WatchSource:0}: Error finding container 9e157f073840977d53b62663b5540c7ef722d4caa62ddf6ea14210a932abaeb1: Status 404 returned error can't find the container with id 9e157f073840977d53b62663b5540c7ef722d4caa62ddf6ea14210a932abaeb1
Sep 08 15:45:24.838397 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:24.838359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7790-139920034489648" event={"ID":"86d46911-21b3-4eb9-9376-312f22ecfd56","Type":"ContainerStarted","Data":"9e157f073840977d53b62663b5540c7ef722d4caa62ddf6ea14210a932abaeb1"}
Sep 08 15:45:25.536644 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:25.536606    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:45:25.590172 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:25.590123    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:25.685872 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:25.685829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:25.845944 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:25.845907    2579 generic.go:356] "Generic (PLEG): container finished" podID="86d46911-21b3-4eb9-9376-312f22ecfd56" containerID="e4f4737e5eb0ac700a8a808f5d3816d5979ea884657766b7a3ec149ddb579f06" exitCode=0
Sep 08 15:45:25.846125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:25.845979    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7790-139920034489648" event={"ID":"86d46911-21b3-4eb9-9376-312f22ecfd56","Type":"ContainerDied","Data":"e4f4737e5eb0ac700a8a808f5d3816d5979ea884657766b7a3ec149ddb579f06"}
Sep 08 15:45:26.919700 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:26.919668    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"]
Sep 08 15:45:26.923745 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:26.923722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:26.927172 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:26.927146    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tq4f4\""
Sep 08 15:45:26.927375 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:26.927325    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-a-28e012-serving-cert\""
Sep 08 15:45:26.934622 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:26.934584    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"]
Sep 08 15:45:26.964780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:26.964742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:26.999120 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:26.999095    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-139920034489648"
Sep 08 15:45:27.020552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.020523    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7790-139920034489648_86d46911-21b3-4eb9-9376-312f22ecfd56/test-curl-7790-139920034489648/0.log"
Sep 08 15:45:27.048477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.048450    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a56b7f2-c8e7-453e-af4a-da10201baddf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.048633 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.048511    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xh664\" (UniqueName: \"kubernetes.io/projected/7a56b7f2-c8e7-453e-af4a-da10201baddf-kube-api-access-xh664\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.048633 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.048579    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-metrics-certs\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.048711 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.048627    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-maas-api-tls\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.055157 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.055134    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7790-139920034489648"]
Sep 08 15:45:27.058243 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.058212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:27.060578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.060558    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7790-139920034489648"]
Sep 08 15:45:27.144690 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.144610    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:27.148972 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.148932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l2ct7\" (UniqueName: \"kubernetes.io/projected/86d46911-21b3-4eb9-9376-312f22ecfd56-kube-api-access-l2ct7\") pod \"86d46911-21b3-4eb9-9376-312f22ecfd56\" (UID: \"86d46911-21b3-4eb9-9376-312f22ecfd56\") "
Sep 08 15:45:27.149117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.149103    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a56b7f2-c8e7-453e-af4a-da10201baddf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.149187 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.149156    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xh664\" (UniqueName: \"kubernetes.io/projected/7a56b7f2-c8e7-453e-af4a-da10201baddf-kube-api-access-xh664\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.149254 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.149195    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-metrics-certs\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.149254 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.149214    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-maas-api-tls\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.149906 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.149876    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a56b7f2-c8e7-453e-af4a-da10201baddf-openshift-service-ca\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.151390 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.151359    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86d46911-21b3-4eb9-9376-312f22ecfd56-kube-api-access-l2ct7" (OuterVolumeSpecName: "kube-api-access-l2ct7") pod "86d46911-21b3-4eb9-9376-312f22ecfd56" (UID: "86d46911-21b3-4eb9-9376-312f22ecfd56"). InnerVolumeSpecName "kube-api-access-l2ct7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:45:27.151771 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.151750    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-maas-api-tls\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.151860 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.151795    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-metrics-certs\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.157445 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.157420    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xh664\" (UniqueName: \"kubernetes.io/projected/7a56b7f2-c8e7-453e-af4a-da10201baddf-kube-api-access-xh664\") pod \"maas-api-e2e-inf-a-28e012-565d975844-nvlq6\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.239296 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.239268    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:27.250019 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.249993    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l2ct7\" (UniqueName: \"kubernetes.io/projected/86d46911-21b3-4eb9-9376-312f22ecfd56-kube-api-access-l2ct7\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:45:27.530141 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.530108    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"]
Sep 08 15:45:27.530295 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:45:27.530273    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a56b7f2_c8e7_453e_af4a_da10201baddf.slice/crio-a63b6398016fb477406c14c2515324672b863ba5c15eccd863a9e0ded419bef0 WatchSource:0}: Error finding container a63b6398016fb477406c14c2515324672b863ba5c15eccd863a9e0ded419bef0: Status 404 returned error can't find the container with id a63b6398016fb477406c14c2515324672b863ba5c15eccd863a9e0ded419bef0
Sep 08 15:45:27.553571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.553539    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:27.647680 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.647646    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:27.858443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.858413    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6" event={"ID":"7a56b7f2-c8e7-453e-af4a-da10201baddf","Type":"ContainerStarted","Data":"a63b6398016fb477406c14c2515324672b863ba5c15eccd863a9e0ded419bef0"}
Sep 08 15:45:27.860030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.859993    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9e157f073840977d53b62663b5540c7ef722d4caa62ddf6ea14210a932abaeb1"
Sep 08 15:45:27.860030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:27.860001    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7790-139920034489648"
Sep 08 15:45:27.872207 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:45:27.872176    2579 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7790-139920034489648\" is forbidden: User \"system:node:ip-10-0-134-78.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-78.ec2.internal' and this object" podUID="86d46911-21b3-4eb9-9376-312f22ecfd56" pod="opendatahub/test-curl-7790-139920034489648"
Sep 08 15:45:28.115171 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:28.115092    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86d46911-21b3-4eb9-9376-312f22ecfd56" path="/var/lib/kubelet/pods/86d46911-21b3-4eb9-9376-312f22ecfd56/volumes"
Sep 08 15:45:28.873358 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:28.873318    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6" event={"ID":"7a56b7f2-c8e7-453e-af4a-da10201baddf","Type":"ContainerStarted","Data":"95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65"}
Sep 08 15:45:28.873572 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:28.873476    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:28.891743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:28.891692    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6" podStartSLOduration=2.473256274 podStartE2EDuration="2.891678949s" totalImagesPullingTime="418.422675ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:28.890740056 +0000 UTC m=+789.251282814" watchObservedRunningTime="2026-09-08 15:45:28.891678949 +0000 UTC m=+789.252221713"
Sep 08 15:45:29.580835 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:29.580795    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:29.644909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:29.644875    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:29.838167 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:29.838084    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:30.156165 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:30.156066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:30.301793 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:30.301766    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:32.547802 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:32.547768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:32.928451 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:32.928414    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:33.148178 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:33.148148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:33.249505 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:33.249417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:33.355631 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:33.355591    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:34.331205 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.331167    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"]
Sep 08 15:45:34.331594 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.331579    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86d46911-21b3-4eb9-9376-312f22ecfd56" containerName="test-curl-7790-139920034489648"
Sep 08 15:45:34.331638 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.331595    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="86d46911-21b3-4eb9-9376-312f22ecfd56" containerName="test-curl-7790-139920034489648"
Sep 08 15:45:34.331674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.331664    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="86d46911-21b3-4eb9-9376-312f22ecfd56" containerName="test-curl-7790-139920034489648"
Sep 08 15:45:34.335982 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.335947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.339086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.339065    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ait-f1f0ac73-serving-cert\""
Sep 08 15:45:34.344949 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.344926    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"]
Sep 08 15:45:34.364324 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.364280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:34.413509 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.413468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47a05-f0ee-4b18-ae58-0a7bac559691-openshift-service-ca\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.413678 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.413516    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgsx4\" (UniqueName: \"kubernetes.io/projected/53a47a05-f0ee-4b18-ae58-0a7bac559691-kube-api-access-tgsx4\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.413678 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.413582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-metrics-certs\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.413678 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.413635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.464233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.464191    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:34.514424 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.514385    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47a05-f0ee-4b18-ae58-0a7bac559691-openshift-service-ca\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.514571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.514439    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgsx4\" (UniqueName: \"kubernetes.io/projected/53a47a05-f0ee-4b18-ae58-0a7bac559691-kube-api-access-tgsx4\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.514571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.514484    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-metrics-certs\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.514571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.514539    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.514700 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:45:34.514663    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-serving-cert: secret "maas-api-e2e-ait-f1f0ac73-serving-cert" not found
Sep 08 15:45:34.514755 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:45:34.514744    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls podName:53a47a05-f0ee-4b18-ae58-0a7bac559691 nodeName:}" failed. No retries permitted until 2026-09-08 15:45:35.014723548 +0000 UTC m=+795.375266309 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls") pod "maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z" (UID: "53a47a05-f0ee-4b18-ae58-0a7bac559691") : secret "maas-api-e2e-ait-f1f0ac73-serving-cert" not found
Sep 08 15:45:34.515204 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.515176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47a05-f0ee-4b18-ae58-0a7bac559691-openshift-service-ca\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.517022 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.516997    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-metrics-certs\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.522945 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.522924    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgsx4\" (UniqueName: \"kubernetes.io/projected/53a47a05-f0ee-4b18-ae58-0a7bac559691-kube-api-access-tgsx4\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:34.884482 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.884451    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:45:34.951485 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.951448    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"]
Sep 08 15:45:34.955343 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.955315    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:34.959599 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.959554    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-f1f0ac73-dockercfg-nq9wj\""
Sep 08 15:45:34.959754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.959735    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-f1f0ac73\""
Sep 08 15:45:34.965863 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.965834    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"]
Sep 08 15:45:34.977933 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.977898    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"]
Sep 08 15:45:34.981568 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.981545    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:34.993424 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:34.993397    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"]
Sep 08 15:45:35.019820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.019771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:35.022141 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.022119    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls\") pod \"maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") " pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:35.120533 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.120483    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mx72\" (UniqueName: \"kubernetes.io/projected/1ffb6be2-7061-4533-8893-9bebb0a4cf95-kube-api-access-8mx72\") pod \"payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8\" (UID: \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:35.120739 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.120651    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69xt5\" (UniqueName: \"kubernetes.io/projected/1a1b2131-07dc-4870-8f94-6b61d60025d0-kube-api-access-69xt5\") pod \"payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps\" (UID: \"1a1b2131-07dc-4870-8f94-6b61d60025d0\") " pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:35.120810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.120734    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a1b2131-07dc-4870-8f94-6b61d60025d0-plugins-config-volume\") pod \"payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps\" (UID: \"1a1b2131-07dc-4870-8f94-6b61d60025d0\") " pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:35.120810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.120768    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ffb6be2-7061-4533-8893-9bebb0a4cf95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8\" (UID: \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:35.222341 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.222241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69xt5\" (UniqueName: \"kubernetes.io/projected/1a1b2131-07dc-4870-8f94-6b61d60025d0-kube-api-access-69xt5\") pod \"payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps\" (UID: \"1a1b2131-07dc-4870-8f94-6b61d60025d0\") " pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:35.222341 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.222290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a1b2131-07dc-4870-8f94-6b61d60025d0-plugins-config-volume\") pod \"payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps\" (UID: \"1a1b2131-07dc-4870-8f94-6b61d60025d0\") " pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:35.222341 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.222310    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ffb6be2-7061-4533-8893-9bebb0a4cf95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8\" (UID: \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:35.222341 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.222344    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mx72\" (UniqueName: \"kubernetes.io/projected/1ffb6be2-7061-4533-8893-9bebb0a4cf95-kube-api-access-8mx72\") pod \"payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8\" (UID: \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:35.223084 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.223059    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ffb6be2-7061-4533-8893-9bebb0a4cf95-plugins-config-volume\") pod \"payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8\" (UID: \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:35.223084 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.223072    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a1b2131-07dc-4870-8f94-6b61d60025d0-plugins-config-volume\") pod \"payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps\" (UID: \"1a1b2131-07dc-4870-8f94-6b61d60025d0\") " pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:35.230817 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.230792    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mx72\" (UniqueName: \"kubernetes.io/projected/1ffb6be2-7061-4533-8893-9bebb0a4cf95-kube-api-access-8mx72\") pod \"payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8\" (UID: \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\") " pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:35.230953 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.230860    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-69xt5\" (UniqueName: \"kubernetes.io/projected/1a1b2131-07dc-4870-8f94-6b61d60025d0-kube-api-access-69xt5\") pod \"payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps\" (UID: \"1a1b2131-07dc-4870-8f94-6b61d60025d0\") " pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:35.248154 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.248119    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:35.271049 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.270947    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:35.295152 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.294577    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:35.532571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.532537    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"]
Sep 08 15:45:35.534152 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:45:35.534122    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53a47a05_f0ee_4b18_ae58_0a7bac559691.slice/crio-6fa90f19b51d491e159d8e0843b57f2f4bd0c2aef1b5e9f933530e16c38238ae WatchSource:0}: Error finding container 6fa90f19b51d491e159d8e0843b57f2f4bd0c2aef1b5e9f933530e16c38238ae: Status 404 returned error can't find the container with id 6fa90f19b51d491e159d8e0843b57f2f4bd0c2aef1b5e9f933530e16c38238ae
Sep 08 15:45:35.561807 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.561778    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"]
Sep 08 15:45:35.563607 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:45:35.563576    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ffb6be2_7061_4533_8893_9bebb0a4cf95.slice/crio-76274099ec0a957cffc0caa20f2d33bc342b698546d5675c8eb99ac261cc78a6 WatchSource:0}: Error finding container 76274099ec0a957cffc0caa20f2d33bc342b698546d5675c8eb99ac261cc78a6: Status 404 returned error can't find the container with id 76274099ec0a957cffc0caa20f2d33bc342b698546d5675c8eb99ac261cc78a6
Sep 08 15:45:35.586471 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.586441    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"]
Sep 08 15:45:35.591163 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:45:35.591135    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a1b2131_07dc_4870_8f94_6b61d60025d0.slice/crio-5220e7ab48722c9bb8c2ebd57c8ca6b1aa40964af5c0654a6c4ad8c4e52f51a7 WatchSource:0}: Error finding container 5220e7ab48722c9bb8c2ebd57c8ca6b1aa40964af5c0654a6c4ad8c4e52f51a7: Status 404 returned error can't find the container with id 5220e7ab48722c9bb8c2ebd57c8ca6b1aa40964af5c0654a6c4ad8c4e52f51a7
Sep 08 15:45:35.920524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.920486    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8" event={"ID":"1ffb6be2-7061-4533-8893-9bebb0a4cf95","Type":"ContainerStarted","Data":"2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf"}
Sep 08 15:45:35.920706 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.920553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8" event={"ID":"1ffb6be2-7061-4533-8893-9bebb0a4cf95","Type":"ContainerStarted","Data":"76274099ec0a957cffc0caa20f2d33bc342b698546d5675c8eb99ac261cc78a6"}
Sep 08 15:45:35.920706 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.920590    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:35.930786 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.930750    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z" event={"ID":"53a47a05-f0ee-4b18-ae58-0a7bac559691","Type":"ContainerStarted","Data":"6fa90f19b51d491e159d8e0843b57f2f4bd0c2aef1b5e9f933530e16c38238ae"}
Sep 08 15:45:35.932495 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.932467    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps" event={"ID":"1a1b2131-07dc-4870-8f94-6b61d60025d0","Type":"ContainerStarted","Data":"451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4"}
Sep 08 15:45:35.932605 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.932527    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:35.932605 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.932552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps" event={"ID":"1a1b2131-07dc-4870-8f94-6b61d60025d0","Type":"ContainerStarted","Data":"5220e7ab48722c9bb8c2ebd57c8ca6b1aa40964af5c0654a6c4ad8c4e52f51a7"}
Sep 08 15:45:35.945107 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.945039    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8" podStartSLOduration=1.9450185 podStartE2EDuration="1.9450185s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:35.940782277 +0000 UTC m=+796.301325042" watchObservedRunningTime="2026-09-08 15:45:35.9450185 +0000 UTC m=+796.305561267"
Sep 08 15:45:35.965994 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:35.965928    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps" podStartSLOduration=1.965911253 podStartE2EDuration="1.965911253s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:35.962782148 +0000 UTC m=+796.323324913" watchObservedRunningTime="2026-09-08 15:45:35.965911253 +0000 UTC m=+796.326454017"
Sep 08 15:45:36.452467 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:36.452428    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:36.548749 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:36.548707    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:36.893853 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:36.893799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:36.939998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:36.939940    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z" event={"ID":"53a47a05-f0ee-4b18-ae58-0a7bac559691","Type":"ContainerStarted","Data":"fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f"}
Sep 08 15:45:36.940180 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:36.940036    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:36.958757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:36.958678    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z" podStartSLOduration=2.630243465 podStartE2EDuration="2.958659352s" totalImagesPullingTime="328.415887ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:36.956662127 +0000 UTC m=+797.317204894" watchObservedRunningTime="2026-09-08 15:45:36.958659352 +0000 UTC m=+797.319202120"
Sep 08 15:45:36.961756 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:36.961716    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:37.034853 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.034820    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:45:37.259990 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.259884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:37.363869 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.363837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:37.453627 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.453595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:37.500646 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.500613    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"]
Sep 08 15:45:37.503900 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.503884    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:37.506512 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.506487    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-autores-36c51d\""
Sep 08 15:45:37.506619 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.506570    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-autores-36c51d-dockercfg-bntwg\""
Sep 08 15:45:37.515355 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.515331    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"]
Sep 08 15:45:37.645552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.645506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgc8q\" (UniqueName: \"kubernetes.io/projected/90422702-09cc-4aab-b025-31ba35b64da0-kube-api-access-mgc8q\") pod \"payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2\" (UID: \"90422702-09cc-4aab-b025-31ba35b64da0\") " pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:37.645552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.645558    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90422702-09cc-4aab-b025-31ba35b64da0-plugins-config-volume\") pod \"payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2\" (UID: \"90422702-09cc-4aab-b025-31ba35b64da0\") " pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:37.747112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.747073    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgc8q\" (UniqueName: \"kubernetes.io/projected/90422702-09cc-4aab-b025-31ba35b64da0-kube-api-access-mgc8q\") pod \"payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2\" (UID: \"90422702-09cc-4aab-b025-31ba35b64da0\") " pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:37.747112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.747114    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90422702-09cc-4aab-b025-31ba35b64da0-plugins-config-volume\") pod \"payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2\" (UID: \"90422702-09cc-4aab-b025-31ba35b64da0\") " pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:37.747857 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.747836    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90422702-09cc-4aab-b025-31ba35b64da0-plugins-config-volume\") pod \"payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2\" (UID: \"90422702-09cc-4aab-b025-31ba35b64da0\") " pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:37.755165 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.755141    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgc8q\" (UniqueName: \"kubernetes.io/projected/90422702-09cc-4aab-b025-31ba35b64da0-kube-api-access-mgc8q\") pod \"payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2\" (UID: \"90422702-09cc-4aab-b025-31ba35b64da0\") " pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:37.816101 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:37.816002    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:38.091765 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:38.091734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"]
Sep 08 15:45:38.092936 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:45:38.092910    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90422702_09cc_4aab_b025_31ba35b64da0.slice/crio-904b48b6aca00e62767c39382de9bde0028aa5c2f9e8af8accf6e4313936e2f8 WatchSource:0}: Error finding container 904b48b6aca00e62767c39382de9bde0028aa5c2f9e8af8accf6e4313936e2f8: Status 404 returned error can't find the container with id 904b48b6aca00e62767c39382de9bde0028aa5c2f9e8af8accf6e4313936e2f8
Sep 08 15:45:38.953685 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:38.953645    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2" event={"ID":"90422702-09cc-4aab-b025-31ba35b64da0","Type":"ContainerStarted","Data":"71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5"}
Sep 08 15:45:38.953685 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:38.953699    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2" event={"ID":"90422702-09cc-4aab-b025-31ba35b64da0","Type":"ContainerStarted","Data":"904b48b6aca00e62767c39382de9bde0028aa5c2f9e8af8accf6e4313936e2f8"}
Sep 08 15:45:38.953685 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:38.953764    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:38.983198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:38.983134    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2" podStartSLOduration=1.983113829 podStartE2EDuration="1.983113829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:45:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:45:38.982347637 +0000 UTC m=+799.342890425" watchObservedRunningTime="2026-09-08 15:45:38.983113829 +0000 UTC m=+799.343656591"
Sep 08 15:45:40.806352 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:40.806303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:40.934476 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:40.934441    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:41.025175 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:41.025137    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:41.123521 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:41.123491    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:41.189714 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:41.189680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:42.952742 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:42.952709    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:45:43.908628 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:43.908589    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:45.598221 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:45.598184    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:45.922773 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:45.922682    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:46.020871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:46.020838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:46.942541 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:46.942512    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:45:46.943042 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:46.942642    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:45:47.157780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:47.157745    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:47.263842 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:47.263752    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:47.360711 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:47.360678    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:47.526585 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:47.526488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:48.085796 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:48.085765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:49.822648 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:49.822601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:49.923328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:49.923285    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:49.961415 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:49.961380    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:45:50.613848 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:50.613815    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:50.950671 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:50.950572    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:51.244986 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:51.244878    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:45:51.262482 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:51.262429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:51.438544 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:51.438510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:53.600567 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:53.600524    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:53.702436 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:53.702394    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:55.281176 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:55.281134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:57.924363 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:57.924263    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:58.013008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:58.012972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:58.808325 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:58.808280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:45:59.683409 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:45:59.683353    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:00.580318 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:00.580280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:00.680413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:00.680375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:00.895995 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:00.895894    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:01.055828 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.055784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:01.163801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.163699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:01.201294 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.201261    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"]
Sep 08 15:46:01.205358 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.205334    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:01.209111 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.209092    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-inf-b-a057c5\""
Sep 08 15:46:01.224493 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.224466    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"]
Sep 08 15:46:01.269400 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.269360    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad54fbc9-827c-4569-8433-8cc4580de581-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59\" (UID: \"ad54fbc9-827c-4569-8433-8cc4580de581\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:01.269608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.269420    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dkmdb\" (UniqueName: \"kubernetes.io/projected/ad54fbc9-827c-4569-8433-8cc4580de581-kube-api-access-dkmdb\") pod \"payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59\" (UID: \"ad54fbc9-827c-4569-8433-8cc4580de581\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:01.370387 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.370346    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad54fbc9-827c-4569-8433-8cc4580de581-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59\" (UID: \"ad54fbc9-827c-4569-8433-8cc4580de581\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:01.370387 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.370389    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dkmdb\" (UniqueName: \"kubernetes.io/projected/ad54fbc9-827c-4569-8433-8cc4580de581-kube-api-access-dkmdb\") pod \"payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59\" (UID: \"ad54fbc9-827c-4569-8433-8cc4580de581\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:01.371407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.371380    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad54fbc9-827c-4569-8433-8cc4580de581-plugins-config-volume\") pod \"payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59\" (UID: \"ad54fbc9-827c-4569-8433-8cc4580de581\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:01.385739 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.385709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dkmdb\" (UniqueName: \"kubernetes.io/projected/ad54fbc9-827c-4569-8433-8cc4580de581-kube-api-access-dkmdb\") pod \"payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59\" (UID: \"ad54fbc9-827c-4569-8433-8cc4580de581\") " pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:01.515677 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.515553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:01.796736 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.796702    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"]
Sep 08 15:46:01.798546 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:46:01.798515    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad54fbc9_827c_4569_8433_8cc4580de581.slice/crio-35683f1ebaf9b9331395a7a2cea9f3b177ffe34ef4b0453a66c92e7e77252e5b WatchSource:0}: Error finding container 35683f1ebaf9b9331395a7a2cea9f3b177ffe34ef4b0453a66c92e7e77252e5b: Status 404 returned error can't find the container with id 35683f1ebaf9b9331395a7a2cea9f3b177ffe34ef4b0453a66c92e7e77252e5b
Sep 08 15:46:01.854818 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:01.854775    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:02.096870 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:02.096811    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59" event={"ID":"ad54fbc9-827c-4569-8433-8cc4580de581","Type":"ContainerStarted","Data":"d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8"}
Sep 08 15:46:02.097283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:02.096933    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:02.097283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:02.096977    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59" event={"ID":"ad54fbc9-827c-4569-8433-8cc4580de581","Type":"ContainerStarted","Data":"35683f1ebaf9b9331395a7a2cea9f3b177ffe34ef4b0453a66c92e7e77252e5b"}
Sep 08 15:46:02.115648 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:02.115592    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59" podStartSLOduration=1.115578061 podStartE2EDuration="1.115578061s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:02.112750048 +0000 UTC m=+822.473292814" watchObservedRunningTime="2026-09-08 15:46:02.115578061 +0000 UTC m=+822.476120825"
Sep 08 15:46:02.574885 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:02.574847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:04.468195 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:04.468161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:05.130360 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.130324    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:46:05.183917 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.183880    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"]
Sep 08 15:46:05.184364 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.184328    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z" podUID="53a47a05-f0ee-4b18-ae58-0a7bac559691" containerName="maas-api" containerID="cri-o://fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f" gracePeriod=30
Sep 08 15:46:05.226615 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.226581    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:05.246709 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.246673    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"]
Sep 08 15:46:05.246948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.246923    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps" podUID="1a1b2131-07dc-4870-8f94-6b61d60025d0" containerName="payload-processing" containerID="cri-o://451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4" gracePeriod=30
Sep 08 15:46:05.253872 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.253832    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"]
Sep 08 15:46:05.254193 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.254162    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8" podUID="1ffb6be2-7061-4533-8893-9bebb0a4cf95" containerName="payload-pre-processing" containerID="cri-o://2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf" gracePeriod=30
Sep 08 15:46:05.295043 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.295006    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:05.423247 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.423162    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:05.547703 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.547677    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:46:05.562632 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.562568    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:05.567110 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.567021    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:46:05.595117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.595032    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:46:05.613751 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.612884    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69xt5\" (UniqueName: \"kubernetes.io/projected/1a1b2131-07dc-4870-8f94-6b61d60025d0-kube-api-access-69xt5\") pod \"1a1b2131-07dc-4870-8f94-6b61d60025d0\" (UID: \"1a1b2131-07dc-4870-8f94-6b61d60025d0\") "
Sep 08 15:46:05.613751 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.613047    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a1b2131-07dc-4870-8f94-6b61d60025d0-plugins-config-volume\") pod \"1a1b2131-07dc-4870-8f94-6b61d60025d0\" (UID: \"1a1b2131-07dc-4870-8f94-6b61d60025d0\") "
Sep 08 15:46:05.613751 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.613697    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a1b2131-07dc-4870-8f94-6b61d60025d0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1a1b2131-07dc-4870-8f94-6b61d60025d0" (UID: "1a1b2131-07dc-4870-8f94-6b61d60025d0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:05.615947 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.615924    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a1b2131-07dc-4870-8f94-6b61d60025d0-kube-api-access-69xt5" (OuterVolumeSpecName: "kube-api-access-69xt5") pod "1a1b2131-07dc-4870-8f94-6b61d60025d0" (UID: "1a1b2131-07dc-4870-8f94-6b61d60025d0"). InnerVolumeSpecName "kube-api-access-69xt5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:46:05.660023 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.659982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:05.714421 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.714328    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47a05-f0ee-4b18-ae58-0a7bac559691-openshift-service-ca\") pod \"53a47a05-f0ee-4b18-ae58-0a7bac559691\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") "
Sep 08 15:46:05.714421 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.714401    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls\") pod \"53a47a05-f0ee-4b18-ae58-0a7bac559691\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") "
Sep 08 15:46:05.714666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.714471    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-metrics-certs\") pod \"53a47a05-f0ee-4b18-ae58-0a7bac559691\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") "
Sep 08 15:46:05.714666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.714498    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8mx72\" (UniqueName: \"kubernetes.io/projected/1ffb6be2-7061-4533-8893-9bebb0a4cf95-kube-api-access-8mx72\") pod \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\" (UID: \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\") "
Sep 08 15:46:05.714666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.714524    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgsx4\" (UniqueName: \"kubernetes.io/projected/53a47a05-f0ee-4b18-ae58-0a7bac559691-kube-api-access-tgsx4\") pod \"53a47a05-f0ee-4b18-ae58-0a7bac559691\" (UID: \"53a47a05-f0ee-4b18-ae58-0a7bac559691\") "
Sep 08 15:46:05.714666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.714593    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ffb6be2-7061-4533-8893-9bebb0a4cf95-plugins-config-volume\") pod \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\" (UID: \"1ffb6be2-7061-4533-8893-9bebb0a4cf95\") "
Sep 08 15:46:05.714877 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.714666    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/53a47a05-f0ee-4b18-ae58-0a7bac559691-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "53a47a05-f0ee-4b18-ae58-0a7bac559691" (UID: "53a47a05-f0ee-4b18-ae58-0a7bac559691"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:05.715093 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.715042    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffb6be2-7061-4533-8893-9bebb0a4cf95-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "1ffb6be2-7061-4533-8893-9bebb0a4cf95" (UID: "1ffb6be2-7061-4533-8893-9bebb0a4cf95"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:05.715288 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.715261    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69xt5\" (UniqueName: \"kubernetes.io/projected/1a1b2131-07dc-4870-8f94-6b61d60025d0-kube-api-access-69xt5\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:05.715288 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.715290    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1ffb6be2-7061-4533-8893-9bebb0a4cf95-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:05.715474 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.715304    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/53a47a05-f0ee-4b18-ae58-0a7bac559691-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:05.715474 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.715317    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1a1b2131-07dc-4870-8f94-6b61d60025d0-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:05.716830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.716802    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "53a47a05-f0ee-4b18-ae58-0a7bac559691" (UID: "53a47a05-f0ee-4b18-ae58-0a7bac559691"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:46:05.717244 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.717223    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "53a47a05-f0ee-4b18-ae58-0a7bac559691" (UID: "53a47a05-f0ee-4b18-ae58-0a7bac559691"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:46:05.717324 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.717235    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffb6be2-7061-4533-8893-9bebb0a4cf95-kube-api-access-8mx72" (OuterVolumeSpecName: "kube-api-access-8mx72") pod "1ffb6be2-7061-4533-8893-9bebb0a4cf95" (UID: "1ffb6be2-7061-4533-8893-9bebb0a4cf95"). InnerVolumeSpecName "kube-api-access-8mx72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:46:05.717324 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.717242    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/53a47a05-f0ee-4b18-ae58-0a7bac559691-kube-api-access-tgsx4" (OuterVolumeSpecName: "kube-api-access-tgsx4") pod "53a47a05-f0ee-4b18-ae58-0a7bac559691" (UID: "53a47a05-f0ee-4b18-ae58-0a7bac559691"). InnerVolumeSpecName "kube-api-access-tgsx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:46:05.816329 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.816283    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:05.816329 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.816314    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8mx72\" (UniqueName: \"kubernetes.io/projected/1ffb6be2-7061-4533-8893-9bebb0a4cf95-kube-api-access-8mx72\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:05.816329 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.816325    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgsx4\" (UniqueName: \"kubernetes.io/projected/53a47a05-f0ee-4b18-ae58-0a7bac559691-kube-api-access-tgsx4\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:05.816329 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:05.816334    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/53a47a05-f0ee-4b18-ae58-0a7bac559691-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:06.126406 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.126365    2579 generic.go:356] "Generic (PLEG): container finished" podID="53a47a05-f0ee-4b18-ae58-0a7bac559691" containerID="fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f" exitCode=0
Sep 08 15:46:06.126604 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.126434    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"
Sep 08 15:46:06.126604 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.126449    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z" event={"ID":"53a47a05-f0ee-4b18-ae58-0a7bac559691","Type":"ContainerDied","Data":"fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f"}
Sep 08 15:46:06.126604 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.126504    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z" event={"ID":"53a47a05-f0ee-4b18-ae58-0a7bac559691","Type":"ContainerDied","Data":"6fa90f19b51d491e159d8e0843b57f2f4bd0c2aef1b5e9f933530e16c38238ae"}
Sep 08 15:46:06.126604 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.126533    2579 scope.go:117] "RemoveContainer" containerID="fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f"
Sep 08 15:46:06.128567 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.128540    2579 generic.go:356] "Generic (PLEG): container finished" podID="1a1b2131-07dc-4870-8f94-6b61d60025d0" containerID="451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4" exitCode=0
Sep 08 15:46:06.128781 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.128608    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"
Sep 08 15:46:06.129258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.128640    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps" event={"ID":"1a1b2131-07dc-4870-8f94-6b61d60025d0","Type":"ContainerDied","Data":"451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4"}
Sep 08 15:46:06.129258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.129227    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps" event={"ID":"1a1b2131-07dc-4870-8f94-6b61d60025d0","Type":"ContainerDied","Data":"5220e7ab48722c9bb8c2ebd57c8ca6b1aa40964af5c0654a6c4ad8c4e52f51a7"}
Sep 08 15:46:06.133702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.133673    2579 generic.go:356] "Generic (PLEG): container finished" podID="1ffb6be2-7061-4533-8893-9bebb0a4cf95" containerID="2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf" exitCode=0
Sep 08 15:46:06.133806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.133718    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8" event={"ID":"1ffb6be2-7061-4533-8893-9bebb0a4cf95","Type":"ContainerDied","Data":"2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf"}
Sep 08 15:46:06.133806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.133737    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"
Sep 08 15:46:06.133806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.133754    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8" event={"ID":"1ffb6be2-7061-4533-8893-9bebb0a4cf95","Type":"ContainerDied","Data":"76274099ec0a957cffc0caa20f2d33bc342b698546d5675c8eb99ac261cc78a6"}
Sep 08 15:46:06.137137 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.136871    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:06.148138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.148115    2579 scope.go:117] "RemoveContainer" containerID="fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f"
Sep 08 15:46:06.148629 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:46:06.148599    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f\": container with ID starting with fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f not found: ID does not exist" containerID="fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f"
Sep 08 15:46:06.148743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.148642    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f"} err="failed to get container status \"fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f\": rpc error: code = NotFound desc = could not find container \"fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f\": container with ID starting with fd4e9d57fc923dfa49e2ed7759efeb9ecfdfd348407fa607a3ee6a6432f80c2f not found: ID does not exist"
Sep 08 15:46:06.148743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.148668    2579 scope.go:117] "RemoveContainer" containerID="451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4"
Sep 08 15:46:06.157749 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.157729    2579 scope.go:117] "RemoveContainer" containerID="451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4"
Sep 08 15:46:06.158117 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:46:06.158093    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4\": container with ID starting with 451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4 not found: ID does not exist" containerID="451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4"
Sep 08 15:46:06.158205 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.158127    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4"} err="failed to get container status \"451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4\": rpc error: code = NotFound desc = could not find container \"451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4\": container with ID starting with 451d90b5bb81670466bd66354e166d1bad5b87606cd1f05a1d4c325b26b73fa4 not found: ID does not exist"
Sep 08 15:46:06.158205 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.158151    2579 scope.go:117] "RemoveContainer" containerID="2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf"
Sep 08 15:46:06.166696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.166675    2579 scope.go:117] "RemoveContainer" containerID="2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf"
Sep 08 15:46:06.167001 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:46:06.166946    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf\": container with ID starting with 2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf not found: ID does not exist" containerID="2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf"
Sep 08 15:46:06.167064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.167013    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf"} err="failed to get container status \"2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf\": rpc error: code = NotFound desc = could not find container \"2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf\": container with ID starting with 2906c7c971d01703dbb9c15a22e9a9945b75f49cae7a543ab964e3b9870d82bf not found: ID does not exist"
Sep 08 15:46:06.195178 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.195148    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"]
Sep 08 15:46:06.203450 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.203423    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-f1f0ac73-68cf85d9c-6w9ps"]
Sep 08 15:46:06.227679 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.227646    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"]
Sep 08 15:46:06.240365 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.240328    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ait-f1f0ac73-797485c498-kpzd8"]
Sep 08 15:46:06.282739 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.282696    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"]
Sep 08 15:46:06.297497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.297462    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ait-f1f0ac73-5477cb5d5b-52v6z"]
Sep 08 15:46:06.337479 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.337447    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:06.516356 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.516252    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:06.689829 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.689794    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"]
Sep 08 15:46:06.690251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690205    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a1b2131-07dc-4870-8f94-6b61d60025d0" containerName="payload-processing"
Sep 08 15:46:06.690251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690219    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a1b2131-07dc-4870-8f94-6b61d60025d0" containerName="payload-processing"
Sep 08 15:46:06.690251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690238    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffb6be2-7061-4533-8893-9bebb0a4cf95" containerName="payload-pre-processing"
Sep 08 15:46:06.690251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690243    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffb6be2-7061-4533-8893-9bebb0a4cf95" containerName="payload-pre-processing"
Sep 08 15:46:06.690251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690251    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="53a47a05-f0ee-4b18-ae58-0a7bac559691" containerName="maas-api"
Sep 08 15:46:06.690251 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690256    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="53a47a05-f0ee-4b18-ae58-0a7bac559691" containerName="maas-api"
Sep 08 15:46:06.690479 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690315    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ffb6be2-7061-4533-8893-9bebb0a4cf95" containerName="payload-pre-processing"
Sep 08 15:46:06.690479 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690323    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="53a47a05-f0ee-4b18-ae58-0a7bac559691" containerName="maas-api"
Sep 08 15:46:06.690479 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.690331    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a1b2131-07dc-4870-8f94-6b61d60025d0" containerName="payload-processing"
Sep 08 15:46:06.695089 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.695064    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.698088 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.698063    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-13162f1c-gw-openshift-default-dockercfg-kdqlz\""
Sep 08 15:46:06.698228 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.698070    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:46:06.707457 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.707432    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"]
Sep 08 15:46:06.728041 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.727995    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:06.828035 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.827990    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-credential-socket\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828245 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828050    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40b92af-7551-4d0b-b191-0e3076ad9df1-istiod-ca-cert\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828245 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828082    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-certs\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828245 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828107    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-envoy\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828245 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828126    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-token\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828245 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828145    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-socket\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828245 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828166    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spz9h\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-kube-api-access-spz9h\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828510 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828280    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-data\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828510 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828323    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-podinfo\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.828936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.828884    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:06.929637 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.929592    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spz9h\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-kube-api-access-spz9h\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.929796 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.929670    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-data\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.929796 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.929721    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-podinfo\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.929934 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.929807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-credential-socket\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930013 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.929930    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40b92af-7551-4d0b-b191-0e3076ad9df1-istiod-ca-cert\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930068 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930013    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-certs\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930123 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930064    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-envoy\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930123 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930090    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-token\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930235 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-socket\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930235 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930199    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-data\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930474 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930448    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-socket\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930582 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-credential-socket\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930680 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930659    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-certs\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.930737 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.930675    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40b92af-7551-4d0b-b191-0e3076ad9df1-istiod-ca-cert\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.932403 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.932379    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-envoy\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.932495 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.932477    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-podinfo\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.939379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.939340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-token\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:06.939465 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:06.939439    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spz9h\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-kube-api-access-spz9h\") pod \"e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") " pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:07.006190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:07.006157    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:07.282211 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:07.282066    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"]
Sep 08 15:46:07.284618 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:46:07.284578    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode40b92af_7551_4d0b_b191_0e3076ad9df1.slice/crio-3017810376fbd9b163233f2de93f3ccf5fc48bf2c443c9e94198c4e9e30ed228 WatchSource:0}: Error finding container 3017810376fbd9b163233f2de93f3ccf5fc48bf2c443c9e94198c4e9e30ed228: Status 404 returned error can't find the container with id 3017810376fbd9b163233f2de93f3ccf5fc48bf2c443c9e94198c4e9e30ed228
Sep 08 15:46:08.117603 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:08.117567    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a1b2131-07dc-4870-8f94-6b61d60025d0" path="/var/lib/kubelet/pods/1a1b2131-07dc-4870-8f94-6b61d60025d0/volumes"
Sep 08 15:46:08.117998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:08.117914    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ffb6be2-7061-4533-8893-9bebb0a4cf95" path="/var/lib/kubelet/pods/1ffb6be2-7061-4533-8893-9bebb0a4cf95/volumes"
Sep 08 15:46:08.118298 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:08.118283    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="53a47a05-f0ee-4b18-ae58-0a7bac559691" path="/var/lib/kubelet/pods/53a47a05-f0ee-4b18-ae58-0a7bac559691/volumes"
Sep 08 15:46:08.149125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:08.149090    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" event={"ID":"e40b92af-7551-4d0b-b191-0e3076ad9df1","Type":"ContainerStarted","Data":"3017810376fbd9b163233f2de93f3ccf5fc48bf2c443c9e94198c4e9e30ed228"}
Sep 08 15:46:10.424003 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:10.423937    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:10.424403 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:10.424061    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:10.424403 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:10.424103    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:10.902529 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:10.902486    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:11.168353 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:11.168253    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" event={"ID":"e40b92af-7551-4d0b-b191-0e3076ad9df1","Type":"ContainerStarted","Data":"34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6"}
Sep 08 15:46:11.192610 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:11.192557    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" podStartSLOduration=2.056046361 podStartE2EDuration="5.192541385s" totalImagesPullingTime="3.136495024s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:11.190384474 +0000 UTC m=+831.550927243" watchObservedRunningTime="2026-09-08 15:46:11.192541385 +0000 UTC m=+831.553084151"
Sep 08 15:46:12.006788 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.006748    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:12.012190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.012162    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:12.174934 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.174892    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:12.176060 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.176040    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:12.660183 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.660148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:12.759160 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.759120    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:12.851559 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.851520    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"]
Sep 08 15:46:12.855882 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.855854    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:12.858834 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.858814    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-migrate-13162f1c-serving-cert\""
Sep 08 15:46:12.869608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.869579    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"]
Sep 08 15:46:12.893050 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.893002    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:12.991524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.991431    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:12.993546 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.993518    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-maas-api-tls\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:12.993674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.993565    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/744ddec4-3458-44f1-8742-82f679f22b66-openshift-service-ca\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:12.993674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.993628    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-metrics-certs\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:12.993674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:12.993660    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzp7n\" (UniqueName: \"kubernetes.io/projected/744ddec4-3458-44f1-8742-82f679f22b66-kube-api-access-nzp7n\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.094792 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.094748    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-metrics-certs\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.094792 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.094795    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzp7n\" (UniqueName: \"kubernetes.io/projected/744ddec4-3458-44f1-8742-82f679f22b66-kube-api-access-nzp7n\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.095327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.094871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-maas-api-tls\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.095327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.094891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/744ddec4-3458-44f1-8742-82f679f22b66-openshift-service-ca\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.095659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.095638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/744ddec4-3458-44f1-8742-82f679f22b66-openshift-service-ca\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.097427 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.097403    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-metrics-certs\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.097528 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.097428    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-maas-api-tls\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.104259 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.104236    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzp7n\" (UniqueName: \"kubernetes.io/projected/744ddec4-3458-44f1-8742-82f679f22b66-kube-api-access-nzp7n\") pod \"maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") " pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.105362 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.105338    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:46:13.167074 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.167038    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:13.391066 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.391027    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:13.449639 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.449612    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"]
Sep 08 15:46:13.450841 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:46:13.450810    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod744ddec4_3458_44f1_8742_82f679f22b66.slice/crio-e43e3c82e74b71cfc4ce1a1a8bc51f8c2d6868ce1b885a83a60d1a91711c3963 WatchSource:0}: Error finding container e43e3c82e74b71cfc4ce1a1a8bc51f8c2d6868ce1b885a83a60d1a91711c3963: Status 404 returned error can't find the container with id e43e3c82e74b71cfc4ce1a1a8bc51f8c2d6868ce1b885a83a60d1a91711c3963
Sep 08 15:46:13.473555 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.473516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:13.512753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.512719    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"]
Sep 08 15:46:13.517737 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.517714    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:13.520278 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.520256    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-migrate-13162f1c-dockercfg-mw8rp\""
Sep 08 15:46:13.520405 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.520305    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-migrate-13162f1c\""
Sep 08 15:46:13.527724 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.527694    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"]
Sep 08 15:46:13.601161 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.601121    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgjtl\" (UniqueName: \"kubernetes.io/projected/ad9c266f-cef8-4a2f-81d0-58a025f41e36-kube-api-access-hgjtl\") pod \"payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d\" (UID: \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\") " pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:13.601413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.601197    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad9c266f-cef8-4a2f-81d0-58a025f41e36-plugins-config-volume\") pod \"payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d\" (UID: \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\") " pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:13.702442 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.702356    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgjtl\" (UniqueName: \"kubernetes.io/projected/ad9c266f-cef8-4a2f-81d0-58a025f41e36-kube-api-access-hgjtl\") pod \"payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d\" (UID: \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\") " pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:13.702442 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.702404    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad9c266f-cef8-4a2f-81d0-58a025f41e36-plugins-config-volume\") pod \"payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d\" (UID: \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\") " pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:13.703057 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.703039    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad9c266f-cef8-4a2f-81d0-58a025f41e36-plugins-config-volume\") pod \"payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d\" (UID: \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\") " pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:13.710624 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.710601    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgjtl\" (UniqueName: \"kubernetes.io/projected/ad9c266f-cef8-4a2f-81d0-58a025f41e36-kube-api-access-hgjtl\") pod \"payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d\" (UID: \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\") " pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:13.830802 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.830762    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:13.916861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:13.916803    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:14.121369 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:14.121343    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"]
Sep 08 15:46:14.122413 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:46:14.122388    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad9c266f_cef8_4a2f_81d0_58a025f41e36.slice/crio-1a7c3ff646837d2c4a2f613a16f3c3c88fdf40f586d142d6727aa5d20f5ed1e4 WatchSource:0}: Error finding container 1a7c3ff646837d2c4a2f613a16f3c3c88fdf40f586d142d6727aa5d20f5ed1e4: Status 404 returned error can't find the container with id 1a7c3ff646837d2c4a2f613a16f3c3c88fdf40f586d142d6727aa5d20f5ed1e4
Sep 08 15:46:14.191112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:14.191078    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d" event={"ID":"ad9c266f-cef8-4a2f-81d0-58a025f41e36","Type":"ContainerStarted","Data":"1a7c3ff646837d2c4a2f613a16f3c3c88fdf40f586d142d6727aa5d20f5ed1e4"}
Sep 08 15:46:14.192642 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:14.192616    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9" event={"ID":"744ddec4-3458-44f1-8742-82f679f22b66","Type":"ContainerStarted","Data":"e43e3c82e74b71cfc4ce1a1a8bc51f8c2d6868ce1b885a83a60d1a91711c3963"}
Sep 08 15:46:15.200069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:15.200036    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d" event={"ID":"ad9c266f-cef8-4a2f-81d0-58a025f41e36","Type":"ContainerStarted","Data":"edf83511aae21f2d4084b616afea41c2d06110f926cc04f53461b305e86795a5"}
Sep 08 15:46:15.200539 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:15.200110    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:15.201656 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:15.201631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9" event={"ID":"744ddec4-3458-44f1-8742-82f679f22b66","Type":"ContainerStarted","Data":"7153325e4fc4a62b11d9e3c4bfcac69da06be895059425a650cb62abfc669d1b"}
Sep 08 15:46:15.201786 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:15.201683    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:15.220590 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:15.220540    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d" podStartSLOduration=2.220523677 podStartE2EDuration="2.220523677s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:15.218086329 +0000 UTC m=+835.578629093" watchObservedRunningTime="2026-09-08 15:46:15.220523677 +0000 UTC m=+835.581066441"
Sep 08 15:46:15.235521 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:15.235464    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9" podStartSLOduration=1.601936554 podStartE2EDuration="3.235446194s" totalImagesPullingTime="1.63350964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:15.233809048 +0000 UTC m=+835.594351813" watchObservedRunningTime="2026-09-08 15:46:15.235446194 +0000 UTC m=+835.595989012"
Sep 08 15:46:21.213722 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:21.213690    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:21.774242 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:21.774204    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:21.836521 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:21.836484    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:46:22.921515 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:22.921478    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:26.209935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:26.209902    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:33.345720 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:33.345680    2579 generic.go:356] "Generic (PLEG): container finished" podID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerID="34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6" exitCode=0
Sep 08 15:46:33.346156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:33.345732    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" event={"ID":"e40b92af-7551-4d0b-b191-0e3076ad9df1","Type":"ContainerDied","Data":"34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6"}
Sep 08 15:46:33.346207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:33.346155    2579 scope.go:117] "RemoveContainer" containerID="34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6"
Sep 08 15:46:33.347284 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:33.347251    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:33.347361 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:33.347326    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:33.347402 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:33.347358    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:33.871380 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:33.871341    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:34.354018 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:34.353982    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" event={"ID":"e40b92af-7551-4d0b-b191-0e3076ad9df1","Type":"ContainerStarted","Data":"28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae"}
Sep 08 15:46:35.006847 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:35.006804    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:35.007082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:35.007006    2579 patch_prober.go:28] interesting pod/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:46:35.007082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:35.007053    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 15:46:36.007443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:36.007409    2579 patch_prober.go:28] interesting pod/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:46:36.007910 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:36.007885    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 15:46:36.141447 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:36.141406    2579 pod_container_manager_linux.go:217] "Failed to delete cgroup paths" cgroupName=["kubepods","burstable","pod53a47a05-f0ee-4b18-ae58-0a7bac559691"] err="unable to destroy cgroup paths for cgroup [kubepods burstable pod53a47a05-f0ee-4b18-ae58-0a7bac559691] : Timed out while waiting for systemd to remove kubepods-burstable-pod53a47a05_f0ee_4b18_ae58_0a7bac559691.slice"
Sep 08 15:46:37.007211 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:37.007170    2579 patch_prober.go:28] interesting pod/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:46:37.007398 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:37.007231    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 15:46:38.006899 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:38.006852    2579 patch_prober.go:28] interesting pod/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:46:38.007343 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:38.006947    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 15:46:39.006865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:39.006818    2579 patch_prober.go:28] interesting pod/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body=
Sep 08 15:46:39.007112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:39.006889    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused"
Sep 08 15:46:40.010854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:40.010819    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:40.011277 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:40.011187    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:40.011830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:40.011811    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:44.149867 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.149832    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"]
Sep 08 15:46:44.150370 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.150257    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9" podUID="744ddec4-3458-44f1-8742-82f679f22b66" containerName="maas-api" containerID="cri-o://7153325e4fc4a62b11d9e3c4bfcac69da06be895059425a650cb62abfc669d1b" gracePeriod=30
Sep 08 15:46:44.178383 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.178351    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:44.202804 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.202760    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"]
Sep 08 15:46:44.203203 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.203169    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d" podUID="ad9c266f-cef8-4a2f-81d0-58a025f41e36" containerName="payload-processing" containerID="cri-o://edf83511aae21f2d4084b616afea41c2d06110f926cc04f53461b305e86795a5" gracePeriod=30
Sep 08 15:46:44.278343 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.278287    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:44.350456 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.350417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:44.411379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.411277    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:44.423494 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.423457    2579 generic.go:356] "Generic (PLEG): container finished" podID="ad9c266f-cef8-4a2f-81d0-58a025f41e36" containerID="edf83511aae21f2d4084b616afea41c2d06110f926cc04f53461b305e86795a5" exitCode=0
Sep 08 15:46:44.423698 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.423493    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d" event={"ID":"ad9c266f-cef8-4a2f-81d0-58a025f41e36","Type":"ContainerDied","Data":"edf83511aae21f2d4084b616afea41c2d06110f926cc04f53461b305e86795a5"}
Sep 08 15:46:44.426354 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.426322    2579 generic.go:356] "Generic (PLEG): container finished" podID="744ddec4-3458-44f1-8742-82f679f22b66" containerID="7153325e4fc4a62b11d9e3c4bfcac69da06be895059425a650cb62abfc669d1b" exitCode=0
Sep 08 15:46:44.426473 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.426393    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9" event={"ID":"744ddec4-3458-44f1-8742-82f679f22b66","Type":"ContainerDied","Data":"7153325e4fc4a62b11d9e3c4bfcac69da06be895059425a650cb62abfc669d1b"}
Sep 08 15:46:44.483172 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.483138    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:44.487732 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.487704    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"]
Sep 08 15:46:44.488098 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.488075    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy" containerID="cri-o://28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae" gracePeriod=30
Sep 08 15:46:44.504152 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.504124    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:44.522028 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.521997    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:44.603035 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.602995    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-metrics-certs\") pod \"744ddec4-3458-44f1-8742-82f679f22b66\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") "
Sep 08 15:46:44.603207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.603052    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/744ddec4-3458-44f1-8742-82f679f22b66-openshift-service-ca\") pod \"744ddec4-3458-44f1-8742-82f679f22b66\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") "
Sep 08 15:46:44.603207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.603106    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hgjtl\" (UniqueName: \"kubernetes.io/projected/ad9c266f-cef8-4a2f-81d0-58a025f41e36-kube-api-access-hgjtl\") pod \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\" (UID: \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\") "
Sep 08 15:46:44.603207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.603148    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad9c266f-cef8-4a2f-81d0-58a025f41e36-plugins-config-volume\") pod \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\" (UID: \"ad9c266f-cef8-4a2f-81d0-58a025f41e36\") "
Sep 08 15:46:44.603207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.603190    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-maas-api-tls\") pod \"744ddec4-3458-44f1-8742-82f679f22b66\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") "
Sep 08 15:46:44.603366 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.603243    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzp7n\" (UniqueName: \"kubernetes.io/projected/744ddec4-3458-44f1-8742-82f679f22b66-kube-api-access-nzp7n\") pod \"744ddec4-3458-44f1-8742-82f679f22b66\" (UID: \"744ddec4-3458-44f1-8742-82f679f22b66\") "
Sep 08 15:46:44.603726 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.603688    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad9c266f-cef8-4a2f-81d0-58a025f41e36-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad9c266f-cef8-4a2f-81d0-58a025f41e36" (UID: "ad9c266f-cef8-4a2f-81d0-58a025f41e36"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:44.603843 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.603756    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/744ddec4-3458-44f1-8742-82f679f22b66-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "744ddec4-3458-44f1-8742-82f679f22b66" (UID: "744ddec4-3458-44f1-8742-82f679f22b66"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:44.605407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.605381    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "744ddec4-3458-44f1-8742-82f679f22b66" (UID: "744ddec4-3458-44f1-8742-82f679f22b66"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:46:44.605497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.605435    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "744ddec4-3458-44f1-8742-82f679f22b66" (UID: "744ddec4-3458-44f1-8742-82f679f22b66"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:46:44.605691 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.605673    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad9c266f-cef8-4a2f-81d0-58a025f41e36-kube-api-access-hgjtl" (OuterVolumeSpecName: "kube-api-access-hgjtl") pod "ad9c266f-cef8-4a2f-81d0-58a025f41e36" (UID: "ad9c266f-cef8-4a2f-81d0-58a025f41e36"). InnerVolumeSpecName "kube-api-access-hgjtl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:46:44.605752 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.605700    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/744ddec4-3458-44f1-8742-82f679f22b66-kube-api-access-nzp7n" (OuterVolumeSpecName: "kube-api-access-nzp7n") pod "744ddec4-3458-44f1-8742-82f679f22b66" (UID: "744ddec4-3458-44f1-8742-82f679f22b66"). InnerVolumeSpecName "kube-api-access-nzp7n". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:46:44.704268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.704174    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:44.704268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.704211    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/744ddec4-3458-44f1-8742-82f679f22b66-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:44.704268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.704223    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hgjtl\" (UniqueName: \"kubernetes.io/projected/ad9c266f-cef8-4a2f-81d0-58a025f41e36-kube-api-access-hgjtl\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:44.704268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.704232    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad9c266f-cef8-4a2f-81d0-58a025f41e36-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:44.704268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.704241    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/744ddec4-3458-44f1-8742-82f679f22b66-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:44.704268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.704249    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzp7n\" (UniqueName: \"kubernetes.io/projected/744ddec4-3458-44f1-8742-82f679f22b66-kube-api-access-nzp7n\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:44.977855 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:44.977765    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:45.263741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.263658    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"]
Sep 08 15:46:45.264282 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.264266    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad9c266f-cef8-4a2f-81d0-58a025f41e36" containerName="payload-processing"
Sep 08 15:46:45.264338 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.264285    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad9c266f-cef8-4a2f-81d0-58a025f41e36" containerName="payload-processing"
Sep 08 15:46:45.264338 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.264311    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="744ddec4-3458-44f1-8742-82f679f22b66" containerName="maas-api"
Sep 08 15:46:45.264338 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.264319    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="744ddec4-3458-44f1-8742-82f679f22b66" containerName="maas-api"
Sep 08 15:46:45.264446 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.264399    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad9c266f-cef8-4a2f-81d0-58a025f41e36" containerName="payload-processing"
Sep 08 15:46:45.264446 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.264412    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="744ddec4-3458-44f1-8742-82f679f22b66" containerName="maas-api"
Sep 08 15:46:45.268261 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.268234    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.270906 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.270880    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ddd2c784-openshift-default-dockercfg-8j9p8\""
Sep 08 15:46:45.276886 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.276857    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"]
Sep 08 15:46:45.294623 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.294583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:45.393248 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.393211    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:45.411487 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411441    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-token\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.411661 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411502    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-socket\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.411661 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411542    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-podinfo\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.411661 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411610    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-certs\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.411661 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411645    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-credential-socket\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.411800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411669    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-data\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.411800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411741    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpq2p\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-kube-api-access-hpq2p\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.411800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411790    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fef9aac-af78-4e73-a07e-3180ad5a877f-istiod-ca-cert\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.411892 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.411868    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-envoy\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.434570 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.434540    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"
Sep 08 15:46:45.434570 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.434563    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d" event={"ID":"ad9c266f-cef8-4a2f-81d0-58a025f41e36","Type":"ContainerDied","Data":"1a7c3ff646837d2c4a2f613a16f3c3c88fdf40f586d142d6727aa5d20f5ed1e4"}
Sep 08 15:46:45.434839 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.434629    2579 scope.go:117] "RemoveContainer" containerID="edf83511aae21f2d4084b616afea41c2d06110f926cc04f53461b305e86795a5"
Sep 08 15:46:45.436088 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.436066    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9" event={"ID":"744ddec4-3458-44f1-8742-82f679f22b66","Type":"ContainerDied","Data":"e43e3c82e74b71cfc4ce1a1a8bc51f8c2d6868ce1b885a83a60d1a91711c3963"}
Sep 08 15:46:45.436180 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.436099    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"
Sep 08 15:46:45.445476 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.445457    2579 scope.go:117] "RemoveContainer" containerID="7153325e4fc4a62b11d9e3c4bfcac69da06be895059425a650cb62abfc669d1b"
Sep 08 15:46:45.460897 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.460868    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"]
Sep 08 15:46:45.470409 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.470385    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-migrate-13162f1c-64c7bdc945-ktgk9"]
Sep 08 15:46:45.480647 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.480620    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"]
Sep 08 15:46:45.482912 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.482891    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-migrate-13162f1c-5f56947dcd-gbj2d"]
Sep 08 15:46:45.512740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.512707    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-token\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.512890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.512747    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-socket\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.512890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.512770    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-podinfo\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.512890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.512796    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-certs\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.512890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.512824    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-credential-socket\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.512890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.512852    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-data\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.513181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.512891    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpq2p\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-kube-api-access-hpq2p\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.513181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.513022    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fef9aac-af78-4e73-a07e-3180ad5a877f-istiod-ca-cert\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.513181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.513144    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-envoy\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.513320 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.513286    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-certs\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.513401 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.513386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-socket\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.513439 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.513394    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-data\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.513506 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.513484    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-credential-socket\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.513820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.513758    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fef9aac-af78-4e73-a07e-3180ad5a877f-istiod-ca-cert\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.515356 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.515329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-envoy\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.515558 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.515540    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-podinfo\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.521470 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.521445    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-token\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.522225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.522205    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpq2p\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-kube-api-access-hpq2p\") pod \"e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") " pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.581711 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.581670    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:45.859618 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.859582    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"]
Sep 08 15:46:45.860776 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:46:45.860752    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0fef9aac_af78_4e73_a07e_3180ad5a877f.slice/crio-85b248cca17891e0615eb38ddb1441f1e0b5b554f34e7c2d11fcce90227e9e0f WatchSource:0}: Error finding container 85b248cca17891e0615eb38ddb1441f1e0b5b554f34e7c2d11fcce90227e9e0f: Status 404 returned error can't find the container with id 85b248cca17891e0615eb38ddb1441f1e0b5b554f34e7c2d11fcce90227e9e0f
Sep 08 15:46:45.863727 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.863693    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:45.863816 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.863759    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:45.863816 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:45.863787    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:46:46.116525 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:46.116426    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="744ddec4-3458-44f1-8742-82f679f22b66" path="/var/lib/kubelet/pods/744ddec4-3458-44f1-8742-82f679f22b66/volumes"
Sep 08 15:46:46.117012 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:46.116954    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad9c266f-cef8-4a2f-81d0-58a025f41e36" path="/var/lib/kubelet/pods/ad9c266f-cef8-4a2f-81d0-58a025f41e36/volumes"
Sep 08 15:46:46.444018 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:46.443903    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" event={"ID":"0fef9aac-af78-4e73-a07e-3180ad5a877f","Type":"ContainerStarted","Data":"f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa"}
Sep 08 15:46:46.444018 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:46.443988    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" event={"ID":"0fef9aac-af78-4e73-a07e-3180ad5a877f","Type":"ContainerStarted","Data":"85b248cca17891e0615eb38ddb1441f1e0b5b554f34e7c2d11fcce90227e9e0f"}
Sep 08 15:46:46.468546 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:46.468450    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" podStartSLOduration=1.4684305389999999 podStartE2EDuration="1.468430539s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:46.463781858 +0000 UTC m=+866.824324623" watchObservedRunningTime="2026-09-08 15:46:46.468430539 +0000 UTC m=+866.828973304"
Sep 08 15:46:46.581936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:46.581896    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:46.587878 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:46.587837    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:47.451809 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:47.451776    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:47.452741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:47.452721    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:46:47.821703 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:47.821608    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:47.913171 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:47.913136    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:49.049767 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.049734    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:49.107019 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.106986    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:49.459733 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.459683    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:49.579219 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.579186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:49.701574 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.701534    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:46:49.758359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.758325    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:49.813912 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.813881    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"]
Sep 08 15:46:49.814368 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.814350    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy"
Sep 08 15:46:49.814457 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.814371    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy"
Sep 08 15:46:49.814457 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.814389    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy"
Sep 08 15:46:49.814457 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.814398    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy"
Sep 08 15:46:49.814612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.814522    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy"
Sep 08 15:46:49.814612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.814535    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerName="istio-proxy"
Sep 08 15:46:49.817574 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.817553    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:49.820220 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.820195    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ait-ddd2c784-dockercfg-2hff9\""
Sep 08 15:46:49.820579 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.820565    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ait-ddd2c784\""
Sep 08 15:46:49.827227 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.827079    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"]
Sep 08 15:46:49.856473 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856443    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-credential-socket\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.856704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856481    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-envoy\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.856704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856510    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-certs\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.856704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856534    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-podinfo\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.856704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856614    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-socket\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.856704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856662    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-data\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.856704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856694    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-spz9h\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-kube-api-access-spz9h\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.857097 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856723    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40b92af-7551-4d0b-b191-0e3076ad9df1-istiod-ca-cert\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.857097 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856746    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-token\") pod \"e40b92af-7551-4d0b-b191-0e3076ad9df1\" (UID: \"e40b92af-7551-4d0b-b191-0e3076ad9df1\") "
Sep 08 15:46:49.857097 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856807    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:46:49.857097 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.856840    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:46:49.857292 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.857145    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-data" (OuterVolumeSpecName: "istio-data") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:46:49.857292 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.857181    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:49.857292 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.857192    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e40b92af-7551-4d0b-b191-0e3076ad9df1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:46:49.857292 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.857203    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:49.857504 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.857412    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:46:49.859100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.859073    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:46:49.859328 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.859309    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:46:49.859393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.859332    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-token" (OuterVolumeSpecName: "istio-token") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:46:49.859443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.859428    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-kube-api-access-spz9h" (OuterVolumeSpecName: "kube-api-access-spz9h") pod "e40b92af-7551-4d0b-b191-0e3076ad9df1" (UID: "e40b92af-7551-4d0b-b191-0e3076ad9df1"). InnerVolumeSpecName "kube-api-access-spz9h". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:46:49.958557 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958521    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7f7s\" (UniqueName: \"kubernetes.io/projected/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-kube-api-access-p7f7s\") pod \"payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp\" (UID: \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\") " pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:49.958753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-plugins-config-volume\") pod \"payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp\" (UID: \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\") " pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:49.958753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958683    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:49.958753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958694    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-spz9h\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-kube-api-access-spz9h\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:49.958753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958703    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e40b92af-7551-4d0b-b191-0e3076ad9df1-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:49.958753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958711    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:49.958753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958724    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:49.958753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958736    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e40b92af-7551-4d0b-b191-0e3076ad9df1-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:49.958753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:49.958748    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e40b92af-7551-4d0b-b191-0e3076ad9df1-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:46:50.060240 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.060139    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7f7s\" (UniqueName: \"kubernetes.io/projected/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-kube-api-access-p7f7s\") pod \"payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp\" (UID: \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\") " pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:50.060240 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.060211    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-plugins-config-volume\") pod \"payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp\" (UID: \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\") " pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:50.060905 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.060883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-plugins-config-volume\") pod \"payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp\" (UID: \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\") " pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:50.068430 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.068401    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7f7s\" (UniqueName: \"kubernetes.io/projected/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-kube-api-access-p7f7s\") pod \"payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp\" (UID: \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\") " pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:50.131204 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.131164    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:50.409982 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.409938    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"]
Sep 08 15:46:50.411149 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:46:50.411118    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab8eb1a0_09aa_4402_a9b9_db36e8d3f6a7.slice/crio-d9a52685df9fba609a0a35c9fe25ba868db9230d7a05546d937942694da0c697 WatchSource:0}: Error finding container d9a52685df9fba609a0a35c9fe25ba868db9230d7a05546d937942694da0c697: Status 404 returned error can't find the container with id d9a52685df9fba609a0a35c9fe25ba868db9230d7a05546d937942694da0c697
Sep 08 15:46:50.475639 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.475600    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp" event={"ID":"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7","Type":"ContainerStarted","Data":"4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd"}
Sep 08 15:46:50.475823 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.475673    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp" event={"ID":"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7","Type":"ContainerStarted","Data":"d9a52685df9fba609a0a35c9fe25ba868db9230d7a05546d937942694da0c697"}
Sep 08 15:46:50.475823 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.475734    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:46:50.477687 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.477660    2579 generic.go:356] "Generic (PLEG): container finished" podID="e40b92af-7551-4d0b-b191-0e3076ad9df1" containerID="28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae" exitCode=0
Sep 08 15:46:50.477815 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.477698    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" event={"ID":"e40b92af-7551-4d0b-b191-0e3076ad9df1","Type":"ContainerDied","Data":"28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae"}
Sep 08 15:46:50.477815 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.477719    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"
Sep 08 15:46:50.477815 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.477757    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f" event={"ID":"e40b92af-7551-4d0b-b191-0e3076ad9df1","Type":"ContainerDied","Data":"3017810376fbd9b163233f2de93f3ccf5fc48bf2c443c9e94198c4e9e30ed228"}
Sep 08 15:46:50.477815 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.477791    2579 scope.go:117] "RemoveContainer" containerID="28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae"
Sep 08 15:46:50.488524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.488506    2579 scope.go:117] "RemoveContainer" containerID="34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6"
Sep 08 15:46:50.497378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.497338    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp" podStartSLOduration=1.497324564 podStartE2EDuration="1.497324564s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:46:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:46:50.493517161 +0000 UTC m=+870.854059926" watchObservedRunningTime="2026-09-08 15:46:50.497324564 +0000 UTC m=+870.857867329"
Sep 08 15:46:50.498487 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.498464    2579 scope.go:117] "RemoveContainer" containerID="28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae"
Sep 08 15:46:50.498818 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:46:50.498793    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae\": container with ID starting with 28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae not found: ID does not exist" containerID="28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae"
Sep 08 15:46:50.498900 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.498826    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae"} err="failed to get container status \"28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae\": rpc error: code = NotFound desc = could not find container \"28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae\": container with ID starting with 28b2d0d4b2c337b52586438251be6032a5f8112579184213c6d216f2b93cc3ae not found: ID does not exist"
Sep 08 15:46:50.498900 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.498842    2579 scope.go:117] "RemoveContainer" containerID="34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6"
Sep 08 15:46:50.499152 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:46:50.499134    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6\": container with ID starting with 34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6 not found: ID does not exist" containerID="34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6"
Sep 08 15:46:50.499209 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.499157    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6"} err="failed to get container status \"34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6\": rpc error: code = NotFound desc = could not find container \"34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6\": container with ID starting with 34b43ef81c485855a8c99cda00a4b5db8a173f9ef242d47ad136cf1457cdaac6 not found: ID does not exist"
Sep 08 15:46:50.510256 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.510229    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"]
Sep 08 15:46:50.515444 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.515419    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-13162f1c-gw-openshift-default-6d9c768bdd-6df7f"]
Sep 08 15:46:50.534845 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:50.534805    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:46:52.113993 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:46:52.113942    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e40b92af-7551-4d0b-b191-0e3076ad9df1" path="/var/lib/kubelet/pods/e40b92af-7551-4d0b-b191-0e3076ad9df1/volumes"
Sep 08 15:47:01.488180 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:01.488144    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:47:08.591589 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:08.591555    2579 generic.go:356] "Generic (PLEG): container finished" podID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerID="f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa" exitCode=0
Sep 08 15:47:08.592049 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:08.591621    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" event={"ID":"0fef9aac-af78-4e73-a07e-3180ad5a877f","Type":"ContainerDied","Data":"f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa"}
Sep 08 15:47:08.592049 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:08.592046    2579 scope.go:117] "RemoveContainer" containerID="f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa"
Sep 08 15:47:08.593087 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:08.593060    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:08.593186 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:08.593124    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:08.593186 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:08.593154    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:08.635580 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:08.635534    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:47:09.603182 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:09.603148    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" event={"ID":"0fef9aac-af78-4e73-a07e-3180ad5a877f","Type":"ContainerStarted","Data":"fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978"}
Sep 08 15:47:10.582197 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:10.582148    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:47:10.582423 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:10.582333    2579 patch_prober.go:28] interesting pod/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:47:10.582423 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:10.582377    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 08 15:47:11.582727 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:11.582677    2579 patch_prober.go:28] interesting pod/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:47:11.583273 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:11.582752    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 08 15:47:12.582403 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:12.582361    2579 patch_prober.go:28] interesting pod/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:47:12.582714 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:12.582683    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 08 15:47:13.582776 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:13.582733    2579 patch_prober.go:28] interesting pod/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:47:13.583466 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:13.583429    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 08 15:47:13.847804 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:13.847707    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:14.583006 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:14.582948    2579 patch_prober.go:28] interesting pod/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused" start-of-body=
Sep 08 15:47:14.583636 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:14.583609    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.62:15021/healthz/ready\": dial tcp 10.132.0.62:15021: connect: connection refused"
Sep 08 15:47:15.586597 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:15.586561    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:47:15.587038 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:15.587019    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:47:15.587878 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:15.587856    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:47:19.584178 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.584134    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:19.610365 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.610330    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"]
Sep 08 15:47:19.610580 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.610558    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp" podUID="ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7" containerName="payload-processing" containerID="cri-o://4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd" gracePeriod=30
Sep 08 15:47:19.658332 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.658294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:19.752190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.752154    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:19.808611 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.808535    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:19.875563 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.875536    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:47:19.957588 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.957552    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-plugins-config-volume\") pod \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\" (UID: \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\") "
Sep 08 15:47:19.957792 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.957608    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7f7s\" (UniqueName: \"kubernetes.io/projected/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-kube-api-access-p7f7s\") pod \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\" (UID: \"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7\") "
Sep 08 15:47:19.957939 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.957912    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7" (UID: "ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:47:19.959851 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:19.959822    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-kube-api-access-p7f7s" (OuterVolumeSpecName: "kube-api-access-p7f7s") pod "ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7" (UID: "ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7"). InnerVolumeSpecName "kube-api-access-p7f7s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:47:20.058487 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.058429    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:20.058487 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.058463    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7f7s\" (UniqueName: \"kubernetes.io/projected/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7-kube-api-access-p7f7s\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:20.673294 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.673258    2579 generic.go:356] "Generic (PLEG): container finished" podID="ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7" containerID="4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd" exitCode=0
Sep 08 15:47:20.673743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.673317    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"
Sep 08 15:47:20.673743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.673327    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp" event={"ID":"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7","Type":"ContainerDied","Data":"4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd"}
Sep 08 15:47:20.673743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.673382    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp" event={"ID":"ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7","Type":"ContainerDied","Data":"d9a52685df9fba609a0a35c9fe25ba868db9230d7a05546d937942694da0c697"}
Sep 08 15:47:20.673743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.673406    2579 scope.go:117] "RemoveContainer" containerID="4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd"
Sep 08 15:47:20.682337 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.682318    2579 scope.go:117] "RemoveContainer" containerID="4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd"
Sep 08 15:47:20.682632 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:47:20.682610    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd\": container with ID starting with 4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd not found: ID does not exist" containerID="4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd"
Sep 08 15:47:20.682685 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.682639    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd"} err="failed to get container status \"4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd\": rpc error: code = NotFound desc = could not find container \"4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd\": container with ID starting with 4c5c147a41b1a856888dfe58cbaa11781ee9fec833b9e64acd0c9b636344f0fd not found: ID does not exist"
Sep 08 15:47:20.692886 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.692861    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"]
Sep 08 15:47:20.696718 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.696697    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ait-ddd2c784-575dbd96b7-g5llp"]
Sep 08 15:47:20.921822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.921787    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"]
Sep 08 15:47:20.922036 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.922016    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy" containerID="cri-o://fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978" gracePeriod=30
Sep 08 15:47:20.934193 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:20.934102    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:21.375522 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.375489    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:21.653291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.653192    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"]
Sep 08 15:47:21.654206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.654180    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7" containerName="payload-processing"
Sep 08 15:47:21.654206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.654208    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7" containerName="payload-processing"
Sep 08 15:47:21.654452 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.654439    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7" containerName="payload-processing"
Sep 08 15:47:21.662490 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.662464    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.665210 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.665182    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a82afc10-openshift-default-dockercfg-gf9nk\""
Sep 08 15:47:21.666631 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.666602    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"]
Sep 08 15:47:21.672269 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.672243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:21.774625 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.774580    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcda48bf-3b3f-421e-a18d-54b5df2db034-istiod-ca-cert\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.775027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.774723    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dv6tn\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-kube-api-access-dv6tn\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.775027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.774760    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-envoy\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.775027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.774781    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-podinfo\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.775027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.774857    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-certs\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.775027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.774898    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-data\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.775027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.774932    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-credential-socket\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.775027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.774950    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-token\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.775027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.775006    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-socket\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876065 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876031    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-token\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876065 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876070    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-socket\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876320 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876189    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcda48bf-3b3f-421e-a18d-54b5df2db034-istiod-ca-cert\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876320 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876289    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dv6tn\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-kube-api-access-dv6tn\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876436 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876322    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-envoy\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876436 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876354    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-podinfo\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876464    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-socket\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876599 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876548    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-certs\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876656 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876625    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-data\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876705 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-credential-socket\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876818 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876797    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-certs\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.876980 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876943    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcda48bf-3b3f-421e-a18d-54b5df2db034-istiod-ca-cert\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.877054 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.876984    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-data\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.877105 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.877060    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-credential-socket\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.878665 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.878644    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-envoy\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.878902 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.878881    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-podinfo\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.883550 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.883524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-token\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.883844 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.883823    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dv6tn\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-kube-api-access-dv6tn\") pod \"e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") " pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:21.976791 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:21.976683    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:22.114201 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.114168    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7" path="/var/lib/kubelet/pods/ab8eb1a0-09aa-4402-a9b9-db36e8d3f6a7/volumes"
Sep 08 15:47:22.255509 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.255472    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"]
Sep 08 15:47:22.256843 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:47:22.256820    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddcda48bf_3b3f_421e_a18d_54b5df2db034.slice/crio-b7079cb0aca92a6c951bf03469c2fcca941c81c1c622d25502f1526236c0ceb3 WatchSource:0}: Error finding container b7079cb0aca92a6c951bf03469c2fcca941c81c1c622d25502f1526236c0ceb3: Status 404 returned error can't find the container with id b7079cb0aca92a6c951bf03469c2fcca941c81c1c622d25502f1526236c0ceb3
Sep 08 15:47:22.259389 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.259351    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:22.259508 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.259422    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:22.259508 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.259451    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:22.260471 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.260445    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:22.688130 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.688093    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" event={"ID":"dcda48bf-3b3f-421e-a18d-54b5df2db034","Type":"ContainerStarted","Data":"7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce"}
Sep 08 15:47:22.688308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.688147    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" event={"ID":"dcda48bf-3b3f-421e-a18d-54b5df2db034","Type":"ContainerStarted","Data":"b7079cb0aca92a6c951bf03469c2fcca941c81c1c622d25502f1526236c0ceb3"}
Sep 08 15:47:22.710684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.710625    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" podStartSLOduration=1.710603098 podStartE2EDuration="1.710603098s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:47:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:47:22.708816623 +0000 UTC m=+903.069359388" watchObservedRunningTime="2026-09-08 15:47:22.710603098 +0000 UTC m=+903.071145868"
Sep 08 15:47:22.977496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:22.977400    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:23.983359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:23.983319    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:24.046813 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:24.046772    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:24.143625 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:24.143577    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:24.698882 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:24.698852    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:24.699949 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:24.699926    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:25.239876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.239840    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:25.340213 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.340176    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:25.702533 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.702502    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:25.797379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.797345    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:25.799249 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.799226    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"]
Sep 08 15:47:25.802895 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.802878    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:25.805352 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.805330    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-derive-a82afc10\""
Sep 08 15:47:25.805435 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.805371    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-derive-a82afc10-dockercfg-5vb89\""
Sep 08 15:47:25.813064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.813043    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"]
Sep 08 15:47:25.912096 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.912059    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq9pm\" (UniqueName: \"kubernetes.io/projected/9a1860d0-fc58-4fc9-8468-a0be61ad3738-kube-api-access-gq9pm\") pod \"payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj\" (UID: \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:25.912297 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:25.912198    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a1860d0-fc58-4fc9-8468-a0be61ad3738-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj\" (UID: \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:26.013068 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.012938    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a1860d0-fc58-4fc9-8468-a0be61ad3738-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj\" (UID: \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:26.013241 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.013084    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq9pm\" (UniqueName: \"kubernetes.io/projected/9a1860d0-fc58-4fc9-8468-a0be61ad3738-kube-api-access-gq9pm\") pod \"payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj\" (UID: \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:26.013695 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.013673    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a1860d0-fc58-4fc9-8468-a0be61ad3738-plugins-config-volume\") pod \"payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj\" (UID: \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:26.021373 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.021340    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq9pm\" (UniqueName: \"kubernetes.io/projected/9a1860d0-fc58-4fc9-8468-a0be61ad3738-kube-api-access-gq9pm\") pod \"payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj\" (UID: \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\") " pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:26.115389 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.115114    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:26.189467 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.188928    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:47:26.315719 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.315625    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-podinfo\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.315719 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.315662    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fef9aac-af78-4e73-a07e-3180ad5a877f-istiod-ca-cert\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.315719 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.315684    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-envoy\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.315859    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-socket\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.315899    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hpq2p\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-kube-api-access-hpq2p\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.315932    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-certs\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.315985    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-data\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316059    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-credential-socket\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316106    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-token\") pod \"0fef9aac-af78-4e73-a07e-3180ad5a877f\" (UID: \"0fef9aac-af78-4e73-a07e-3180ad5a877f\") "
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316170    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316222    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0fef9aac-af78-4e73-a07e-3180ad5a877f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:47:26.316304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316225    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:26.316684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316407    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-data" (OuterVolumeSpecName: "istio-data") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:26.316684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316384    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:26.316684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316500    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0fef9aac-af78-4e73-a07e-3180ad5a877f-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.316684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316521    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.316684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316534    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.316684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316546    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.316684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.316559    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.317999 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.317956    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:47:26.317999 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.317978    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:47:26.318407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.318388    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-token" (OuterVolumeSpecName: "istio-token") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:47:26.318457 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.318416    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-kube-api-access-hpq2p" (OuterVolumeSpecName: "kube-api-access-hpq2p") pod "0fef9aac-af78-4e73-a07e-3180ad5a877f" (UID: "0fef9aac-af78-4e73-a07e-3180ad5a877f"). InnerVolumeSpecName "kube-api-access-hpq2p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:47:26.405712 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.405686    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"]
Sep 08 15:47:26.407556 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:47:26.407526    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9a1860d0_fc58_4fc9_8468_a0be61ad3738.slice/crio-eab11f157f6edc3bdcea5e983f71cb126487a78ca93d7898c81cdce8953ecc00 WatchSource:0}: Error finding container eab11f157f6edc3bdcea5e983f71cb126487a78ca93d7898c81cdce8953ecc00: Status 404 returned error can't find the container with id eab11f157f6edc3bdcea5e983f71cb126487a78ca93d7898c81cdce8953ecc00
Sep 08 15:47:26.417321 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.417294    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.417321 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.417317    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hpq2p\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-kube-api-access-hpq2p\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.417430 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.417326    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.417430 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.417335    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0fef9aac-af78-4e73-a07e-3180ad5a877f-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:26.713626 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.713586    2579 generic.go:356] "Generic (PLEG): container finished" podID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerID="fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978" exitCode=0
Sep 08 15:47:26.713845 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.713640    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"
Sep 08 15:47:26.713845 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.713679    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" event={"ID":"0fef9aac-af78-4e73-a07e-3180ad5a877f","Type":"ContainerDied","Data":"fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978"}
Sep 08 15:47:26.713845 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.713765    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26" event={"ID":"0fef9aac-af78-4e73-a07e-3180ad5a877f","Type":"ContainerDied","Data":"85b248cca17891e0615eb38ddb1441f1e0b5b554f34e7c2d11fcce90227e9e0f"}
Sep 08 15:47:26.713845 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.713796    2579 scope.go:117] "RemoveContainer" containerID="fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978"
Sep 08 15:47:26.715779 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.715739    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj" event={"ID":"9a1860d0-fc58-4fc9-8468-a0be61ad3738","Type":"ContainerStarted","Data":"a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e"}
Sep 08 15:47:26.715904 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.715788    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj" event={"ID":"9a1860d0-fc58-4fc9-8468-a0be61ad3738","Type":"ContainerStarted","Data":"eab11f157f6edc3bdcea5e983f71cb126487a78ca93d7898c81cdce8953ecc00"}
Sep 08 15:47:26.715904 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.715849    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:26.726064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.726046    2579 scope.go:117] "RemoveContainer" containerID="f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa"
Sep 08 15:47:26.732869 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.732817    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj" podStartSLOduration=1.732801411 podStartE2EDuration="1.732801411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:47:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:47:26.73228353 +0000 UTC m=+907.092826296" watchObservedRunningTime="2026-09-08 15:47:26.732801411 +0000 UTC m=+907.093344175"
Sep 08 15:47:26.735584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.735564    2579 scope.go:117] "RemoveContainer" containerID="fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978"
Sep 08 15:47:26.735933 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:47:26.735912    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978\": container with ID starting with fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978 not found: ID does not exist" containerID="fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978"
Sep 08 15:47:26.736016 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.735942    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978"} err="failed to get container status \"fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978\": rpc error: code = NotFound desc = could not find container \"fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978\": container with ID starting with fb04f560efd8e718d926ec13a54451609bbb41aa95e9e41fdfb34d3e5a7b6978 not found: ID does not exist"
Sep 08 15:47:26.736016 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.735973    2579 scope.go:117] "RemoveContainer" containerID="f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa"
Sep 08 15:47:26.736258 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:47:26.736238    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa\": container with ID starting with f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa not found: ID does not exist" containerID="f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa"
Sep 08 15:47:26.736308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.736268    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa"} err="failed to get container status \"f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa\": rpc error: code = NotFound desc = could not find container \"f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa\": container with ID starting with f97d3bf459f0246ca3e2a4aeac2f48dabdad9bbe1a04569735911e1cd14773fa not found: ID does not exist"
Sep 08 15:47:26.745903 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.745873    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"]
Sep 08 15:47:26.749775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:26.749743    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ddd2c784-openshift-default-864658c8b4-hvj26"]
Sep 08 15:47:27.522464 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:27.522430    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:47:28.114979 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:28.114936    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" path="/var/lib/kubelet/pods/0fef9aac-af78-4e73-a07e-3180ad5a877f/volumes"
Sep 08 15:47:37.725519 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:37.725483    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:44.826643 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:44.826602    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:47:46.848791 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:46.848754    2579 generic.go:356] "Generic (PLEG): container finished" podID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerID="7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce" exitCode=0
Sep 08 15:47:46.849347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:46.848832    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" event={"ID":"dcda48bf-3b3f-421e-a18d-54b5df2db034","Type":"ContainerDied","Data":"7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce"}
Sep 08 15:47:46.849425 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:46.849345    2579 scope.go:117] "RemoveContainer" containerID="7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce"
Sep 08 15:47:46.850423 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:46.850394    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:46.850511 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:46.850478    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:46.850553 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:46.850521    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:47:47.857327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:47.857286    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" event={"ID":"dcda48bf-3b3f-421e-a18d-54b5df2db034","Type":"ContainerStarted","Data":"f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3"}
Sep 08 15:47:47.977179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:47.977131    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:47.977651 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:47.977623    2579 patch_prober.go:28] interesting pod/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:47:47.977766 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:47.977683    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 15:47:48.978058 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:48.978011    2579 patch_prober.go:28] interesting pod/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:47:48.978564 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:48.978093    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 15:47:49.682365 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:49.682320    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:49.977993 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:49.977868    2579 patch_prober.go:28] interesting pod/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:47:49.977993 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:49.977949    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 15:47:50.504212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:50.504172    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:50.977796 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:50.977751    2579 patch_prober.go:28] interesting pod/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:47:50.978042 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:50.977839    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 15:47:51.290104 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:51.290000    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:51.977528 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:51.977483    2579 patch_prober.go:28] interesting pod/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:47:51.977845 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:51.977814    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 15:47:52.977593 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:52.977547    2579 patch_prober.go:28] interesting pod/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body=
Sep 08 15:47:52.978127 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:52.977672    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused"
Sep 08 15:47:53.982317 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:53.982280    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:53.982755 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:53.982574    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:53.983300 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:53.983281    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:47:55.367942 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:55.367908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:55.903405 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:55.903357    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:55.940313 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:55.940276    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"]
Sep 08 15:47:55.940529 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:55.940505    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj" podUID="9a1860d0-fc58-4fc9-8468-a0be61ad3738" containerName="payload-pre-processing" containerID="cri-o://a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e" gracePeriod=30
Sep 08 15:47:56.003586 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.003550    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:56.087757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.087722    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:56.157452 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.157364    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:56.203697 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.203673    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:56.227310 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.227279    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"]
Sep 08 15:47:56.257604 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.257566    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:56.335587 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.335555    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a1860d0-fc58-4fc9-8468-a0be61ad3738-plugins-config-volume\") pod \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\" (UID: \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\") "
Sep 08 15:47:56.335779 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.335635    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq9pm\" (UniqueName: \"kubernetes.io/projected/9a1860d0-fc58-4fc9-8468-a0be61ad3738-kube-api-access-gq9pm\") pod \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\" (UID: \"9a1860d0-fc58-4fc9-8468-a0be61ad3738\") "
Sep 08 15:47:56.336032 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.335997    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9a1860d0-fc58-4fc9-8468-a0be61ad3738-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9a1860d0-fc58-4fc9-8468-a0be61ad3738" (UID: "9a1860d0-fc58-4fc9-8468-a0be61ad3738"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:47:56.337887 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.337860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a1860d0-fc58-4fc9-8468-a0be61ad3738-kube-api-access-gq9pm" (OuterVolumeSpecName: "kube-api-access-gq9pm") pod "9a1860d0-fc58-4fc9-8468-a0be61ad3738" (UID: "9a1860d0-fc58-4fc9-8468-a0be61ad3738"). InnerVolumeSpecName "kube-api-access-gq9pm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:47:56.436622 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.436524    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9a1860d0-fc58-4fc9-8468-a0be61ad3738-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:56.436622 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.436554    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq9pm\" (UniqueName: \"kubernetes.io/projected/9a1860d0-fc58-4fc9-8468-a0be61ad3738-kube-api-access-gq9pm\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:47:56.925286 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.925252    2579 generic.go:356] "Generic (PLEG): container finished" podID="9a1860d0-fc58-4fc9-8468-a0be61ad3738" containerID="a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e" exitCode=0
Sep 08 15:47:56.925493 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.925296    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"
Sep 08 15:47:56.925493 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.925340    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj" event={"ID":"9a1860d0-fc58-4fc9-8468-a0be61ad3738","Type":"ContainerDied","Data":"a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e"}
Sep 08 15:47:56.925493 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.925399    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj" event={"ID":"9a1860d0-fc58-4fc9-8468-a0be61ad3738","Type":"ContainerDied","Data":"eab11f157f6edc3bdcea5e983f71cb126487a78ca93d7898c81cdce8953ecc00"}
Sep 08 15:47:56.925493 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.925429    2579 scope.go:117] "RemoveContainer" containerID="a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e"
Sep 08 15:47:56.925712 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.925632    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy" containerID="cri-o://f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3" gracePeriod=30
Sep 08 15:47:56.935876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.935840    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:56.936876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.936821    2579 scope.go:117] "RemoveContainer" containerID="a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e"
Sep 08 15:47:56.937357 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:47:56.937188    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e\": container with ID starting with a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e not found: ID does not exist" containerID="a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e"
Sep 08 15:47:56.937357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.937221    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e"} err="failed to get container status \"a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e\": rpc error: code = NotFound desc = could not find container \"a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e\": container with ID starting with a5842eaac8901f4a4fb475e85b5bfca53178242a70724db826955ac1a29cf72e not found: ID does not exist"
Sep 08 15:47:56.970020 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.969937    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"]
Sep 08 15:47:56.973029 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:56.972996    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-derive-a82afc10-f5557f8-prvtj"]
Sep 08 15:47:57.003064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:57.003028    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:57.072652 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:57.072607    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:58.114206 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:58.114167    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a1860d0-fc58-4fc9-8468-a0be61ad3738" path="/var/lib/kubelet/pods/9a1860d0-fc58-4fc9-8468-a0be61ad3738/volumes"
Sep 08 15:47:58.533589 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:58.533492    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:47:59.606710 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:47:59.606674    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:00.217923 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.217886    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:00.254078 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.254040    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"]
Sep 08 15:48:00.254361 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.254333    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2" podUID="90422702-09cc-4aab-b025-31ba35b64da0" containerName="payload-processing" containerID="cri-o://71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5" gracePeriod=30
Sep 08 15:48:00.333718 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.333682    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:00.354050 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.354019    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:48:00.418301 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.418267    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:00.511421 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.511394    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:48:00.518278 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.518227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:00.584998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.584942    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mgc8q\" (UniqueName: \"kubernetes.io/projected/90422702-09cc-4aab-b025-31ba35b64da0-kube-api-access-mgc8q\") pod \"90422702-09cc-4aab-b025-31ba35b64da0\" (UID: \"90422702-09cc-4aab-b025-31ba35b64da0\") "
Sep 08 15:48:00.585173 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.585084    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90422702-09cc-4aab-b025-31ba35b64da0-plugins-config-volume\") pod \"90422702-09cc-4aab-b025-31ba35b64da0\" (UID: \"90422702-09cc-4aab-b025-31ba35b64da0\") "
Sep 08 15:48:00.585413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.585386    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/90422702-09cc-4aab-b025-31ba35b64da0-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "90422702-09cc-4aab-b025-31ba35b64da0" (UID: "90422702-09cc-4aab-b025-31ba35b64da0"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:48:00.587045 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.587023    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/90422702-09cc-4aab-b025-31ba35b64da0-kube-api-access-mgc8q" (OuterVolumeSpecName: "kube-api-access-mgc8q") pod "90422702-09cc-4aab-b025-31ba35b64da0" (UID: "90422702-09cc-4aab-b025-31ba35b64da0"). InnerVolumeSpecName "kube-api-access-mgc8q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:48:00.686009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.685948    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mgc8q\" (UniqueName: \"kubernetes.io/projected/90422702-09cc-4aab-b025-31ba35b64da0-kube-api-access-mgc8q\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:00.686009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.685994    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/90422702-09cc-4aab-b025-31ba35b64da0-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:00.841677 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.841643    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:00.951466 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.951432    2579 generic.go:356] "Generic (PLEG): container finished" podID="90422702-09cc-4aab-b025-31ba35b64da0" containerID="71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5" exitCode=0
Sep 08 15:48:00.951650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.951475    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"
Sep 08 15:48:00.951650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.951502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2" event={"ID":"90422702-09cc-4aab-b025-31ba35b64da0","Type":"ContainerDied","Data":"71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5"}
Sep 08 15:48:00.951650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.951542    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2" event={"ID":"90422702-09cc-4aab-b025-31ba35b64da0","Type":"ContainerDied","Data":"904b48b6aca00e62767c39382de9bde0028aa5c2f9e8af8accf6e4313936e2f8"}
Sep 08 15:48:00.951650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.951563    2579 scope.go:117] "RemoveContainer" containerID="71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5"
Sep 08 15:48:00.960744 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.960723    2579 scope.go:117] "RemoveContainer" containerID="71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5"
Sep 08 15:48:00.961021 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:48:00.961002    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5\": container with ID starting with 71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5 not found: ID does not exist" containerID="71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5"
Sep 08 15:48:00.961085 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.961031    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5"} err="failed to get container status \"71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5\": rpc error: code = NotFound desc = could not find container \"71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5\": container with ID starting with 71eb2f10f101a443e022123053d49adcb86afbbe9e0552abfd242a0f37c827a5 not found: ID does not exist"
Sep 08 15:48:00.976070 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.976040    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"]
Sep 08 15:48:00.978538 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:00.978508    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-autores-36c51d-5bf86664d9-hczf2"]
Sep 08 15:48:02.114319 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.114282    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="90422702-09cc-4aab-b025-31ba35b64da0" path="/var/lib/kubelet/pods/90422702-09cc-4aab-b025-31ba35b64da0/volumes"
Sep 08 15:48:02.187070 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.187000    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:48:02.302220 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302181    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dv6tn\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-kube-api-access-dv6tn\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302237    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-credential-socket\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302274    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-certs\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302311    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-envoy\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302379 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302349    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-token\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302380    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcda48bf-3b3f-421e-a18d-54b5df2db034-istiod-ca-cert\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302436    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-podinfo\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302469    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-data\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302508    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-socket\") pod \"dcda48bf-3b3f-421e-a18d-54b5df2db034\" (UID: \"dcda48bf-3b3f-421e-a18d-54b5df2db034\") "
Sep 08 15:48:02.302835 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302627    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:02.302835 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302665    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:02.302946 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302838    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:02.302946 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302848    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-data" (OuterVolumeSpecName: "istio-data") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:02.302946 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302848    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.302946 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.302880    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.303205 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.303134    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dcda48bf-3b3f-421e-a18d-54b5df2db034-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:48:02.304607 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.304576    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:48:02.304607 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.304592    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-kube-api-access-dv6tn" (OuterVolumeSpecName: "kube-api-access-dv6tn") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "kube-api-access-dv6tn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:48:02.304607 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.304584    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-token" (OuterVolumeSpecName: "istio-token") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:48:02.304822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.304801    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dcda48bf-3b3f-421e-a18d-54b5df2db034" (UID: "dcda48bf-3b3f-421e-a18d-54b5df2db034"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:48:02.404116 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.404069    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.404116 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.404106    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.404116 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.404116    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dcda48bf-3b3f-421e-a18d-54b5df2db034-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.404116 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.404125    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.404426 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.404133    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.404426 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.404141    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dcda48bf-3b3f-421e-a18d-54b5df2db034-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.404426 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.404148    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dv6tn\" (UniqueName: \"kubernetes.io/projected/dcda48bf-3b3f-421e-a18d-54b5df2db034-kube-api-access-dv6tn\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:48:02.965513 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.965478    2579 generic.go:356] "Generic (PLEG): container finished" podID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerID="f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3" exitCode=0
Sep 08 15:48:02.965702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.965528    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"
Sep 08 15:48:02.965702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.965566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" event={"ID":"dcda48bf-3b3f-421e-a18d-54b5df2db034","Type":"ContainerDied","Data":"f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3"}
Sep 08 15:48:02.965702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.965631    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr" event={"ID":"dcda48bf-3b3f-421e-a18d-54b5df2db034","Type":"ContainerDied","Data":"b7079cb0aca92a6c951bf03469c2fcca941c81c1c622d25502f1526236c0ceb3"}
Sep 08 15:48:02.965702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.965656    2579 scope.go:117] "RemoveContainer" containerID="f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3"
Sep 08 15:48:02.976176 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.976154    2579 scope.go:117] "RemoveContainer" containerID="7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce"
Sep 08 15:48:02.985196 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.985176    2579 scope.go:117] "RemoveContainer" containerID="f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3"
Sep 08 15:48:02.985526 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:48:02.985505    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3\": container with ID starting with f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3 not found: ID does not exist" containerID="f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3"
Sep 08 15:48:02.985570 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.985535    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3"} err="failed to get container status \"f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3\": rpc error: code = NotFound desc = could not find container \"f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3\": container with ID starting with f5c6d49df9b2d879e28bd0a4f00a67ad0f31d16de3d0399d9284068f03adf9a3 not found: ID does not exist"
Sep 08 15:48:02.985570 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.985554    2579 scope.go:117] "RemoveContainer" containerID="7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce"
Sep 08 15:48:02.985814 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:48:02.985794    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce\": container with ID starting with 7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce not found: ID does not exist" containerID="7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce"
Sep 08 15:48:02.985871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.985824    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce"} err="failed to get container status \"7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce\": rpc error: code = NotFound desc = could not find container \"7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce\": container with ID starting with 7fc0d06cb74fb072155361ce32608b63bbbedec98a8304bb42bf37e39c1d49ce not found: ID does not exist"
Sep 08 15:48:02.992462 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.992436    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"]
Sep 08 15:48:02.999035 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:02.999005    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a82afc10-openshift-default-8b4cf6bc6-c8kxr"]
Sep 08 15:48:04.115082 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:04.115047    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" path="/var/lib/kubelet/pods/dcda48bf-3b3f-421e-a18d-54b5df2db034/volumes"
Sep 08 15:48:04.758864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:04.758795    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:04.858918 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:04.858874    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:05.199075 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:05.199040    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:05.921755 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:05.921721    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:11.818584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:11.818545    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:15.230897 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:15.230857    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:48:21.649549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:21.649511    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:25.191744 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:25.191689    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:26.643733 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:26.643692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:30.526830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:30.526796    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:31.127855 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:31.127816    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:33.627349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:33.627314    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:48:36.937249 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:36.937212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:39.863265 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:39.863221    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:40.872266 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:40.872230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:43.453949 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:43.453849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:43.707409 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:43.707321    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:44.194577 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.194548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:44.489448 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489360    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"]
Sep 08 15:48:44.489801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489763    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="90422702-09cc-4aab-b025-31ba35b64da0" containerName="payload-processing"
Sep 08 15:48:44.489801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489775    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="90422702-09cc-4aab-b025-31ba35b64da0" containerName="payload-processing"
Sep 08 15:48:44.489801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489791    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy"
Sep 08 15:48:44.489801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489797    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489807    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489813    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489821    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489826    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489832    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a1860d0-fc58-4fc9-8468-a0be61ad3738" containerName="payload-pre-processing"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489837    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a1860d0-fc58-4fc9-8468-a0be61ad3738" containerName="payload-pre-processing"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489845    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489851    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489912    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489919    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489924    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9a1860d0-fc58-4fc9-8468-a0be61ad3738" containerName="payload-pre-processing"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489931    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="0fef9aac-af78-4e73-a07e-3180ad5a877f" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489938    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="dcda48bf-3b3f-421e-a18d-54b5df2db034" containerName="istio-proxy"
Sep 08 15:48:44.489992 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.489944    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="90422702-09cc-4aab-b025-31ba35b64da0" containerName="payload-processing"
Sep 08 15:48:44.492857 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.492837    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.496235 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.496209    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:48:44.496349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.496291    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-explicit-bb8457-openshift-default-dockercfg-8h7dx\""
Sep 08 15:48:44.504866 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.504841    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"]
Sep 08 15:48:44.514278 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.514246    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:44.590357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590315    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-credential-socket\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.590357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590359    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxkd5\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-kube-api-access-jxkd5\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.590584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590425    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-socket\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.590584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590473    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a5df78-2c69-4508-a243-ab8358c66686-istio-podinfo\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.590584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590506    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-istio-token\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.590584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590564    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-envoy\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.590713 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590603    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a5df78-2c69-4508-a243-ab8358c66686-istiod-ca-cert\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.590713 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590684    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-data\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.590780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.590720    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-certs\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.691721 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.691675    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-credential-socket\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.691900 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.691729    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxkd5\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-kube-api-access-jxkd5\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.691900 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.691766    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-socket\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.691900 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.691826    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a5df78-2c69-4508-a243-ab8358c66686-istio-podinfo\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.691900 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.691866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-istio-token\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.691900 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.691896    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-envoy\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.692197 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.691950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a5df78-2c69-4508-a243-ab8358c66686-istiod-ca-cert\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.692197 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.692057    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-data\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.692197 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.692092    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-certs\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.692197 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.692186    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-credential-socket\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.692369 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.692231    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-socket\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.692369 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.692343    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-certs\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.692506 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.692487    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-data\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.692749 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.692731    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a5df78-2c69-4508-a243-ab8358c66686-istiod-ca-cert\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.694295 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.694264    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-envoy\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.694510 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.694473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a5df78-2c69-4508-a243-ab8358c66686-istio-podinfo\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.702681 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.702657    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxkd5\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-kube-api-access-jxkd5\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.702681 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.702671    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-istio-token\") pod \"e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") " pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:44.722940 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.722908    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:44.805262 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:44.805152    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:45.080650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:45.080619    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"]
Sep 08 15:48:45.082069 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:48:45.082040    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92a5df78_2c69_4508_a243_ab8358c66686.slice/crio-da6571319de26faedf6517b194b6ee0e9371ac9f2171be88628a9ca741f107ab WatchSource:0}: Error finding container da6571319de26faedf6517b194b6ee0e9371ac9f2171be88628a9ca741f107ab: Status 404 returned error can't find the container with id da6571319de26faedf6517b194b6ee0e9371ac9f2171be88628a9ca741f107ab
Sep 08 15:48:45.084475 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:45.084443    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:48:45.084562 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:45.084532    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:48:45.084610 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:45.084561    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:48:45.206735 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:45.206692    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" event={"ID":"92a5df78-2c69-4508-a243-ab8358c66686","Type":"ContainerStarted","Data":"bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96"}
Sep 08 15:48:45.206915 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:45.206747    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" event={"ID":"92a5df78-2c69-4508-a243-ab8358c66686","Type":"ContainerStarted","Data":"da6571319de26faedf6517b194b6ee0e9371ac9f2171be88628a9ca741f107ab"}
Sep 08 15:48:45.228263 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:45.228201    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" podStartSLOduration=1.228182921 podStartE2EDuration="1.228182921s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:48:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:45.2274312 +0000 UTC m=+985.587973966" watchObservedRunningTime="2026-09-08 15:48:45.228182921 +0000 UTC m=+985.588725686"
Sep 08 15:48:45.806124 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:45.806084    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:46.338302 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:46.338268    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:48:46.811806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:46.811709    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:47.192024 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:47.191991    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:47.216883 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:47.216847    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:47.217776 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:47.217754    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:48:47.283669 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:47.283578    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:48.379448 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:48.379420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:48.480229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:48.480193    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:48.579691 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:48.579657    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:48.864657 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:48.864616    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:49.003458 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.003425    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"]
Sep 08 15:48:49.007048 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.007021    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:49.011869 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.011843    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-explicit-bb8457\""
Sep 08 15:48:49.011869 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.011843    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-explicit-bb8457-dockercfg-cg69x\""
Sep 08 15:48:49.023001 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.022977    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"]
Sep 08 15:48:49.034811 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.034784    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:49.133871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.133777    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6f2216e-d4cc-42f0-b611-3280fa2718f4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr\" (UID: \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\") " pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:49.133871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.133832    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2mjfv\" (UniqueName: \"kubernetes.io/projected/f6f2216e-d4cc-42f0-b611-3280fa2718f4-kube-api-access-2mjfv\") pod \"payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr\" (UID: \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\") " pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:49.235298 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.235265    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6f2216e-d4cc-42f0-b611-3280fa2718f4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr\" (UID: \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\") " pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:49.235492 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.235309    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2mjfv\" (UniqueName: \"kubernetes.io/projected/f6f2216e-d4cc-42f0-b611-3280fa2718f4-kube-api-access-2mjfv\") pod \"payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr\" (UID: \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\") " pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:49.235936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.235914    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6f2216e-d4cc-42f0-b611-3280fa2718f4-plugins-config-volume\") pod \"payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr\" (UID: \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\") " pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:49.245088 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.245055    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2mjfv\" (UniqueName: \"kubernetes.io/projected/f6f2216e-d4cc-42f0-b611-3280fa2718f4-kube-api-access-2mjfv\") pod \"payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr\" (UID: \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\") " pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:49.322469 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.322431    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:49.599441 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:49.599408    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"]
Sep 08 15:48:49.601015 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:48:49.600986    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6f2216e_d4cc_42f0_b611_3280fa2718f4.slice/crio-71142839a23e9b8b6ba8abeb3a585dba1778b92d4ea7cfae473745ef3884e2ff WatchSource:0}: Error finding container 71142839a23e9b8b6ba8abeb3a585dba1778b92d4ea7cfae473745ef3884e2ff: Status 404 returned error can't find the container with id 71142839a23e9b8b6ba8abeb3a585dba1778b92d4ea7cfae473745ef3884e2ff
Sep 08 15:48:50.234744 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:50.234706    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr" event={"ID":"f6f2216e-d4cc-42f0-b611-3280fa2718f4","Type":"ContainerStarted","Data":"1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46"}
Sep 08 15:48:50.234973 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:50.234809    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr" event={"ID":"f6f2216e-d4cc-42f0-b611-3280fa2718f4","Type":"ContainerStarted","Data":"71142839a23e9b8b6ba8abeb3a585dba1778b92d4ea7cfae473745ef3884e2ff"}
Sep 08 15:48:50.234973 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:50.234876    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:48:50.253124 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:50.253070    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr" podStartSLOduration=2.253050767 podStartE2EDuration="2.253050767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:48:50.251067816 +0000 UTC m=+990.611610582" watchObservedRunningTime="2026-09-08 15:48:50.253050767 +0000 UTC m=+990.613593537"
Sep 08 15:48:53.015945 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:53.015906    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:59.101228 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:59.101194    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:59.204127 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:59.204095    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:48:59.300311 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:48:59.300276    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:01.243088 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:01.243056    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:49:08.124660 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:08.124622    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:49:08.355253 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:08.355219    2579 generic.go:356] "Generic (PLEG): container finished" podID="92a5df78-2c69-4508-a243-ab8358c66686" containerID="bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96" exitCode=0
Sep 08 15:49:08.355415 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:08.355285    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" event={"ID":"92a5df78-2c69-4508-a243-ab8358c66686","Type":"ContainerDied","Data":"bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96"}
Sep 08 15:49:08.355693 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:08.355670    2579 scope.go:117] "RemoveContainer" containerID="bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96"
Sep 08 15:49:08.356729 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:08.356699    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:08.356789 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:08.356772    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:08.356825 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:08.356808    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:09.363454 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:09.363422    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" event={"ID":"92a5df78-2c69-4508-a243-ab8358c66686","Type":"ContainerStarted","Data":"20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760"}
Sep 08 15:49:09.786765 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:09.786592    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:09.806285 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:09.806249    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:49:09.806576 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:09.806548    2579 patch_prober.go:28] interesting pod/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 15:49:09.806694 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:09.806598    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 15:49:10.606552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:10.606515    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:10.805858 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:10.805817    2579 patch_prober.go:28] interesting pod/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 15:49:10.806069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:10.805899    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 15:49:11.806459 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:11.806421    2579 patch_prober.go:28] interesting pod/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 15:49:11.806872 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:11.806504    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 15:49:12.177725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:12.177679    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:12.806230 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:12.806190    2579 patch_prober.go:28] interesting pod/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 15:49:12.806424 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:12.806268    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 15:49:13.805506 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:13.805465    2579 patch_prober.go:28] interesting pod/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body=
Sep 08 15:49:13.805880 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:13.805534    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused"
Sep 08 15:49:14.810378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:14.810346    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:49:14.810856 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:14.810711    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:49:14.811416 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:14.811396    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:49:16.309970 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:16.309940    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:16.372883 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:16.372844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:16.456704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:16.456666    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:16.561803 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:16.561710    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:16.656524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:16.656479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:17.300246 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:17.300212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:17.399659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:17.399621    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:17.500257 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:17.500224    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:18.995927 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:18.995894    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:23.236744 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:23.236711    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:49:25.237674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:25.237632    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:25.338135 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:25.338093    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:25.969341 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:25.969305    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:27.953487 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:27.953450    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:30.153181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:30.153148    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:31.822395 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:31.822361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:31.922142 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:31.922104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:32.056864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.056820    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:32.380852 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.380816    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"]
Sep 08 15:49:32.384852 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.384833    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.387516 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.387493    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-bbf4a143-openshift-default-dockercfg-wlmgn\""
Sep 08 15:49:32.396416 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.396389    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"]
Sep 08 15:49:32.404095 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.404069    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:32.441084 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441054    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hf8p\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-kube-api-access-7hf8p\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.441234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441105    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11646660-82fd-49fb-bae8-3fb899503ff8-istio-podinfo\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.441234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441122    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-istio-token\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.441234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441180    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-data\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.441234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441222    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-credential-socket\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.441374 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441242    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-certs\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.441374 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-envoy\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.441374 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441279    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11646660-82fd-49fb-bae8-3fb899503ff8-istiod-ca-cert\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.441374 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.441309    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-socket\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542122 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542081    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hf8p\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-kube-api-access-7hf8p\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542146    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11646660-82fd-49fb-bae8-3fb899503ff8-istio-podinfo\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542169    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-istio-token\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542200    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-data\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-credential-socket\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542403    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-certs\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542452    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-envoy\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542481    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11646660-82fd-49fb-bae8-3fb899503ff8-istiod-ca-cert\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542526    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-socket\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542756 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542694    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-credential-socket\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542756 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542710    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-data\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.542874 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.542849    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-certs\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.543061 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.543036    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-socket\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.543316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.543293    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11646660-82fd-49fb-bae8-3fb899503ff8-istiod-ca-cert\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.544612 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.544596    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-envoy\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.545018 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.545003    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11646660-82fd-49fb-bae8-3fb899503ff8-istio-podinfo\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.551029 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.550938    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-istio-token\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.551481 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.551455    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hf8p\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-kube-api-access-7hf8p\") pod \"e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") " pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.603189 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.603140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:32.698413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.698317    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:32.977337 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.977298    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"]
Sep 08 15:49:32.979109 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:49:32.979081    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11646660_82fd_49fb_bae8_3fb899503ff8.slice/crio-c559374ef7e237ff1a464567ba991fec5ad012578ffcd9935c319620b872a28d WatchSource:0}: Error finding container c559374ef7e237ff1a464567ba991fec5ad012578ffcd9935c319620b872a28d: Status 404 returned error can't find the container with id c559374ef7e237ff1a464567ba991fec5ad012578ffcd9935c319620b872a28d
Sep 08 15:49:32.981574 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.981539    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:32.981701 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.981603    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:32.981701 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:32.981631    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:33.514670 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:33.514633    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" event={"ID":"11646660-82fd-49fb-bae8-3fb899503ff8","Type":"ContainerStarted","Data":"292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789"}
Sep 08 15:49:33.514865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:33.514701    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" event={"ID":"11646660-82fd-49fb-bae8-3fb899503ff8","Type":"ContainerStarted","Data":"c559374ef7e237ff1a464567ba991fec5ad012578ffcd9935c319620b872a28d"}
Sep 08 15:49:33.535888 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:33.535839    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" podStartSLOduration=1.535823218 podStartE2EDuration="1.535823218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:33.534001949 +0000 UTC m=+1033.894544714" watchObservedRunningTime="2026-09-08 15:49:33.535823218 +0000 UTC m=+1033.896365982"
Sep 08 15:49:33.699301 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:33.699266    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:34.704671 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:34.704637    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:35.527282 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:35.527240    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:35.528334 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:35.528313    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:35.542497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:35.542464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:35.624850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:35.624816    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:36.731694 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:36.731624    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:36.829201 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:36.829161    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:36.997834 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:36.997740    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:37.296407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.296312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:37.389814 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.389780    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:37.394974 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.394940    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"]
Sep 08 15:49:37.398617 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.398602    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:37.401602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.401581    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-bbf4a143\""
Sep 08 15:49:37.401830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.401814    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-bbf4a143-dockercfg-8m6cf\""
Sep 08 15:49:37.411105 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.411083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"]
Sep 08 15:49:37.488271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.488233    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43082c4c-d5cb-4a40-af09-64f1b38bae84-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt\" (UID: \"43082c4c-d5cb-4a40-af09-64f1b38bae84\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:37.488472 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.488285    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lnnv5\" (UniqueName: \"kubernetes.io/projected/43082c4c-d5cb-4a40-af09-64f1b38bae84-kube-api-access-lnnv5\") pod \"payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt\" (UID: \"43082c4c-d5cb-4a40-af09-64f1b38bae84\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:37.589739 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.589698    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43082c4c-d5cb-4a40-af09-64f1b38bae84-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt\" (UID: \"43082c4c-d5cb-4a40-af09-64f1b38bae84\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:37.589941 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.589918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lnnv5\" (UniqueName: \"kubernetes.io/projected/43082c4c-d5cb-4a40-af09-64f1b38bae84-kube-api-access-lnnv5\") pod \"payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt\" (UID: \"43082c4c-d5cb-4a40-af09-64f1b38bae84\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:37.590495 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.590473    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43082c4c-d5cb-4a40-af09-64f1b38bae84-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt\" (UID: \"43082c4c-d5cb-4a40-af09-64f1b38bae84\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:37.600560 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.600533    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lnnv5\" (UniqueName: \"kubernetes.io/projected/43082c4c-d5cb-4a40-af09-64f1b38bae84-kube-api-access-lnnv5\") pod \"payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt\" (UID: \"43082c4c-d5cb-4a40-af09-64f1b38bae84\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:37.712350 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.712312    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:37.990662 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:37.990632    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"]
Sep 08 15:49:37.992683 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:49:37.992651    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43082c4c_d5cb_4a40_af09_64f1b38bae84.slice/crio-cb975f0244987a2e4c0cbf7ec796eb6809c87af353fee5c9e8fff3fe09d29359 WatchSource:0}: Error finding container cb975f0244987a2e4c0cbf7ec796eb6809c87af353fee5c9e8fff3fe09d29359: Status 404 returned error can't find the container with id cb975f0244987a2e4c0cbf7ec796eb6809c87af353fee5c9e8fff3fe09d29359
Sep 08 15:49:38.546871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:38.546837    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt" event={"ID":"43082c4c-d5cb-4a40-af09-64f1b38bae84","Type":"ContainerStarted","Data":"066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c"}
Sep 08 15:49:38.547086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:38.546889    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt" event={"ID":"43082c4c-d5cb-4a40-af09-64f1b38bae84","Type":"ContainerStarted","Data":"cb975f0244987a2e4c0cbf7ec796eb6809c87af353fee5c9e8fff3fe09d29359"}
Sep 08 15:49:38.547086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:38.546955    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:38.561707 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:38.561645    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt" podStartSLOduration=1.5616291119999999 podStartE2EDuration="1.561629112s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:49:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:38.561249072 +0000 UTC m=+1038.921791837" watchObservedRunningTime="2026-09-08 15:49:38.561629112 +0000 UTC m=+1038.922171877"
Sep 08 15:49:40.454459 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:40.454422    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:41.004691 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.004655    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:41.039108 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.039079    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"]
Sep 08 15:49:41.039304 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.039282    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr" podUID="f6f2216e-d4cc-42f0-b611-3280fa2718f4" containerName="payload-processing" containerID="cri-o://1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46" gracePeriod=30
Sep 08 15:49:41.105448 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.105417    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:41.205038 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.205004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:41.308411 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.308386    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:49:41.424173 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.424139    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6f2216e-d4cc-42f0-b611-3280fa2718f4-plugins-config-volume\") pod \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\" (UID: \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\") "
Sep 08 15:49:41.424352 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.424270    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2mjfv\" (UniqueName: \"kubernetes.io/projected/f6f2216e-d4cc-42f0-b611-3280fa2718f4-kube-api-access-2mjfv\") pod \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\" (UID: \"f6f2216e-d4cc-42f0-b611-3280fa2718f4\") "
Sep 08 15:49:41.424533 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.424509    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f6f2216e-d4cc-42f0-b611-3280fa2718f4-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "f6f2216e-d4cc-42f0-b611-3280fa2718f4" (UID: "f6f2216e-d4cc-42f0-b611-3280fa2718f4"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:49:41.426334 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.426306    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6f2216e-d4cc-42f0-b611-3280fa2718f4-kube-api-access-2mjfv" (OuterVolumeSpecName: "kube-api-access-2mjfv") pod "f6f2216e-d4cc-42f0-b611-3280fa2718f4" (UID: "f6f2216e-d4cc-42f0-b611-3280fa2718f4"). InnerVolumeSpecName "kube-api-access-2mjfv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:49:41.525414 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.525376    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2mjfv\" (UniqueName: \"kubernetes.io/projected/f6f2216e-d4cc-42f0-b611-3280fa2718f4-kube-api-access-2mjfv\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:41.525414 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.525411    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/f6f2216e-d4cc-42f0-b611-3280fa2718f4-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:41.564728 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.564645    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6f2216e-d4cc-42f0-b611-3280fa2718f4" containerID="1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46" exitCode=0
Sep 08 15:49:41.564728 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.564689    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr" event={"ID":"f6f2216e-d4cc-42f0-b611-3280fa2718f4","Type":"ContainerDied","Data":"1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46"}
Sep 08 15:49:41.564728 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.564692    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"
Sep 08 15:49:41.564989 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.564733    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr" event={"ID":"f6f2216e-d4cc-42f0-b611-3280fa2718f4","Type":"ContainerDied","Data":"71142839a23e9b8b6ba8abeb3a585dba1778b92d4ea7cfae473745ef3884e2ff"}
Sep 08 15:49:41.565478 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.564756    2579 scope.go:117] "RemoveContainer" containerID="1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46"
Sep 08 15:49:41.577615 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.577595    2579 scope.go:117] "RemoveContainer" containerID="1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46"
Sep 08 15:49:41.577920 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:49:41.577896    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46\": container with ID starting with 1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46 not found: ID does not exist" containerID="1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46"
Sep 08 15:49:41.578013 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.577928    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46"} err="failed to get container status \"1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46\": rpc error: code = NotFound desc = could not find container \"1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46\": container with ID starting with 1aeeacf1bcee52e3d938d3c1eab4c9e913aa203f28ece15cd944351875ff2f46 not found: ID does not exist"
Sep 08 15:49:41.590968 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.590939    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"]
Sep 08 15:49:41.593724 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.593705    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr"]
Sep 08 15:49:41.935629 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:41.935581    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:49:42.117007 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:42.116955    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6f2216e-d4cc-42f0-b611-3280fa2718f4" path="/var/lib/kubelet/pods/f6f2216e-d4cc-42f0-b611-3280fa2718f4/volumes"
Sep 08 15:49:42.241476 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:42.241387    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-processing-e2e-explicit-bb8457-8494574dd9-zklnr" podUID="f6f2216e-d4cc-42f0-b611-3280fa2718f4" containerName="payload-processing" probeResult="failure" output="dial tcp 10.132.0.67:9004: i/o timeout"
Sep 08 15:49:42.453233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:42.453199    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:42.551798 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:42.551715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:46.667825 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:46.667789    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:48.395909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:48.395879    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:48.474783 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:48.474733    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:48.675954 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:48.675862    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"]
Sep 08 15:49:48.677269 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:48.677236    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy" containerID="cri-o://20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760" gracePeriod=30
Sep 08 15:49:48.696350 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:48.696261    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:49.160103 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.160070    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:49.434494 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.434421    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"]
Sep 08 15:49:49.435329 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.435308    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6f2216e-d4cc-42f0-b611-3280fa2718f4" containerName="payload-processing"
Sep 08 15:49:49.435445 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.435437    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6f2216e-d4cc-42f0-b611-3280fa2718f4" containerName="payload-processing"
Sep 08 15:49:49.435579 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.435571    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6f2216e-d4cc-42f0-b611-3280fa2718f4" containerName="payload-processing"
Sep 08 15:49:49.438738 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.438722    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.442291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.442271    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-noten-69ef67-openshift-default-dockercfg-r4vx8\""
Sep 08 15:49:49.452832 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.452810    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"]
Sep 08 15:49:49.499392 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.498867    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:49.555129 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.555100    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:49:49.604518 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.604482    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-certs\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.604783 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.604528    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-envoy\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.604783 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.604668    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-data\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.604783 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.604709    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-podinfo\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.604783 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.604737    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-token\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.604783 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.604759    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-credential-socket\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.605114 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.604948    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-socket\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.605114 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.605018    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9dsq\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-kube-api-access-h9dsq\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.605114 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.605055    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istiod-ca-cert\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.620832 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.620802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:49.705743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705654    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-certs\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.705743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705697    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-envoy\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.705938 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705757    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-data\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.705938 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705780    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-podinfo\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.705938 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705799    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-token\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.705938 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705815    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-credential-socket\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.705938 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705866    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-socket\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.705938 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9dsq\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-kube-api-access-h9dsq\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.705938 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.705931    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istiod-ca-cert\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.706189 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.706131    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-certs\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.706316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.706258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-data\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.706355 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.706336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-socket\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.706775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.706748    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istiod-ca-cert\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.706775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.706764    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-credential-socket\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.708289 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.708267    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-envoy\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.708741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.708720    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-podinfo\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.714184 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.714161    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9dsq\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-kube-api-access-h9dsq\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.714500 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.714482    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-token\") pod \"e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") " pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:49.752600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:49.752570    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:50.055734 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.055691    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"]
Sep 08 15:49:50.056557 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:49:50.056528    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod94d9a8b3_8bd5_402f_8f41_e2ddb5ebbcfa.slice/crio-8f46a2cd284ea67820c681b47e489ef01203b3efa282e3f7a3ac6f6224e1d87d WatchSource:0}: Error finding container 8f46a2cd284ea67820c681b47e489ef01203b3efa282e3f7a3ac6f6224e1d87d: Status 404 returned error can't find the container with id 8f46a2cd284ea67820c681b47e489ef01203b3efa282e3f7a3ac6f6224e1d87d
Sep 08 15:49:50.058880 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.058851    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:50.058973 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.058913    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:50.058973 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.058942    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:50.628549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.628509    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph" event={"ID":"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa","Type":"ContainerStarted","Data":"39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3"}
Sep 08 15:49:50.629107 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.628576    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph" event={"ID":"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa","Type":"ContainerStarted","Data":"8f46a2cd284ea67820c681b47e489ef01203b3efa282e3f7a3ac6f6224e1d87d"}
Sep 08 15:49:50.650861 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.650809    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph" podStartSLOduration=1.6507952019999999 podStartE2EDuration="1.650795202s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:49:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:49:50.648488158 +0000 UTC m=+1051.009030926" watchObservedRunningTime="2026-09-08 15:49:50.650795202 +0000 UTC m=+1051.011337997"
Sep 08 15:49:50.753142 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.753108    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:50.935785 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:50.935693    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:51.027055 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:51.027008    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:51.139545 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:51.139506    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:51.759271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:51.759236    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:52.642637 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:52.642607    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:52.643600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:52.643579    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:49:53.854924 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.854898    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:49:53.951283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951184    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-credential-socket\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.951283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951246    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a5df78-2c69-4508-a243-ab8358c66686-istio-podinfo\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.951534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951285    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jxkd5\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-kube-api-access-jxkd5\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.951534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951334    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-certs\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.951534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951373    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-socket\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.951534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951454    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a5df78-2c69-4508-a243-ab8358c66686-istiod-ca-cert\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.951534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951477    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:49:53.951534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951514    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-istio-token\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.951864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951563    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-data\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.951864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951639    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:49:53.951864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951728    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:49:53.952070 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951880    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-data" (OuterVolumeSpecName: "istio-data") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:49:53.952070 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951900    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/92a5df78-2c69-4508-a243-ab8358c66686-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:49:53.952070 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.951952    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-envoy\") pod \"92a5df78-2c69-4508-a243-ab8358c66686\" (UID: \"92a5df78-2c69-4508-a243-ab8358c66686\") "
Sep 08 15:49:53.952342 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.952319    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:53.952342 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.952344    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:53.952529 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.952356    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/92a5df78-2c69-4508-a243-ab8358c66686-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:53.952529 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.952366    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:53.952529 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.952374    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:53.953568 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.953513    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/92a5df78-2c69-4508-a243-ab8358c66686-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:49:53.953928 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.953903    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:49:53.954049 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.953956    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-istio-token" (OuterVolumeSpecName: "istio-token") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:49:53.954049 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:53.953998    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-kube-api-access-jxkd5" (OuterVolumeSpecName: "kube-api-access-jxkd5") pod "92a5df78-2c69-4508-a243-ab8358c66686" (UID: "92a5df78-2c69-4508-a243-ab8358c66686"). InnerVolumeSpecName "kube-api-access-jxkd5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:49:54.053616 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.053575    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:54.053616 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.053606    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/92a5df78-2c69-4508-a243-ab8358c66686-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:54.053616 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.053617    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/92a5df78-2c69-4508-a243-ab8358c66686-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:54.053616 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.053626    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jxkd5\" (UniqueName: \"kubernetes.io/projected/92a5df78-2c69-4508-a243-ab8358c66686-kube-api-access-jxkd5\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:49:54.656603 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.656569    2579 generic.go:356] "Generic (PLEG): container finished" podID="11646660-82fd-49fb-bae8-3fb899503ff8" containerID="292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789" exitCode=0
Sep 08 15:49:54.656791 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.656641    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" event={"ID":"11646660-82fd-49fb-bae8-3fb899503ff8","Type":"ContainerDied","Data":"292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789"}
Sep 08 15:49:54.657175 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.657150    2579 scope.go:117] "RemoveContainer" containerID="292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789"
Sep 08 15:49:54.658469 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.658439    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:54.658593 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.658527    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:54.658593 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.658577    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:49:54.658707 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.658583    2579 generic.go:356] "Generic (PLEG): container finished" podID="92a5df78-2c69-4508-a243-ab8358c66686" containerID="20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760" exitCode=0
Sep 08 15:49:54.658707 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.658636    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"
Sep 08 15:49:54.658707 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.658671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" event={"ID":"92a5df78-2c69-4508-a243-ab8358c66686","Type":"ContainerDied","Data":"20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760"}
Sep 08 15:49:54.658831 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.658722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb" event={"ID":"92a5df78-2c69-4508-a243-ab8358c66686","Type":"ContainerDied","Data":"da6571319de26faedf6517b194b6ee0e9371ac9f2171be88628a9ca741f107ab"}
Sep 08 15:49:54.658831 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.658746    2579 scope.go:117] "RemoveContainer" containerID="20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760"
Sep 08 15:49:54.669989 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.669952    2579 scope.go:117] "RemoveContainer" containerID="bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96"
Sep 08 15:49:54.680341 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.680313    2579 scope.go:117] "RemoveContainer" containerID="20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760"
Sep 08 15:49:54.680712 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:49:54.680685    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760\": container with ID starting with 20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760 not found: ID does not exist" containerID="20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760"
Sep 08 15:49:54.680816 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.680725    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760"} err="failed to get container status \"20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760\": rpc error: code = NotFound desc = could not find container \"20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760\": container with ID starting with 20057efb22093c7b09f5ed9a96b2e101f107c0076dce62da23d57a448f0d9760 not found: ID does not exist"
Sep 08 15:49:54.680816 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.680752    2579 scope.go:117] "RemoveContainer" containerID="bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96"
Sep 08 15:49:54.681191 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:49:54.681168    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96\": container with ID starting with bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96 not found: ID does not exist" containerID="bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96"
Sep 08 15:49:54.681263 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.681198    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96"} err="failed to get container status \"bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96\": rpc error: code = NotFound desc = could not find container \"bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96\": container with ID starting with bd3314bef7e4bad1d7154c90784d5605f6435863b96380915d7af62866915a96 not found: ID does not exist"
Sep 08 15:49:54.692239 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.692214    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"]
Sep 08 15:49:54.696443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:54.696303    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-explicit-bb8457-openshift-default-6d566b688-ktrxb"]
Sep 08 15:49:55.668100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:55.668055    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" event={"ID":"11646660-82fd-49fb-bae8-3fb899503ff8","Type":"ContainerStarted","Data":"4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c"}
Sep 08 15:49:55.699078 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:55.699036    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:49:55.699256 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:55.699159    2579 patch_prober.go:28] interesting pod/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:49:55.699256 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:55.699217    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:49:56.114639 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:56.114603    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92a5df78-2c69-4508-a243-ab8358c66686" path="/var/lib/kubelet/pods/92a5df78-2c69-4508-a243-ab8358c66686/volumes"
Sep 08 15:49:56.699137 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:56.699102    2579 patch_prober.go:28] interesting pod/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:49:56.699527 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:56.699158    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:49:57.699594 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:57.699560    2579 patch_prober.go:28] interesting pod/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:49:57.700114 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:57.699636    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:49:58.698695 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:58.698664    2579 patch_prober.go:28] interesting pod/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:49:58.699056 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:58.699030    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:49:58.704014 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:58.703989    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:49:59.699385 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:59.699352    2579 patch_prober.go:28] interesting pod/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:49:59.699569 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:49:59.699414    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:50:00.433814 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:00.433777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:00.699850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:00.699764    2579 patch_prober.go:28] interesting pod/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body=
Sep 08 15:50:00.699850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:00.699835    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused"
Sep 08 15:50:01.125080 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:01.125039    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:01.219218 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:01.219172    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:01.560990 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:01.560876    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:01.702548 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:01.702516    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:50:01.702975 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:01.702942    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:50:01.703678 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:01.703658    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:50:05.430286 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:05.430240    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:50:07.353091 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:07.353049    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:07.453497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:07.453461    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:09.856202 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:09.856164    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:12.172314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:12.172231    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:18.219016 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.218521    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:18.254183 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.254151    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"]
Sep 08 15:50:18.254533 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.254464    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt" podUID="43082c4c-d5cb-4a40-af09-64f1b38bae84" containerName="payload-pre-processing" containerID="cri-o://066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c" gracePeriod=30
Sep 08 15:50:18.285920 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.285878    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:18.384720 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.384675    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:18.444998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.444951    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:18.528658 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.528622    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:50:18.610549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.610505    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43082c4c-d5cb-4a40-af09-64f1b38bae84-plugins-config-volume\") pod \"43082c4c-d5cb-4a40-af09-64f1b38bae84\" (UID: \"43082c4c-d5cb-4a40-af09-64f1b38bae84\") "
Sep 08 15:50:18.610775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.610638    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lnnv5\" (UniqueName: \"kubernetes.io/projected/43082c4c-d5cb-4a40-af09-64f1b38bae84-kube-api-access-lnnv5\") pod \"43082c4c-d5cb-4a40-af09-64f1b38bae84\" (UID: \"43082c4c-d5cb-4a40-af09-64f1b38bae84\") "
Sep 08 15:50:18.610951 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.610921    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43082c4c-d5cb-4a40-af09-64f1b38bae84-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "43082c4c-d5cb-4a40-af09-64f1b38bae84" (UID: "43082c4c-d5cb-4a40-af09-64f1b38bae84"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:50:18.612896 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.612872    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43082c4c-d5cb-4a40-af09-64f1b38bae84-kube-api-access-lnnv5" (OuterVolumeSpecName: "kube-api-access-lnnv5") pod "43082c4c-d5cb-4a40-af09-64f1b38bae84" (UID: "43082c4c-d5cb-4a40-af09-64f1b38bae84"). InnerVolumeSpecName "kube-api-access-lnnv5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:18.712363 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.712325    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/43082c4c-d5cb-4a40-af09-64f1b38bae84-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:18.712363 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.712354    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lnnv5\" (UniqueName: \"kubernetes.io/projected/43082c4c-d5cb-4a40-af09-64f1b38bae84-kube-api-access-lnnv5\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:18.797066 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.796972    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:18.820345 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.820314    2579 generic.go:356] "Generic (PLEG): container finished" podID="43082c4c-d5cb-4a40-af09-64f1b38bae84" containerID="066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c" exitCode=0
Sep 08 15:50:18.820524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.820357    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"
Sep 08 15:50:18.820524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.820383    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt" event={"ID":"43082c4c-d5cb-4a40-af09-64f1b38bae84","Type":"ContainerDied","Data":"066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c"}
Sep 08 15:50:18.820524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.820451    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt" event={"ID":"43082c4c-d5cb-4a40-af09-64f1b38bae84","Type":"ContainerDied","Data":"cb975f0244987a2e4c0cbf7ec796eb6809c87af353fee5c9e8fff3fe09d29359"}
Sep 08 15:50:18.820524 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.820472    2579 scope.go:117] "RemoveContainer" containerID="066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c"
Sep 08 15:50:18.830348 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.830328    2579 scope.go:117] "RemoveContainer" containerID="066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c"
Sep 08 15:50:18.830652 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:50:18.830630    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c\": container with ID starting with 066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c not found: ID does not exist" containerID="066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c"
Sep 08 15:50:18.830724 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.830659    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c"} err="failed to get container status \"066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c\": rpc error: code = NotFound desc = could not find container \"066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c\": container with ID starting with 066a9f04be5f81e6b5cd8101c4d7beef80c532e5c7e272fa45f084fe88acc53c not found: ID does not exist"
Sep 08 15:50:18.842500 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.842476    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"]
Sep 08 15:50:18.846270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:18.846246    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-bbf4a143-5f47cbc7d6-j5nrt"]
Sep 08 15:50:20.114494 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:20.114463    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43082c4c-d5cb-4a40-af09-64f1b38bae84" path="/var/lib/kubelet/pods/43082c4c-d5cb-4a40-af09-64f1b38bae84/volumes"
Sep 08 15:50:21.325419 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:21.325385    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:50:24.563644 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:24.563605    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:24.663490 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:24.663449    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:24.811156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:24.811120    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"]
Sep 08 15:50:24.811407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:24.811375    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy" containerID="cri-o://4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c" gracePeriod=30
Sep 08 15:50:24.826153 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:24.826110    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:25.188032 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:25.187921    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:25.275628 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:25.275590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:25.390684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:25.390638    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:30.074425 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.074404    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:50:30.218047 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218009    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-socket\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218047 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218064    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-istio-token\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218097    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-certs\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218123    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11646660-82fd-49fb-bae8-3fb899503ff8-istiod-ca-cert\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218191    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-envoy\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218246    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hf8p\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-kube-api-access-7hf8p\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218291    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11646660-82fd-49fb-bae8-3fb899503ff8-istio-podinfo\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218356    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-credential-socket\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218350    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:30.218497 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218399    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-data\") pod \"11646660-82fd-49fb-bae8-3fb899503ff8\" (UID: \"11646660-82fd-49fb-bae8-3fb899503ff8\") "
Sep 08 15:50:30.218715 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218494    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:30.218715 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218668    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-data" (OuterVolumeSpecName: "istio-data") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:30.218827 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218798    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.218827 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218809    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:30.218827 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218820    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.219009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218835    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.219009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.218851    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11646660-82fd-49fb-bae8-3fb899503ff8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:50:30.220495 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.220459    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/11646660-82fd-49fb-bae8-3fb899503ff8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:50:30.220617 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.220498    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-istio-token" (OuterVolumeSpecName: "istio-token") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:30.220617 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.220527    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-kube-api-access-7hf8p" (OuterVolumeSpecName: "kube-api-access-7hf8p") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "kube-api-access-7hf8p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:30.220617 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.220555    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "11646660-82fd-49fb-bae8-3fb899503ff8" (UID: "11646660-82fd-49fb-bae8-3fb899503ff8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:30.319362 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.319327    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.319362 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.319357    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/11646660-82fd-49fb-bae8-3fb899503ff8-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.319362 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.319366    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.319600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.319376    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hf8p\" (UniqueName: \"kubernetes.io/projected/11646660-82fd-49fb-bae8-3fb899503ff8-kube-api-access-7hf8p\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.319600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.319386    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/11646660-82fd-49fb-bae8-3fb899503ff8-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.319600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.319393    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/11646660-82fd-49fb-bae8-3fb899503ff8-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:30.889790 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.889753    2579 generic.go:356] "Generic (PLEG): container finished" podID="11646660-82fd-49fb-bae8-3fb899503ff8" containerID="4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c" exitCode=0
Sep 08 15:50:30.889998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.889807    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"
Sep 08 15:50:30.889998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.889840    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" event={"ID":"11646660-82fd-49fb-bae8-3fb899503ff8","Type":"ContainerDied","Data":"4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c"}
Sep 08 15:50:30.889998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.889918    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh" event={"ID":"11646660-82fd-49fb-bae8-3fb899503ff8","Type":"ContainerDied","Data":"c559374ef7e237ff1a464567ba991fec5ad012578ffcd9935c319620b872a28d"}
Sep 08 15:50:30.889998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.889939    2579 scope.go:117] "RemoveContainer" containerID="4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c"
Sep 08 15:50:30.900104 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.900082    2579 scope.go:117] "RemoveContainer" containerID="292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789"
Sep 08 15:50:30.909021 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.909002    2579 scope.go:117] "RemoveContainer" containerID="4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c"
Sep 08 15:50:30.909298 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:50:30.909279    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c\": container with ID starting with 4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c not found: ID does not exist" containerID="4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c"
Sep 08 15:50:30.909359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.909307    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c"} err="failed to get container status \"4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c\": rpc error: code = NotFound desc = could not find container \"4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c\": container with ID starting with 4faecd614d681c23e1406e9984b9537079b47e6751b965868cbdd69157cca36c not found: ID does not exist"
Sep 08 15:50:30.909359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.909325    2579 scope.go:117] "RemoveContainer" containerID="292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789"
Sep 08 15:50:30.909691 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:50:30.909667    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789\": container with ID starting with 292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789 not found: ID does not exist" containerID="292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789"
Sep 08 15:50:30.909767 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.909699    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789"} err="failed to get container status \"292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789\": rpc error: code = NotFound desc = could not find container \"292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789\": container with ID starting with 292a238e2241a0d368e79d8cd249a3a332edef8afe6ac24d5bca4c2b5a3db789 not found: ID does not exist"
Sep 08 15:50:30.911121 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.911099    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"]
Sep 08 15:50:30.913496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:30.913477    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-bbf4a143-openshift-default-7d9d4f9fd4-x8jmh"]
Sep 08 15:50:31.200028 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:31.199919    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:31.258876 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:31.258845    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:31.434068 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:31.434033    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:31.552950 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:31.552865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:31.652991 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:31.652929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:32.114764 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:32.114732    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" path="/var/lib/kubelet/pods/11646660-82fd-49fb-bae8-3fb899503ff8/volumes"
Sep 08 15:50:36.887704 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:36.887663    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:37.483774 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:37.483737    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:37.757697 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:37.757612    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:37.855450 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:37.855410    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:37.955840 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:37.955786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:38.526006 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:38.525929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:38.634426 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:38.634391    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"]
Sep 08 15:50:38.634666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:38.634635    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph" podUID="94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" containerName="istio-proxy" containerID="cri-o://39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3" gracePeriod=30
Sep 08 15:50:38.647660 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:38.647598    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:38.750600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:38.750562    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:40.737931 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:40.737895    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:40.805154 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:40.805118    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:42.357140 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:42.357105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:42.452522 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:42.452488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:43.136729 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.136690    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:50:43.544466 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.544371    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"]
Sep 08 15:50:43.544987 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.544948    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43082c4c-d5cb-4a40-af09-64f1b38bae84" containerName="payload-pre-processing"
Sep 08 15:50:43.545048 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.544991    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="43082c4c-d5cb-4a40-af09-64f1b38bae84" containerName="payload-pre-processing"
Sep 08 15:50:43.545048 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545009    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy"
Sep 08 15:50:43.545048 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545017    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy"
Sep 08 15:50:43.545048 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545028    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy"
Sep 08 15:50:43.545048 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545036    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy"
Sep 08 15:50:43.545225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545054    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy"
Sep 08 15:50:43.545225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545062    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy"
Sep 08 15:50:43.545225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545183    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy"
Sep 08 15:50:43.545225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545196    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="92a5df78-2c69-4508-a243-ab8358c66686" containerName="istio-proxy"
Sep 08 15:50:43.545225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545205    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy"
Sep 08 15:50:43.545225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545212    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="43082c4c-d5cb-4a40-af09-64f1b38bae84" containerName="payload-pre-processing"
Sep 08 15:50:43.545225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.545223    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy"
Sep 08 15:50:43.550319 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.550295    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.553214 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.553186    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w2-be2aba-serving-cert\""
Sep 08 15:50:43.562988 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.562946    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"]
Sep 08 15:50:43.575588 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.575555    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:43.644272 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.644237    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gf6lb\" (UniqueName: \"kubernetes.io/projected/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-kube-api-access-gf6lb\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.644423 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.644284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.644423 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.644347    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.644549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.644435    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.673543 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.673510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:43.745727 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.745687    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gf6lb\" (UniqueName: \"kubernetes.io/projected/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-kube-api-access-gf6lb\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.745890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.745744    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.745890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.745793    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.745890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.745836    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.745890 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:50:43.745877    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-serving-cert: secret "maas-api-e2e-shared-a-w2-be2aba-serving-cert" not found
Sep 08 15:50:43.746093 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:50:43.745978    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls podName:a7370dc4-8313-436b-84fa-4e69b8b4ab1a nodeName:}" failed. No retries permitted until 2026-09-08 15:50:44.245938244 +0000 UTC m=+1104.606481002 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls") pod "maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4" (UID: "a7370dc4-8313-436b-84fa-4e69b8b4ab1a") : secret "maas-api-e2e-shared-a-w2-be2aba-serving-cert" not found
Sep 08 15:50:43.746600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.746580    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.748435 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.748416    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-metrics-certs\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.754055 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.754031    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gf6lb\" (UniqueName: \"kubernetes.io/projected/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-kube-api-access-gf6lb\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:43.821804 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.821677    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:43.889462 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.889437    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:50:43.948337 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948300    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-data\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948346    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-socket\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948375    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istiod-ca-cert\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948408    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-podinfo\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948443    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-token\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948477    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-certs\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948512    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-envoy\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948557    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h9dsq\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-kube-api-access-h9dsq\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948590    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-credential-socket\") pod \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\" (UID: \"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa\") "
Sep 08 15:50:43.948850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948603    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-data" (OuterVolumeSpecName: "istio-data") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:43.948850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948617    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:43.949075 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.948895    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:43.949131 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.949098    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:43.949131 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.949119    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:43.949207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.949133    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:43.949327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.949303    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:43.949625 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.949067    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:50:43.950830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.950806    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-kube-api-access-h9dsq" (OuterVolumeSpecName: "kube-api-access-h9dsq") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "kube-api-access-h9dsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:43.950930 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.950823    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:50:43.950930 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.950860    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-token" (OuterVolumeSpecName: "istio-token") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:43.951052 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.950999    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" (UID: "94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:50:43.967444 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.967412    2579 generic.go:356] "Generic (PLEG): container finished" podID="94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" containerID="39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3" exitCode=0
Sep 08 15:50:43.967583 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.967473    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"
Sep 08 15:50:43.967583 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.967499    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph" event={"ID":"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa","Type":"ContainerDied","Data":"39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3"}
Sep 08 15:50:43.967583 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.967566    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph" event={"ID":"94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa","Type":"ContainerDied","Data":"8f46a2cd284ea67820c681b47e489ef01203b3efa282e3f7a3ac6f6224e1d87d"}
Sep 08 15:50:43.967762 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.967608    2579 scope.go:117] "RemoveContainer" containerID="39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3"
Sep 08 15:50:43.979721 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.979704    2579 scope.go:117] "RemoveContainer" containerID="39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3"
Sep 08 15:50:43.980040 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:50:43.980017    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3\": container with ID starting with 39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3 not found: ID does not exist" containerID="39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3"
Sep 08 15:50:43.980136 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:43.980051    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3"} err="failed to get container status \"39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3\": rpc error: code = NotFound desc = could not find container \"39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3\": container with ID starting with 39293602d07c3b1955138464dc28b109354f9e8ba9cbeddb3d891d646444f0a3 not found: ID does not exist"
Sep 08 15:50:44.004438 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.004408    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"]
Sep 08 15:50:44.021540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.021507    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-noten-69ef67-openshift-default-699b6ff6f8-8hpph"]
Sep 08 15:50:44.049740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.049652    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:44.049740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.049680    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:44.049740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.049693    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:44.049740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.049704    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:44.049740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.049715    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h9dsq\" (UniqueName: \"kubernetes.io/projected/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-kube-api-access-h9dsq\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:44.049740 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.049728    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:44.115212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.115178    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" path="/var/lib/kubelet/pods/94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa/volumes"
Sep 08 15:50:44.165223 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.165156    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:44.252263 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.252224    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:44.254810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.254785    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls\") pod \"maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:44.374768 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.374728    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:44.462076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.462042    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:44.481755 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.481716    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:44.490794 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.490769    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"]
Sep 08 15:50:44.491246 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.491231    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy"
Sep 08 15:50:44.491291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.491249    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="11646660-82fd-49fb-bae8-3fb899503ff8" containerName="istio-proxy"
Sep 08 15:50:44.491291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.491283    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" containerName="istio-proxy"
Sep 08 15:50:44.491291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.491288    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" containerName="istio-proxy"
Sep 08 15:50:44.491403 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.491347    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="94d9a8b3-8bd5-402f-8f41-e2ddb5ebbcfa" containerName="istio-proxy"
Sep 08 15:50:44.494698 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.494679    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:44.498153 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.498134    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-shared-a-w2-be2aba\""
Sep 08 15:50:44.509381 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.509358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"]
Sep 08 15:50:44.516451 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.516401    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"]
Sep 08 15:50:44.521475 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.521453    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:44.526559 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.525710    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-shared-a-w2-be2aba-dockercfg-sb9q5\""
Sep 08 15:50:44.538248 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.536128    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"]
Sep 08 15:50:44.555239 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.555210    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lh7n6\" (UniqueName: \"kubernetes.io/projected/ae80a8e8-b0af-4720-9c4f-31aab74cb516-kube-api-access-lh7n6\") pod \"payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6\" (UID: \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:44.555834 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.555271    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5sx9p\" (UniqueName: \"kubernetes.io/projected/8ae13590-55a4-4b19-9d51-3acd14a70ed3-kube-api-access-5sx9p\") pod \"payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq\" (UID: \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:44.555834 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.555438    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae13590-55a4-4b19-9d51-3acd14a70ed3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq\" (UID: \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:44.555834 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.555524    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae80a8e8-b0af-4720-9c4f-31aab74cb516-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6\" (UID: \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:44.656792 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.656761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5sx9p\" (UniqueName: \"kubernetes.io/projected/8ae13590-55a4-4b19-9d51-3acd14a70ed3-kube-api-access-5sx9p\") pod \"payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq\" (UID: \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:44.656919 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.656823    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae13590-55a4-4b19-9d51-3acd14a70ed3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq\" (UID: \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:44.656919 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.656857    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae80a8e8-b0af-4720-9c4f-31aab74cb516-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6\" (UID: \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:44.656919 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.656899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lh7n6\" (UniqueName: \"kubernetes.io/projected/ae80a8e8-b0af-4720-9c4f-31aab74cb516-kube-api-access-lh7n6\") pod \"payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6\" (UID: \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:44.657606 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.657588    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae13590-55a4-4b19-9d51-3acd14a70ed3-plugins-config-volume\") pod \"payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq\" (UID: \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:44.657644 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.657622    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae80a8e8-b0af-4720-9c4f-31aab74cb516-plugins-config-volume\") pod \"payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6\" (UID: \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:44.672261 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.667883    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lh7n6\" (UniqueName: \"kubernetes.io/projected/ae80a8e8-b0af-4720-9c4f-31aab74cb516-kube-api-access-lh7n6\") pod \"payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6\" (UID: \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\") " pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:44.672261 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.668856    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5sx9p\" (UniqueName: \"kubernetes.io/projected/8ae13590-55a4-4b19-9d51-3acd14a70ed3-kube-api-access-5sx9p\") pod \"payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq\" (UID: \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\") " pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:44.745607 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.745484    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"]
Sep 08 15:50:44.746464 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:50:44.746434    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7370dc4_8313_436b_84fa_4e69b8b4ab1a.slice/crio-3e93a7732d8f59983f9d5a34d71e1dbd54b2390c5de023130d5661860e500450 WatchSource:0}: Error finding container 3e93a7732d8f59983f9d5a34d71e1dbd54b2390c5de023130d5661860e500450: Status 404 returned error can't find the container with id 3e93a7732d8f59983f9d5a34d71e1dbd54b2390c5de023130d5661860e500450
Sep 08 15:50:44.748129 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.748108    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:50:44.806539 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.806507    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:44.840917 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.840884    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:44.976877 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:44.976838    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4" event={"ID":"a7370dc4-8313-436b-84fa-4e69b8b4ab1a","Type":"ContainerStarted","Data":"3e93a7732d8f59983f9d5a34d71e1dbd54b2390c5de023130d5661860e500450"}
Sep 08 15:50:45.085542 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.085508    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"]
Sep 08 15:50:45.086609 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:50:45.086576    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae80a8e8_b0af_4720_9c4f_31aab74cb516.slice/crio-ea38fe0f8f1fd5ec43d321f35ba6ba1dbe1c9fe7195ca034063cde278ec5df8a WatchSource:0}: Error finding container ea38fe0f8f1fd5ec43d321f35ba6ba1dbe1c9fe7195ca034063cde278ec5df8a: Status 404 returned error can't find the container with id ea38fe0f8f1fd5ec43d321f35ba6ba1dbe1c9fe7195ca034063cde278ec5df8a
Sep 08 15:50:45.124347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.124316    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"]
Sep 08 15:50:45.125610 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:50:45.125582    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ae13590_55a4_4b19_9d51_3acd14a70ed3.slice/crio-b24c58d6d7a7ee8af49907207f409d259dad71306828b6453290f79aa4474d18 WatchSource:0}: Error finding container b24c58d6d7a7ee8af49907207f409d259dad71306828b6453290f79aa4474d18: Status 404 returned error can't find the container with id b24c58d6d7a7ee8af49907207f409d259dad71306828b6453290f79aa4474d18
Sep 08 15:50:45.986123 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.986065    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6" event={"ID":"ae80a8e8-b0af-4720-9c4f-31aab74cb516","Type":"ContainerStarted","Data":"4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901"}
Sep 08 15:50:45.986603 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.986133    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6" event={"ID":"ae80a8e8-b0af-4720-9c4f-31aab74cb516","Type":"ContainerStarted","Data":"ea38fe0f8f1fd5ec43d321f35ba6ba1dbe1c9fe7195ca034063cde278ec5df8a"}
Sep 08 15:50:45.986603 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.986161    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:50:45.987811 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.987781    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq" event={"ID":"8ae13590-55a4-4b19-9d51-3acd14a70ed3","Type":"ContainerStarted","Data":"2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933"}
Sep 08 15:50:45.987924 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.987840    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:45.987924 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.987867    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq" event={"ID":"8ae13590-55a4-4b19-9d51-3acd14a70ed3","Type":"ContainerStarted","Data":"b24c58d6d7a7ee8af49907207f409d259dad71306828b6453290f79aa4474d18"}
Sep 08 15:50:45.989543 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.989510    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4" event={"ID":"a7370dc4-8313-436b-84fa-4e69b8b4ab1a","Type":"ContainerStarted","Data":"0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234"}
Sep 08 15:50:45.989719 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:45.989628    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:46.006888 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:46.006839    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6" podStartSLOduration=2.006825585 podStartE2EDuration="2.006825585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:50:46.004673744 +0000 UTC m=+1106.365216510" watchObservedRunningTime="2026-09-08 15:50:46.006825585 +0000 UTC m=+1106.367368349"
Sep 08 15:50:46.022986 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:46.022926    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq" podStartSLOduration=2.02291001 podStartE2EDuration="2.02291001s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:50:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:50:46.020708319 +0000 UTC m=+1106.381251083" watchObservedRunningTime="2026-09-08 15:50:46.02291001 +0000 UTC m=+1106.383452774"
Sep 08 15:50:46.048232 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:46.042890    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4" podStartSLOduration=2.613686892 podStartE2EDuration="3.042869274s" totalImagesPullingTime="429.182382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:50:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:50:46.039874443 +0000 UTC m=+1106.400417208" watchObservedRunningTime="2026-09-08 15:50:46.042869274 +0000 UTC m=+1106.403412039"
Sep 08 15:50:47.885230 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:47.885180    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:48.503036 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.503004    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"]
Sep 08 15:50:48.503224 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.503203    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6" podUID="7a56b7f2-c8e7-453e-af4a-da10201baddf" containerName="maas-api" containerID="cri-o://95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65" gracePeriod=30
Sep 08 15:50:48.534717 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.534681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:48.687743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.687706    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:48.755761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.755686    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:50:48.778180 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.777913    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:48.797336 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.797305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xh664\" (UniqueName: \"kubernetes.io/projected/7a56b7f2-c8e7-453e-af4a-da10201baddf-kube-api-access-xh664\") pod \"7a56b7f2-c8e7-453e-af4a-da10201baddf\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") "
Sep 08 15:50:48.797527 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.797359    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-metrics-certs\") pod \"7a56b7f2-c8e7-453e-af4a-da10201baddf\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") "
Sep 08 15:50:48.797527 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.797433    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a56b7f2-c8e7-453e-af4a-da10201baddf-openshift-service-ca\") pod \"7a56b7f2-c8e7-453e-af4a-da10201baddf\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") "
Sep 08 15:50:48.797527 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.797489    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-maas-api-tls\") pod \"7a56b7f2-c8e7-453e-af4a-da10201baddf\" (UID: \"7a56b7f2-c8e7-453e-af4a-da10201baddf\") "
Sep 08 15:50:48.797849 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.797816    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7a56b7f2-c8e7-453e-af4a-da10201baddf-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7a56b7f2-c8e7-453e-af4a-da10201baddf" (UID: "7a56b7f2-c8e7-453e-af4a-da10201baddf"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:50:48.799537 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.799514    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7a56b7f2-c8e7-453e-af4a-da10201baddf" (UID: "7a56b7f2-c8e7-453e-af4a-da10201baddf"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:50:48.799683 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.799645    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7a56b7f2-c8e7-453e-af4a-da10201baddf-kube-api-access-xh664" (OuterVolumeSpecName: "kube-api-access-xh664") pod "7a56b7f2-c8e7-453e-af4a-da10201baddf" (UID: "7a56b7f2-c8e7-453e-af4a-da10201baddf"). InnerVolumeSpecName "kube-api-access-xh664". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:50:48.799945 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.799931    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7a56b7f2-c8e7-453e-af4a-da10201baddf" (UID: "7a56b7f2-c8e7-453e-af4a-da10201baddf"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:50:48.856285 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.856248    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:48.898761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.898720    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7a56b7f2-c8e7-453e-af4a-da10201baddf-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:48.898761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.898764    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:48.899189 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.898781    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xh664\" (UniqueName: \"kubernetes.io/projected/7a56b7f2-c8e7-453e-af4a-da10201baddf-kube-api-access-xh664\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:48.899189 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:48.898793    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7a56b7f2-c8e7-453e-af4a-da10201baddf-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:50:49.008391 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.008296    2579 generic.go:356] "Generic (PLEG): container finished" podID="7a56b7f2-c8e7-453e-af4a-da10201baddf" containerID="95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65" exitCode=0
Sep 08 15:50:49.008391 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.008353    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"
Sep 08 15:50:49.008637 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.008389    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6" event={"ID":"7a56b7f2-c8e7-453e-af4a-da10201baddf","Type":"ContainerDied","Data":"95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65"}
Sep 08 15:50:49.008637 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.008458    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6" event={"ID":"7a56b7f2-c8e7-453e-af4a-da10201baddf","Type":"ContainerDied","Data":"a63b6398016fb477406c14c2515324672b863ba5c15eccd863a9e0ded419bef0"}
Sep 08 15:50:49.008637 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.008490    2579 scope.go:117] "RemoveContainer" containerID="95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65"
Sep 08 15:50:49.018894 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.018875    2579 scope.go:117] "RemoveContainer" containerID="95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65"
Sep 08 15:50:49.019181 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:50:49.019161    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65\": container with ID starting with 95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65 not found: ID does not exist" containerID="95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65"
Sep 08 15:50:49.019244 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.019189    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65"} err="failed to get container status \"95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65\": rpc error: code = NotFound desc = could not find container \"95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65\": container with ID starting with 95e7931ff8396464d070f68eb1f7d9b81259aa7e180f178718b719f62d5cee65 not found: ID does not exist"
Sep 08 15:50:49.036570 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.036542    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"]
Sep 08 15:50:49.040025 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.040000    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-a-28e012-565d975844-nvlq6"]
Sep 08 15:50:49.168188 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:49.168153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:50.114654 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:50.114612    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7a56b7f2-c8e7-453e-af4a-da10201baddf" path="/var/lib/kubelet/pods/7a56b7f2-c8e7-453e-af4a-da10201baddf/volumes"
Sep 08 15:50:52.000822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:52.000787    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:50:53.522754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:53.522712    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:50:55.256109 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:55.256066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:55.319930 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:55.319892    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:55.535346 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:55.535243    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:55.994353 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:55.994319    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:50:56.997447 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:56.997406    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:50:56.997911 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:50:56.997600    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:51:04.882034 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:04.881996    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:06.009198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.009158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:06.041677 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.041495    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"]
Sep 08 15:51:06.041883 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.041765    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59" podUID="ad54fbc9-827c-4569-8433-8cc4580de581" containerName="payload-pre-processing" containerID="cri-o://d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8" gracePeriod=30
Sep 08 15:51:06.109802 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.109767    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:06.210525 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.210490    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:06.276684 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.276588    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:06.307854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.307828    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:51:06.363779 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.363679    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dkmdb\" (UniqueName: \"kubernetes.io/projected/ad54fbc9-827c-4569-8433-8cc4580de581-kube-api-access-dkmdb\") pod \"ad54fbc9-827c-4569-8433-8cc4580de581\" (UID: \"ad54fbc9-827c-4569-8433-8cc4580de581\") "
Sep 08 15:51:06.363995 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.363826    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad54fbc9-827c-4569-8433-8cc4580de581-plugins-config-volume\") pod \"ad54fbc9-827c-4569-8433-8cc4580de581\" (UID: \"ad54fbc9-827c-4569-8433-8cc4580de581\") "
Sep 08 15:51:06.364230 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.364205    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ad54fbc9-827c-4569-8433-8cc4580de581-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ad54fbc9-827c-4569-8433-8cc4580de581" (UID: "ad54fbc9-827c-4569-8433-8cc4580de581"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:51:06.365853 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.365831    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ad54fbc9-827c-4569-8433-8cc4580de581-kube-api-access-dkmdb" (OuterVolumeSpecName: "kube-api-access-dkmdb") pod "ad54fbc9-827c-4569-8433-8cc4580de581" (UID: "ad54fbc9-827c-4569-8433-8cc4580de581"). InnerVolumeSpecName "kube-api-access-dkmdb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:51:06.465357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.465326    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ad54fbc9-827c-4569-8433-8cc4580de581-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.465357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.465355    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dkmdb\" (UniqueName: \"kubernetes.io/projected/ad54fbc9-827c-4569-8433-8cc4580de581-kube-api-access-dkmdb\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:51:06.604621 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:06.604582    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:07.115057 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.115019    2579 generic.go:356] "Generic (PLEG): container finished" podID="ad54fbc9-827c-4569-8433-8cc4580de581" containerID="d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8" exitCode=0
Sep 08 15:51:07.115545 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.115067    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"
Sep 08 15:51:07.115545 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.115104    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59" event={"ID":"ad54fbc9-827c-4569-8433-8cc4580de581","Type":"ContainerDied","Data":"d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8"}
Sep 08 15:51:07.115545 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.115161    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59" event={"ID":"ad54fbc9-827c-4569-8433-8cc4580de581","Type":"ContainerDied","Data":"35683f1ebaf9b9331395a7a2cea9f3b177ffe34ef4b0453a66c92e7e77252e5b"}
Sep 08 15:51:07.115545 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.115189    2579 scope.go:117] "RemoveContainer" containerID="d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8"
Sep 08 15:51:07.125411 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.125387    2579 scope.go:117] "RemoveContainer" containerID="d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8"
Sep 08 15:51:07.125749 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:51:07.125729    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8\": container with ID starting with d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8 not found: ID does not exist" containerID="d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8"
Sep 08 15:51:07.125815 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.125761    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8"} err="failed to get container status \"d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8\": rpc error: code = NotFound desc = could not find container \"d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8\": container with ID starting with d2da5d94b7324851f7f30a37bfd1850eabdfb0e5fe05acb29ddc47c7bbc497a8 not found: ID does not exist"
Sep 08 15:51:07.138349 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.138321    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"]
Sep 08 15:51:07.140709 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.140690    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-inf-b-a057c5-555bdbbc66-sxz59"]
Sep 08 15:51:07.327521 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.327487    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:07.681526 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:07.681494    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:08.067770 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:08.067656    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:08.114747 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:08.114714    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ad54fbc9-827c-4569-8433-8cc4580de581" path="/var/lib/kubelet/pods/ad54fbc9-827c-4569-8433-8cc4580de581/volumes"
Sep 08 15:51:08.157973 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:08.157937    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:10.762376 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:10.762345    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:10.854098 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:10.854066    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:11.437025 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:11.436986    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:51:11.989703 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:11.989670    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:12.089351 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:12.089311    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:12.459517 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:12.459483    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:12.561729 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:12.561692    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:13.530446 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:13.530405    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:13.594317 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:13.594288    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:13.797097 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:13.796999    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:14.337978 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:14.337925    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:14.659363 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:14.659277    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:14.932098 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:14.932004    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:17.766774 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:17.766738    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:17.854941 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:17.854907    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:18.964800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.964769    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"]
Sep 08 15:51:18.965359 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.965338    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7a56b7f2-c8e7-453e-af4a-da10201baddf" containerName="maas-api"
Sep 08 15:51:18.965406 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.965362    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7a56b7f2-c8e7-453e-af4a-da10201baddf" containerName="maas-api"
Sep 08 15:51:18.965406 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.965382    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ad54fbc9-827c-4569-8433-8cc4580de581" containerName="payload-pre-processing"
Sep 08 15:51:18.965406 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.965391    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ad54fbc9-827c-4569-8433-8cc4580de581" containerName="payload-pre-processing"
Sep 08 15:51:18.965512 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.965505    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ad54fbc9-827c-4569-8433-8cc4580de581" containerName="payload-pre-processing"
Sep 08 15:51:18.965544 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.965518    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7a56b7f2-c8e7-453e-af4a-da10201baddf" containerName="maas-api"
Sep 08 15:51:18.968889 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.968866    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:18.971853 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.971824    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-w3-b30e99-serving-cert\""
Sep 08 15:51:18.981419 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:18.981394    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"]
Sep 08 15:51:19.002425 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.002391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:19.080570 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.080531    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec94781-7493-46e7-8c0d-5a9db08bbf06-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.080743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.080582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6jzj\" (UniqueName: \"kubernetes.io/projected/6ec94781-7493-46e7-8c0d-5a9db08bbf06-kube-api-access-n6jzj\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.080743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.080689    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.080842 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.080762    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.101432 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.101396    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:19.182166 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.182124    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec94781-7493-46e7-8c0d-5a9db08bbf06-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.182330 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.182180    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6jzj\" (UniqueName: \"kubernetes.io/projected/6ec94781-7493-46e7-8c0d-5a9db08bbf06-kube-api-access-n6jzj\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.182330 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.182241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.182330 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.182304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.182545 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:51:19.182454    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-serving-cert: secret "maas-api-e2e-shared-a-w3-b30e99-serving-cert" not found
Sep 08 15:51:19.182545 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:51:19.182529    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls podName:6ec94781-7493-46e7-8c0d-5a9db08bbf06 nodeName:}" failed. No retries permitted until 2026-09-08 15:51:19.682504439 +0000 UTC m=+1140.043047199 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls") pod "maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6" (UID: "6ec94781-7493-46e7-8c0d-5a9db08bbf06") : secret "maas-api-e2e-shared-a-w3-b30e99-serving-cert" not found
Sep 08 15:51:19.182816 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.182791    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec94781-7493-46e7-8c0d-5a9db08bbf06-openshift-service-ca\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.184877 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.184844    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-metrics-certs\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.191661 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.191637    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6jzj\" (UniqueName: \"kubernetes.io/projected/6ec94781-7493-46e7-8c0d-5a9db08bbf06-kube-api-access-n6jzj\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.286283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.286193    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:19.688013 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.687953    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.690495 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.690465    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls\") pod \"maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:19.881006 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:19.880952    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:20.158306 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:20.158275    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"]
Sep 08 15:51:20.160048 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:51:20.160023    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ec94781_7493_46e7_8c0d_5a9db08bbf06.slice/crio-14b70d8220c1a1ef3fb2b865c8afd61b846c4b0c79b6009cd8f468cb64c3ec6b WatchSource:0}: Error finding container 14b70d8220c1a1ef3fb2b865c8afd61b846c4b0c79b6009cd8f468cb64c3ec6b: Status 404 returned error can't find the container with id 14b70d8220c1a1ef3fb2b865c8afd61b846c4b0c79b6009cd8f468cb64c3ec6b
Sep 08 15:51:20.202234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:20.202193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6" event={"ID":"6ec94781-7493-46e7-8c0d-5a9db08bbf06","Type":"ContainerStarted","Data":"14b70d8220c1a1ef3fb2b865c8afd61b846c4b0c79b6009cd8f468cb64c3ec6b"}
Sep 08 15:51:20.546628 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:20.546601    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:20.646490 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:20.646454    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:21.210172 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:21.210138    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6" event={"ID":"6ec94781-7493-46e7-8c0d-5a9db08bbf06","Type":"ContainerStarted","Data":"b8b634b0787ece8f0d33d4d360a62a0c8205db32e90ff25cdeb19bb68c574145"}
Sep 08 15:51:21.210651 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:21.210263    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:21.229998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:21.229929    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6" podStartSLOduration=2.883502137 podStartE2EDuration="3.229912999s" totalImagesPullingTime="346.410862ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:21.22784142 +0000 UTC m=+1141.588384175" watchObservedRunningTime="2026-09-08 15:51:21.229912999 +0000 UTC m=+1141.590455765"
Sep 08 15:51:21.316354 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:21.316316    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:22.936809 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:22.936774    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:24.132860 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:24.132821    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:51:27.222223 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:27.222193    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 15:51:32.943659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:32.943622    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:35.787793 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:35.787759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:41.211262 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:41.211212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:42.722739 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:42.722644    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:43.060854 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:43.060748    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:43.394614 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:43.394576    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:43.578555 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:43.578510    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:46.661879 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:46.661841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:46.753065 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:46.753024    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:47.833529 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.833488    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"]
Sep 08 15:51:47.837231 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.837206    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:47.839734 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.839711    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-w3-642d3b-serving-cert\""
Sep 08 15:51:47.855081 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.855052    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"]
Sep 08 15:51:47.882405 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.882361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:47.955090 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.955044    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:47.955284 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.955102    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:47.955284 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.955181    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njb78\" (UniqueName: \"kubernetes.io/projected/7762d22d-1011-4030-b1e5-18aaeaf64036-kube-api-access-njb78\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:47.955284 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.955215    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7762d22d-1011-4030-b1e5-18aaeaf64036-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:47.983864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:47.983825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:48.055825 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.055788    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.056076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.055845    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.056076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.055885    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njb78\" (UniqueName: \"kubernetes.io/projected/7762d22d-1011-4030-b1e5-18aaeaf64036-kube-api-access-njb78\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.056076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.055907    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7762d22d-1011-4030-b1e5-18aaeaf64036-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.056580 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.056554    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7762d22d-1011-4030-b1e5-18aaeaf64036-openshift-service-ca\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.058407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.058382    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-maas-api-tls\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.058522 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.058386    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-metrics-certs\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.063729 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.063709    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-njb78\" (UniqueName: \"kubernetes.io/projected/7762d22d-1011-4030-b1e5-18aaeaf64036-kube-api-access-njb78\") pod \"maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.086108 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.086023    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:48.149685 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.149649    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:48.351503 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.351381    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:48.429540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.429507    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"]
Sep 08 15:51:48.429997 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:51:48.429938    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7762d22d_1011_4030_b1e5_18aaeaf64036.slice/crio-d32dd39e74fd243545d2bd260d39e6392bdc34e926e794515f0f964dda61ece3 WatchSource:0}: Error finding container d32dd39e74fd243545d2bd260d39e6392bdc34e926e794515f0f964dda61ece3: Status 404 returned error can't find the container with id d32dd39e74fd243545d2bd260d39e6392bdc34e926e794515f0f964dda61ece3
Sep 08 15:51:48.430557 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:48.430512    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:49.377203 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:49.377150    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4" event={"ID":"7762d22d-1011-4030-b1e5-18aaeaf64036","Type":"ContainerStarted","Data":"d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b"}
Sep 08 15:51:49.377697 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:49.377241    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:49.377697 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:49.377270    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4" event={"ID":"7762d22d-1011-4030-b1e5-18aaeaf64036","Type":"ContainerStarted","Data":"d32dd39e74fd243545d2bd260d39e6392bdc34e926e794515f0f964dda61ece3"}
Sep 08 15:51:49.396098 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:49.396034    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4" podStartSLOduration=1.908992741 podStartE2EDuration="2.396016677s" totalImagesPullingTime="487.023936ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:49.394994162 +0000 UTC m=+1169.755536929" watchObservedRunningTime="2026-09-08 15:51:49.396016677 +0000 UTC m=+1169.756559468"
Sep 08 15:51:49.554902 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:49.554861    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:49.877194 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:49.877152    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:50.044177 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:50.044142    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:52.731220 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:52.731173    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:52.835717 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:52.835680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:53.958504 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:53.958451    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:54.059290 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.059256    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:54.251860 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.251770    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:54.330554 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.330518    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:51:54.453472 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.453438    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:54.564942 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.564859    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"]
Sep 08 15:51:54.570476 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.570437    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:54.573650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.573617    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-mt-7eb8750f\""
Sep 08 15:51:54.579014 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.578985    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"]
Sep 08 15:51:54.630378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.630334    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"]
Sep 08 15:51:54.633842 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.633817    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:54.636418 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.636398    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-mt-7eb8750f-dockercfg-vrkkj\""
Sep 08 15:51:54.645859 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.645833    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"]
Sep 08 15:51:54.724750 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.724707    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ltl6\" (UniqueName: \"kubernetes.io/projected/efb4af03-acd9-4238-8a6b-46b2c08a5867-kube-api-access-8ltl6\") pod \"payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8\" (UID: \"efb4af03-acd9-4238-8a6b-46b2c08a5867\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:54.724945 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.724755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41eaae79-55f4-496e-81dc-99269612c628-plugins-config-volume\") pod \"payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr\" (UID: \"41eaae79-55f4-496e-81dc-99269612c628\") " pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:54.724945 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.724884    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pb5bx\" (UniqueName: \"kubernetes.io/projected/41eaae79-55f4-496e-81dc-99269612c628-kube-api-access-pb5bx\") pod \"payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr\" (UID: \"41eaae79-55f4-496e-81dc-99269612c628\") " pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:54.724945 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.724926    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb4af03-acd9-4238-8a6b-46b2c08a5867-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8\" (UID: \"efb4af03-acd9-4238-8a6b-46b2c08a5867\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:54.825856 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.825820    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pb5bx\" (UniqueName: \"kubernetes.io/projected/41eaae79-55f4-496e-81dc-99269612c628-kube-api-access-pb5bx\") pod \"payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr\" (UID: \"41eaae79-55f4-496e-81dc-99269612c628\") " pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:54.826064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.825873    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb4af03-acd9-4238-8a6b-46b2c08a5867-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8\" (UID: \"efb4af03-acd9-4238-8a6b-46b2c08a5867\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:54.826064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.825927    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ltl6\" (UniqueName: \"kubernetes.io/projected/efb4af03-acd9-4238-8a6b-46b2c08a5867-kube-api-access-8ltl6\") pod \"payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8\" (UID: \"efb4af03-acd9-4238-8a6b-46b2c08a5867\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:54.826064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.825954    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41eaae79-55f4-496e-81dc-99269612c628-plugins-config-volume\") pod \"payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr\" (UID: \"41eaae79-55f4-496e-81dc-99269612c628\") " pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:54.826647 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.826619    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb4af03-acd9-4238-8a6b-46b2c08a5867-plugins-config-volume\") pod \"payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8\" (UID: \"efb4af03-acd9-4238-8a6b-46b2c08a5867\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:54.826741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.826643    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41eaae79-55f4-496e-81dc-99269612c628-plugins-config-volume\") pod \"payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr\" (UID: \"41eaae79-55f4-496e-81dc-99269612c628\") " pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:54.834109 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.834079    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ltl6\" (UniqueName: \"kubernetes.io/projected/efb4af03-acd9-4238-8a6b-46b2c08a5867-kube-api-access-8ltl6\") pod \"payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8\" (UID: \"efb4af03-acd9-4238-8a6b-46b2c08a5867\") " pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:54.834209 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.834120    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pb5bx\" (UniqueName: \"kubernetes.io/projected/41eaae79-55f4-496e-81dc-99269612c628-kube-api-access-pb5bx\") pod \"payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr\" (UID: \"41eaae79-55f4-496e-81dc-99269612c628\") " pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:54.885793 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.885750    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:54.946839 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:54.946784    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:55.166738 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.166712    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"]
Sep 08 15:51:55.168477 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:51:55.168450    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41eaae79_55f4_496e_81dc_99269612c628.slice/crio-4fa152c7b7eb86851509f107f1e68a00accdfdb578ead21afe11e4d217cd61f4 WatchSource:0}: Error finding container 4fa152c7b7eb86851509f107f1e68a00accdfdb578ead21afe11e4d217cd61f4: Status 404 returned error can't find the container with id 4fa152c7b7eb86851509f107f1e68a00accdfdb578ead21afe11e4d217cd61f4
Sep 08 15:51:55.236286 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.236256    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"]
Sep 08 15:51:55.238191 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:51:55.238163    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podefb4af03_acd9_4238_8a6b_46b2c08a5867.slice/crio-cb062efc8c4fde9e55a718815ce163823549816e2d0d003c5e4d1971b49b0b23 WatchSource:0}: Error finding container cb062efc8c4fde9e55a718815ce163823549816e2d0d003c5e4d1971b49b0b23: Status 404 returned error can't find the container with id cb062efc8c4fde9e55a718815ce163823549816e2d0d003c5e4d1971b49b0b23
Sep 08 15:51:55.270272 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.270113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:51:55.389799 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.389749    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 15:51:55.425774 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.425669    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr" event={"ID":"41eaae79-55f4-496e-81dc-99269612c628","Type":"ContainerStarted","Data":"64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac"}
Sep 08 15:51:55.425774 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.425745    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr" event={"ID":"41eaae79-55f4-496e-81dc-99269612c628","Type":"ContainerStarted","Data":"4fa152c7b7eb86851509f107f1e68a00accdfdb578ead21afe11e4d217cd61f4"}
Sep 08 15:51:55.426039 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.425926    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:51:55.427484 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.427456    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8" event={"ID":"efb4af03-acd9-4238-8a6b-46b2c08a5867","Type":"ContainerStarted","Data":"d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd"}
Sep 08 15:51:55.427620 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.427506    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8" event={"ID":"efb4af03-acd9-4238-8a6b-46b2c08a5867","Type":"ContainerStarted","Data":"cb062efc8c4fde9e55a718815ce163823549816e2d0d003c5e4d1971b49b0b23"}
Sep 08 15:51:55.427620 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.427557    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:51:55.442865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.442808    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr" podStartSLOduration=1.442792114 podStartE2EDuration="1.442792114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:55.442093694 +0000 UTC m=+1175.802636462" watchObservedRunningTime="2026-09-08 15:51:55.442792114 +0000 UTC m=+1175.803334878"
Sep 08 15:51:55.462506 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:51:55.462441    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8" podStartSLOduration=1.462417546 podStartE2EDuration="1.462417546s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:51:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:51:55.461497832 +0000 UTC m=+1175.822040597" watchObservedRunningTime="2026-09-08 15:51:55.462417546 +0000 UTC m=+1175.822960311"
Sep 08 15:52:06.436180 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:06.436145    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:52:06.436746 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:06.436284    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:52:07.818716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:07.818674    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:52:09.671115 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:09.671065    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:11.686822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:11.686783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:14.962914 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:14.962876    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:17.833274 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:17.833226    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:20.228220 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:20.228187    2579 scope.go:117] "RemoveContainer" containerID="e4f4737e5eb0ac700a8a808f5d3816d5979ea884657766b7a3ec149ddb579f06"
Sep 08 15:52:25.049746 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:25.049708    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:32.023450 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:32.023402    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:52:34.334282 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:34.334253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:39.235397 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:39.235361    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:39.338948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:39.338879    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:48.623139 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:48.623102    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:52:52.126825 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:52.126783    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:52:59.549289 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:52:59.549251    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:02.964879 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:02.964838    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:03.831649 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:03.831616    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:53:18.197868 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.197761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:18.211061 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.211025    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"]
Sep 08 15:53:18.211308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.211265    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr" podUID="41eaae79-55f4-496e-81dc-99269612c628" containerName="payload-processing" containerID="cri-o://64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac" gracePeriod=30
Sep 08 15:53:18.219741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.219182    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"]
Sep 08 15:53:18.219741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.219422    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8" podUID="efb4af03-acd9-4238-8a6b-46b2c08a5867" containerName="payload-pre-processing" containerID="cri-o://d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd" gracePeriod=30
Sep 08 15:53:18.295330 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.295294    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:18.366812 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.366761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:18.425290 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.425253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:18.492928 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.492907    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:53:18.506228 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.506204    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:53:18.600652 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.600620    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb4af03-acd9-4238-8a6b-46b2c08a5867-plugins-config-volume\") pod \"efb4af03-acd9-4238-8a6b-46b2c08a5867\" (UID: \"efb4af03-acd9-4238-8a6b-46b2c08a5867\") "
Sep 08 15:53:18.600864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.600726    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8ltl6\" (UniqueName: \"kubernetes.io/projected/efb4af03-acd9-4238-8a6b-46b2c08a5867-kube-api-access-8ltl6\") pod \"efb4af03-acd9-4238-8a6b-46b2c08a5867\" (UID: \"efb4af03-acd9-4238-8a6b-46b2c08a5867\") "
Sep 08 15:53:18.600864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.600754    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pb5bx\" (UniqueName: \"kubernetes.io/projected/41eaae79-55f4-496e-81dc-99269612c628-kube-api-access-pb5bx\") pod \"41eaae79-55f4-496e-81dc-99269612c628\" (UID: \"41eaae79-55f4-496e-81dc-99269612c628\") "
Sep 08 15:53:18.600864 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.600788    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41eaae79-55f4-496e-81dc-99269612c628-plugins-config-volume\") pod \"41eaae79-55f4-496e-81dc-99269612c628\" (UID: \"41eaae79-55f4-496e-81dc-99269612c628\") "
Sep 08 15:53:18.601233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.601201    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/efb4af03-acd9-4238-8a6b-46b2c08a5867-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "efb4af03-acd9-4238-8a6b-46b2c08a5867" (UID: "efb4af03-acd9-4238-8a6b-46b2c08a5867"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:53:18.601308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.601235    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/41eaae79-55f4-496e-81dc-99269612c628-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "41eaae79-55f4-496e-81dc-99269612c628" (UID: "41eaae79-55f4-496e-81dc-99269612c628"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:53:18.602991 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.602951    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/41eaae79-55f4-496e-81dc-99269612c628-kube-api-access-pb5bx" (OuterVolumeSpecName: "kube-api-access-pb5bx") pod "41eaae79-55f4-496e-81dc-99269612c628" (UID: "41eaae79-55f4-496e-81dc-99269612c628"). InnerVolumeSpecName "kube-api-access-pb5bx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:53:18.603042 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.603007    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/efb4af03-acd9-4238-8a6b-46b2c08a5867-kube-api-access-8ltl6" (OuterVolumeSpecName: "kube-api-access-8ltl6") pod "efb4af03-acd9-4238-8a6b-46b2c08a5867" (UID: "efb4af03-acd9-4238-8a6b-46b2c08a5867"). InnerVolumeSpecName "kube-api-access-8ltl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:53:18.702308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.702270    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8ltl6\" (UniqueName: \"kubernetes.io/projected/efb4af03-acd9-4238-8a6b-46b2c08a5867-kube-api-access-8ltl6\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:53:18.702308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.702301    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pb5bx\" (UniqueName: \"kubernetes.io/projected/41eaae79-55f4-496e-81dc-99269612c628-kube-api-access-pb5bx\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:53:18.702308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.702311    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41eaae79-55f4-496e-81dc-99269612c628-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:53:18.702308 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.702319    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/efb4af03-acd9-4238-8a6b-46b2c08a5867-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:53:18.926956 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.926917    2579 generic.go:356] "Generic (PLEG): container finished" podID="41eaae79-55f4-496e-81dc-99269612c628" containerID="64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac" exitCode=0
Sep 08 15:53:18.927177 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.926979    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"
Sep 08 15:53:18.927177 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.927000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr" event={"ID":"41eaae79-55f4-496e-81dc-99269612c628","Type":"ContainerDied","Data":"64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac"}
Sep 08 15:53:18.927177 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.927063    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr" event={"ID":"41eaae79-55f4-496e-81dc-99269612c628","Type":"ContainerDied","Data":"4fa152c7b7eb86851509f107f1e68a00accdfdb578ead21afe11e4d217cd61f4"}
Sep 08 15:53:18.927177 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.927087    2579 scope.go:117] "RemoveContainer" containerID="64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac"
Sep 08 15:53:18.928578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.928555    2579 generic.go:356] "Generic (PLEG): container finished" podID="efb4af03-acd9-4238-8a6b-46b2c08a5867" containerID="d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd" exitCode=0
Sep 08 15:53:18.928690 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.928616    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"
Sep 08 15:53:18.928690 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.928656    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8" event={"ID":"efb4af03-acd9-4238-8a6b-46b2c08a5867","Type":"ContainerDied","Data":"d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd"}
Sep 08 15:53:18.928770 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.928708    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8" event={"ID":"efb4af03-acd9-4238-8a6b-46b2c08a5867","Type":"ContainerDied","Data":"cb062efc8c4fde9e55a718815ce163823549816e2d0d003c5e4d1971b49b0b23"}
Sep 08 15:53:18.938016 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.937993    2579 scope.go:117] "RemoveContainer" containerID="64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac"
Sep 08 15:53:18.938366 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:53:18.938317    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac\": container with ID starting with 64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac not found: ID does not exist" containerID="64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac"
Sep 08 15:53:18.938366 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.938349    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac"} err="failed to get container status \"64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac\": rpc error: code = NotFound desc = could not find container \"64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac\": container with ID starting with 64e63ac8ea5cceb7c13cd4cce6569818069004a01d8f526d4f849362ac69a3ac not found: ID does not exist"
Sep 08 15:53:18.938514 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.938372    2579 scope.go:117] "RemoveContainer" containerID="d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd"
Sep 08 15:53:18.946728 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.946712    2579 scope.go:117] "RemoveContainer" containerID="d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd"
Sep 08 15:53:18.947022 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:53:18.947002    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd\": container with ID starting with d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd not found: ID does not exist" containerID="d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd"
Sep 08 15:53:18.947079 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.947031    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd"} err="failed to get container status \"d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd\": rpc error: code = NotFound desc = could not find container \"d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd\": container with ID starting with d0770d3654bba8606ee6ed48c3609e486d78c874e833ba5f2c0b13f8f332cefd not found: ID does not exist"
Sep 08 15:53:18.950990 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.950968    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"]
Sep 08 15:53:18.955052 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.955029    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-mt-7eb8750f-64799f978f-wqgfr"]
Sep 08 15:53:18.966165 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.966142    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"]
Sep 08 15:53:18.971656 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:18.971625    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-mt-7eb8750f-74b8564fdb-n7ln8"]
Sep 08 15:53:20.115649 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:20.115617    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="41eaae79-55f4-496e-81dc-99269612c628" path="/var/lib/kubelet/pods/41eaae79-55f4-496e-81dc-99269612c628/volumes"
Sep 08 15:53:20.116026 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:20.116010    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="efb4af03-acd9-4238-8a6b-46b2c08a5867" path="/var/lib/kubelet/pods/efb4af03-acd9-4238-8a6b-46b2c08a5867/volumes"
Sep 08 15:53:21.620558 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:21.620524    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:23.629393 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:23.629355    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:53:26.701602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:26.701559    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:37.889406 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:37.889370    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:53:41.428073 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:41.428027    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:53:57.819840 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:53:57.819800    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:54:00.171889 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:00.171847    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:04.825146 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:04.825104    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:09.572405 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:09.572358    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:17.723909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:17.723864    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:54:23.891006 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:23.890947    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:23.964849 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:23.964811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:24.172472 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:24.172368    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:25.493719 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:25.493681    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:27.041016 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:27.040980    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:27.130709 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:27.130671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:27.811531 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:27.811496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:33.236683 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:33.236642    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:54:33.585602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:33.585563    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:33.684625 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:33.684585    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:34.271190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:34.271153    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:40.539743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:40.539705    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:40.609291 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:40.609255    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:40.699600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:40.699560    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:41.037754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:41.037714    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:49.831461 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:49.831418    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:54:51.247700 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:51.247659    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:51.484947 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:51.484911    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:54:56.843155 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.843122    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7781-617285"]
Sep 08 15:54:56.845483 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.843526    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="efb4af03-acd9-4238-8a6b-46b2c08a5867" containerName="payload-pre-processing"
Sep 08 15:54:56.845483 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.843537    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="efb4af03-acd9-4238-8a6b-46b2c08a5867" containerName="payload-pre-processing"
Sep 08 15:54:56.845483 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.843559    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="41eaae79-55f4-496e-81dc-99269612c628" containerName="payload-processing"
Sep 08 15:54:56.845483 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.843565    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="41eaae79-55f4-496e-81dc-99269612c628" containerName="payload-processing"
Sep 08 15:54:56.845483 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.843627    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="41eaae79-55f4-496e-81dc-99269612c628" containerName="payload-processing"
Sep 08 15:54:56.845483 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.843638    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="efb4af03-acd9-4238-8a6b-46b2c08a5867" containerName="payload-pre-processing"
Sep 08 15:54:56.846533 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.846517    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-617285"
Sep 08 15:54:56.849503 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.849486    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6hc5f\""
Sep 08 15:54:56.856696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.856658    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7781-617285"]
Sep 08 15:54:56.935882 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:56.935844    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jqkbk\" (UniqueName: \"kubernetes.io/projected/b39ce0f6-b510-46cc-ae01-fb927ae863f1-kube-api-access-jqkbk\") pod \"mt-curl-7781-617285\" (UID: \"b39ce0f6-b510-46cc-ae01-fb927ae863f1\") " pod="opendatahub/mt-curl-7781-617285"
Sep 08 15:54:57.036851 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:57.036807    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jqkbk\" (UniqueName: \"kubernetes.io/projected/b39ce0f6-b510-46cc-ae01-fb927ae863f1-kube-api-access-jqkbk\") pod \"mt-curl-7781-617285\" (UID: \"b39ce0f6-b510-46cc-ae01-fb927ae863f1\") " pod="opendatahub/mt-curl-7781-617285"
Sep 08 15:54:57.053024 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:57.052983    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jqkbk\" (UniqueName: \"kubernetes.io/projected/b39ce0f6-b510-46cc-ae01-fb927ae863f1-kube-api-access-jqkbk\") pod \"mt-curl-7781-617285\" (UID: \"b39ce0f6-b510-46cc-ae01-fb927ae863f1\") " pod="opendatahub/mt-curl-7781-617285"
Sep 08 15:54:57.156902 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:57.156813    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-617285"
Sep 08 15:54:57.431810 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:57.431782    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7781-617285"]
Sep 08 15:54:57.433501 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:54:57.433475    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb39ce0f6_b510_46cc_ae01_fb927ae863f1.slice/crio-fb91c6c58f275b3781a67f0c416d3a41d870b9db487cd9dde4eafdcb34aa1ef7 WatchSource:0}: Error finding container fb91c6c58f275b3781a67f0c416d3a41d870b9db487cd9dde4eafdcb34aa1ef7: Status 404 returned error can't find the container with id fb91c6c58f275b3781a67f0c416d3a41d870b9db487cd9dde4eafdcb34aa1ef7
Sep 08 15:54:57.504337 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:57.504300    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7781-617285" event={"ID":"b39ce0f6-b510-46cc-ae01-fb927ae863f1","Type":"ContainerStarted","Data":"fb91c6c58f275b3781a67f0c416d3a41d870b9db487cd9dde4eafdcb34aa1ef7"}
Sep 08 15:54:58.510865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:58.510773    2579 generic.go:356] "Generic (PLEG): container finished" podID="b39ce0f6-b510-46cc-ae01-fb927ae863f1" containerID="c80cc6de1961b6d8881528f95e07f78304a28ae232a815f0e5663109e5d2ddf7" exitCode=0
Sep 08 15:54:58.511267 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:58.510860    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7781-617285" event={"ID":"b39ce0f6-b510-46cc-ae01-fb927ae863f1","Type":"ContainerDied","Data":"c80cc6de1961b6d8881528f95e07f78304a28ae232a815f0e5663109e5d2ddf7"}
Sep 08 15:54:59.649671 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:59.649643    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-617285"
Sep 08 15:54:59.668844 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:59.668748    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7781-617285_b39ce0f6-b510-46cc-ae01-fb927ae863f1/mt-curl-7781-617285/0.log"
Sep 08 15:54:59.690922 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:59.690890    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7781-617285"]
Sep 08 15:54:59.694841 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:59.694811    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7781-617285"]
Sep 08 15:54:59.763608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:59.763567    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jqkbk\" (UniqueName: \"kubernetes.io/projected/b39ce0f6-b510-46cc-ae01-fb927ae863f1-kube-api-access-jqkbk\") pod \"b39ce0f6-b510-46cc-ae01-fb927ae863f1\" (UID: \"b39ce0f6-b510-46cc-ae01-fb927ae863f1\") "
Sep 08 15:54:59.765674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:59.765641    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b39ce0f6-b510-46cc-ae01-fb927ae863f1-kube-api-access-jqkbk" (OuterVolumeSpecName: "kube-api-access-jqkbk") pod "b39ce0f6-b510-46cc-ae01-fb927ae863f1" (UID: "b39ce0f6-b510-46cc-ae01-fb927ae863f1"). InnerVolumeSpecName "kube-api-access-jqkbk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:54:59.864281 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:54:59.864245    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jqkbk\" (UniqueName: \"kubernetes.io/projected/b39ce0f6-b510-46cc-ae01-fb927ae863f1-kube-api-access-jqkbk\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:55:00.114458 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:00.114415    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b39ce0f6-b510-46cc-ae01-fb927ae863f1" path="/var/lib/kubelet/pods/b39ce0f6-b510-46cc-ae01-fb927ae863f1/volumes"
Sep 08 15:55:00.524254 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:00.524165    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-617285"
Sep 08 15:55:00.524254 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:00.524218    2579 scope.go:117] "RemoveContainer" containerID="c80cc6de1961b6d8881528f95e07f78304a28ae232a815f0e5663109e5d2ddf7"
Sep 08 15:55:01.062843 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:01.062811    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:02.129086 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:02.129051    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:05.136214 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:05.136171    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:55:12.028744 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:12.028696    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:12.463801 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:12.463759    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:18.638060 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:18.638027    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:55:18.855600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:18.855557    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:18.955268 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:18.955171    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:19.233253 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:19.233129    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:19.592509 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:19.592469    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:19.808238 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:19.808198    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:22.855228 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:22.855190    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:22.950906 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:22.950869    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:24.129133 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:24.129096    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:24.255794 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:24.255761    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:24.661252 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:24.661202    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:24.859503 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:24.859465    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:24.952414 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:24.952314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:25.064316 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.064279    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"]
Sep 08 15:55:25.064710 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.064697    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b39ce0f6-b510-46cc-ae01-fb927ae863f1" containerName="mt-curl-7781-617285"
Sep 08 15:55:25.064767 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.064712    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b39ce0f6-b510-46cc-ae01-fb927ae863f1" containerName="mt-curl-7781-617285"
Sep 08 15:55:25.064811 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.064785    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b39ce0f6-b510-46cc-ae01-fb927ae863f1" containerName="mt-curl-7781-617285"
Sep 08 15:55:25.069326 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.069296    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:25.072103 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.072081    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-api-a-dfa395-dockercfg-vxw74\""
Sep 08 15:55:25.072241 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.072136    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-api-a-dfa395\""
Sep 08 15:55:25.079940 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.079914    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"]
Sep 08 15:55:25.103431 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.103397    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8f5ld\" (UniqueName: \"kubernetes.io/projected/2d924e8c-6760-47d0-9053-4861a67eaebb-kube-api-access-8f5ld\") pod \"payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8\" (UID: \"2d924e8c-6760-47d0-9053-4861a67eaebb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:25.104004 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.103557    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d924e8c-6760-47d0-9053-4861a67eaebb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8\" (UID: \"2d924e8c-6760-47d0-9053-4861a67eaebb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:25.137493 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.137462    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"]
Sep 08 15:55:25.141104 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.141086    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:25.155347 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.155319    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"]
Sep 08 15:55:25.204680 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.204582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dmmlv\" (UniqueName: \"kubernetes.io/projected/e0ec8158-156a-469b-b09e-59eb47e6e037-kube-api-access-dmmlv\") pod \"payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb\" (UID: \"e0ec8158-156a-469b-b09e-59eb47e6e037\") " pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:25.204680 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.204659    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec8158-156a-469b-b09e-59eb47e6e037-plugins-config-volume\") pod \"payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb\" (UID: \"e0ec8158-156a-469b-b09e-59eb47e6e037\") " pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:25.204922 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.204758    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d924e8c-6760-47d0-9053-4861a67eaebb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8\" (UID: \"2d924e8c-6760-47d0-9053-4861a67eaebb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:25.204922 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.204808    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8f5ld\" (UniqueName: \"kubernetes.io/projected/2d924e8c-6760-47d0-9053-4861a67eaebb-kube-api-access-8f5ld\") pod \"payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8\" (UID: \"2d924e8c-6760-47d0-9053-4861a67eaebb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:25.205540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.205513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d924e8c-6760-47d0-9053-4861a67eaebb-plugins-config-volume\") pod \"payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8\" (UID: \"2d924e8c-6760-47d0-9053-4861a67eaebb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:25.217265 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.217233    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8f5ld\" (UniqueName: \"kubernetes.io/projected/2d924e8c-6760-47d0-9053-4861a67eaebb-kube-api-access-8f5ld\") pod \"payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8\" (UID: \"2d924e8c-6760-47d0-9053-4861a67eaebb\") " pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:25.305789 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.305750    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dmmlv\" (UniqueName: \"kubernetes.io/projected/e0ec8158-156a-469b-b09e-59eb47e6e037-kube-api-access-dmmlv\") pod \"payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb\" (UID: \"e0ec8158-156a-469b-b09e-59eb47e6e037\") " pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:25.305789 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.305787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec8158-156a-469b-b09e-59eb47e6e037-plugins-config-volume\") pod \"payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb\" (UID: \"e0ec8158-156a-469b-b09e-59eb47e6e037\") " pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:25.306481 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.306461    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec8158-156a-469b-b09e-59eb47e6e037-plugins-config-volume\") pod \"payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb\" (UID: \"e0ec8158-156a-469b-b09e-59eb47e6e037\") " pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:25.319629 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.319599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dmmlv\" (UniqueName: \"kubernetes.io/projected/e0ec8158-156a-469b-b09e-59eb47e6e037-kube-api-access-dmmlv\") pod \"payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb\" (UID: \"e0ec8158-156a-469b-b09e-59eb47e6e037\") " pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:25.381270 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.381192    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:25.451664 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.451636    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:25.657894 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.657865    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"]
Sep 08 15:55:25.659345 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:55:25.659315    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d924e8c_6760_47d0_9053_4861a67eaebb.slice/crio-2392faded280958afe4e7ac87a1867955003feea4198066ed58e31be39233091 WatchSource:0}: Error finding container 2392faded280958afe4e7ac87a1867955003feea4198066ed58e31be39233091: Status 404 returned error can't find the container with id 2392faded280958afe4e7ac87a1867955003feea4198066ed58e31be39233091
Sep 08 15:55:25.672166 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.672134    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8" event={"ID":"2d924e8c-6760-47d0-9053-4861a67eaebb","Type":"ContainerStarted","Data":"2392faded280958afe4e7ac87a1867955003feea4198066ed58e31be39233091"}
Sep 08 15:55:25.743407 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:25.743377    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"]
Sep 08 15:55:25.745656 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:55:25.745593    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0ec8158_156a_469b_b09e_59eb47e6e037.slice/crio-24c6e2210c8949298be1ad6f5764c78fd9d1b8159c82311d37ccf64f04b23744 WatchSource:0}: Error finding container 24c6e2210c8949298be1ad6f5764c78fd9d1b8159c82311d37ccf64f04b23744: Status 404 returned error can't find the container with id 24c6e2210c8949298be1ad6f5764c78fd9d1b8159c82311d37ccf64f04b23744
Sep 08 15:55:26.681319 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:26.681278    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8" event={"ID":"2d924e8c-6760-47d0-9053-4861a67eaebb","Type":"ContainerStarted","Data":"41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070"}
Sep 08 15:55:26.681821 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:26.681501    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:26.683283 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:26.683256    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb" event={"ID":"e0ec8158-156a-469b-b09e-59eb47e6e037","Type":"ContainerStarted","Data":"4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1"}
Sep 08 15:55:26.683424 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:26.683299    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb" event={"ID":"e0ec8158-156a-469b-b09e-59eb47e6e037","Type":"ContainerStarted","Data":"24c6e2210c8949298be1ad6f5764c78fd9d1b8159c82311d37ccf64f04b23744"}
Sep 08 15:55:26.683424 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:26.683328    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:26.702330 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:26.702275    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8" podStartSLOduration=1.702261339 podStartE2EDuration="1.702261339s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:26.700757296 +0000 UTC m=+1387.061300061" watchObservedRunningTime="2026-09-08 15:55:26.702261339 +0000 UTC m=+1387.062804107"
Sep 08 15:55:26.721908 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:26.721852    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb" podStartSLOduration=1.721834796 podStartE2EDuration="1.721834796s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:26.719793819 +0000 UTC m=+1387.080336580" watchObservedRunningTime="2026-09-08 15:55:26.721834796 +0000 UTC m=+1387.082377560"
Sep 08 15:55:33.929399 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:33.929361    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:55:37.692822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:37.692789    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:55:37.693236 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:37.692867    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:55:45.559399 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:45.559347    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:46.157507 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:46.157464    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:47.896468 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:47.896420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:48.403225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.403189    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:48.662629 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.662526    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"]
Sep 08 15:55:48.668194 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.668155    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.670848 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.670821    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-9a16f5-openshift-default-dockercfg-ltmrc\""
Sep 08 15:55:48.671184 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.671158    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:55:48.676982 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.676944    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"]
Sep 08 15:55:48.684439 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.684411    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:48.734796 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.734745    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-credential-socket\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.734796 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.734798    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-certs\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.735112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.734864    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-data\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.735112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.734900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8cgp\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-kube-api-access-m8cgp\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.735112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.734923    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43efa711-8602-4463-8689-ad05b727bcdd-istio-podinfo\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.735112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.734992    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43efa711-8602-4463-8689-ad05b727bcdd-istiod-ca-cert\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.735112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.735038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-envoy\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.735112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.735083    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-socket\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.735350 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.735135    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-istio-token\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835644 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835604    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8cgp\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-kube-api-access-m8cgp\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835644 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835642    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43efa711-8602-4463-8689-ad05b727bcdd-istio-podinfo\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835666    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43efa711-8602-4463-8689-ad05b727bcdd-istiod-ca-cert\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835693    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-envoy\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835720    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-socket\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835743    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-istio-token\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835784    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-credential-socket\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835817    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-certs\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.835909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.835861    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-data\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.836351 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.836258    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-credential-socket\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.836351 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.836287    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-data\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.836351 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.836329    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-certs\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.836500 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.836383    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-socket\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.836776 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.836752    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43efa711-8602-4463-8689-ad05b727bcdd-istiod-ca-cert\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.838241 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.838178    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-envoy\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.838413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.838389    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43efa711-8602-4463-8689-ad05b727bcdd-istio-podinfo\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.843898 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.843868    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-istio-token\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.844031 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.843989    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8cgp\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-kube-api-access-m8cgp\") pod \"e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") " pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:48.965987 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.965849    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:48.983781 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:48.983748    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:49.265979 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:49.265928    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"]
Sep 08 15:55:49.268103 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:55:49.268064    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43efa711_8602_4463_8689_ad05b727bcdd.slice/crio-9485060e44433602d0ac4c8700321ec158765561c4578730d1f64175063c591c WatchSource:0}: Error finding container 9485060e44433602d0ac4c8700321ec158765561c4578730d1f64175063c591c: Status 404 returned error can't find the container with id 9485060e44433602d0ac4c8700321ec158765561c4578730d1f64175063c591c
Sep 08 15:55:49.270865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:49.270828    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:55:49.270983 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:49.270914    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:55:49.270983 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:49.270955    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:55:49.829295 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:49.829251    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" event={"ID":"43efa711-8602-4463-8689-ad05b727bcdd","Type":"ContainerStarted","Data":"c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091"}
Sep 08 15:55:49.829483 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:49.829317    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" event={"ID":"43efa711-8602-4463-8689-ad05b727bcdd","Type":"ContainerStarted","Data":"9485060e44433602d0ac4c8700321ec158765561c4578730d1f64175063c591c"}
Sep 08 15:55:49.852942 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:49.852887    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" podStartSLOduration=1.852871218 podStartE2EDuration="1.852871218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:49.850228154 +0000 UTC m=+1410.210770919" watchObservedRunningTime="2026-09-08 15:55:49.852871218 +0000 UTC m=+1410.213414054"
Sep 08 15:55:49.984055 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:49.984020    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:50.989650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:50.989616    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:51.802311 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:51.802273    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:51.840749 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:51.840715    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:51.841804 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:51.841785    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:55:51.870551 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:51.870516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:52.193735 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.193695    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:55:52.953578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.953525    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"]
Sep 08 15:55:52.957348 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.957324    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:52.960784 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.960144    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-9a16f5-serving-cert\""
Sep 08 15:55:52.971053 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.971024    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"]
Sep 08 15:55:52.977168 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.977101    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa938c06-9112-4d27-bfbf-b8c3032dcf69-openshift-service-ca\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:52.977827 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.977801    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:52.978057 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.978038    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7v5qr\" (UniqueName: \"kubernetes.io/projected/fa938c06-9112-4d27-bfbf-b8c3032dcf69-kube-api-access-7v5qr\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:52.978255 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.978223    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-metrics-certs\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:52.988729 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:52.988697    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:53.079890 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.079843    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa938c06-9112-4d27-bfbf-b8c3032dcf69-openshift-service-ca\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.080118 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.079900    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.080118 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.079939    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7v5qr\" (UniqueName: \"kubernetes.io/projected/fa938c06-9112-4d27-bfbf-b8c3032dcf69-kube-api-access-7v5qr\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.080118 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.080005    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-metrics-certs\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.080118 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:55:53.080091    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-serving-cert: secret "maas-api-e2e-api-b-9a16f5-serving-cert" not found
Sep 08 15:55:53.080360 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:55:53.080186    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls podName:fa938c06-9112-4d27-bfbf-b8c3032dcf69 nodeName:}" failed. No retries permitted until 2026-09-08 15:55:53.580163167 +0000 UTC m=+1413.940705924 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls") pod "maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw" (UID: "fa938c06-9112-4d27-bfbf-b8c3032dcf69") : secret "maas-api-e2e-api-b-9a16f5-serving-cert" not found
Sep 08 15:55:53.080675 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.080649    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa938c06-9112-4d27-bfbf-b8c3032dcf69-openshift-service-ca\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.082833 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.082798    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-metrics-certs\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.089293 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.089268    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7v5qr\" (UniqueName: \"kubernetes.io/projected/fa938c06-9112-4d27-bfbf-b8c3032dcf69-kube-api-access-7v5qr\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.089564 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.089528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:53.585666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.585630    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.588207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.588185    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls\") pod \"maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:53.875208 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:53.875101    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:54.156921 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:54.156894    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"]
Sep 08 15:55:54.158094 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:55:54.158065    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfa938c06_9112_4d27_bfbf_b8c3032dcf69.slice/crio-7f874571231b793864aeb84a9a5169e060fd7fdc13a5a128d739f764c9215865 WatchSource:0}: Error finding container 7f874571231b793864aeb84a9a5169e060fd7fdc13a5a128d739f764c9215865: Status 404 returned error can't find the container with id 7f874571231b793864aeb84a9a5169e060fd7fdc13a5a128d739f764c9215865
Sep 08 15:55:54.159721 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:54.159699    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 15:55:54.862400 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:54.862362    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw" event={"ID":"fa938c06-9112-4d27-bfbf-b8c3032dcf69","Type":"ContainerStarted","Data":"7f874571231b793864aeb84a9a5169e060fd7fdc13a5a128d739f764c9215865"}
Sep 08 15:55:55.199254 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:55.199158    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:55.299738 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:55.299700    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:55:55.870830 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:55.870774    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw" event={"ID":"fa938c06-9112-4d27-bfbf-b8c3032dcf69","Type":"ContainerStarted","Data":"fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b"}
Sep 08 15:55:55.871356 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:55.870877    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:55:55.893030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:55:55.892954    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw" podStartSLOduration=3.105983788 podStartE2EDuration="3.892937572s" totalImagesPullingTime="786.953784ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:55:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:55:55.892725002 +0000 UTC m=+1416.253267787" watchObservedRunningTime="2026-09-08 15:55:55.892937572 +0000 UTC m=+1416.253480337"
Sep 08 15:56:01.883866 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:01.883835    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:56:05.713592 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:05.713546    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:12.425067 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:12.424977    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:56:12.979143 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:12.979108    2579 generic.go:356] "Generic (PLEG): container finished" podID="43efa711-8602-4463-8689-ad05b727bcdd" containerID="c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091" exitCode=0
Sep 08 15:56:12.979363 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:12.979156    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" event={"ID":"43efa711-8602-4463-8689-ad05b727bcdd","Type":"ContainerDied","Data":"c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091"}
Sep 08 15:56:12.979578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:12.979565    2579 scope.go:117] "RemoveContainer" containerID="c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091"
Sep 08 15:56:12.980933 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:12.980895    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:56:12.981051 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:12.980997    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:56:12.981051 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:12.981035    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:56:14.005272 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:14.005236    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" event={"ID":"43efa711-8602-4463-8689-ad05b727bcdd","Type":"ContainerStarted","Data":"1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc"}
Sep 08 15:56:14.007855 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:14.007828    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:14.984799 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:14.984766    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:56:14.985394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:14.985133    2579 patch_prober.go:28] interesting pod/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:56:14.985573 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:14.985549    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 15:56:15.985067 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:15.985026    2579 patch_prober.go:28] interesting pod/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:56:15.985721 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:15.985683    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 15:56:16.984932 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:16.984893    2579 patch_prober.go:28] interesting pod/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:56:16.985354 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:16.985328    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 15:56:17.402625 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:17.402583    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:17.984766 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:17.984718    2579 patch_prober.go:28] interesting pod/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused" start-of-body=
Sep 08 15:56:17.985011 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:17.984790    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.81:15021/healthz/ready\": dial tcp 10.132.0.81:15021: connect: connection refused"
Sep 08 15:56:19.190547 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:19.190504    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:56:19.191067 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:19.190833    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:56:19.192199 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:19.192175    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:56:20.063569 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:20.063537    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:30.126463 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:30.126425    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:56:33.667760 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:33.667712    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:35.395626 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.395593    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:35.446943 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.446141    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"]
Sep 08 15:56:35.446943 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.446417    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb" podUID="e0ec8158-156a-469b-b09e-59eb47e6e037" containerName="payload-processing" containerID="cri-o://4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1" gracePeriod=30
Sep 08 15:56:35.450457 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.450426    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"]
Sep 08 15:56:35.450680 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.450654    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8" podUID="2d924e8c-6760-47d0-9053-4861a67eaebb" containerName="payload-pre-processing" containerID="cri-o://41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070" gracePeriod=30
Sep 08 15:56:35.467552 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.467482    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:35.619934 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.619799    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:35.695256 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.695213    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:35.764287 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.764261    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:56:35.767400 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.767376    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:56:35.817266 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.817227    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dmmlv\" (UniqueName: \"kubernetes.io/projected/e0ec8158-156a-469b-b09e-59eb47e6e037-kube-api-access-dmmlv\") pod \"e0ec8158-156a-469b-b09e-59eb47e6e037\" (UID: \"e0ec8158-156a-469b-b09e-59eb47e6e037\") "
Sep 08 15:56:35.817443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.817294    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d924e8c-6760-47d0-9053-4861a67eaebb-plugins-config-volume\") pod \"2d924e8c-6760-47d0-9053-4861a67eaebb\" (UID: \"2d924e8c-6760-47d0-9053-4861a67eaebb\") "
Sep 08 15:56:35.817443 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.817330    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec8158-156a-469b-b09e-59eb47e6e037-plugins-config-volume\") pod \"e0ec8158-156a-469b-b09e-59eb47e6e037\" (UID: \"e0ec8158-156a-469b-b09e-59eb47e6e037\") "
Sep 08 15:56:35.817741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.817716    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2d924e8c-6760-47d0-9053-4861a67eaebb-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "2d924e8c-6760-47d0-9053-4861a67eaebb" (UID: "2d924e8c-6760-47d0-9053-4861a67eaebb"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:56:35.817808 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.817784    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0ec8158-156a-469b-b09e-59eb47e6e037-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e0ec8158-156a-469b-b09e-59eb47e6e037" (UID: "e0ec8158-156a-469b-b09e-59eb47e6e037"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:56:35.819522 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.819499    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0ec8158-156a-469b-b09e-59eb47e6e037-kube-api-access-dmmlv" (OuterVolumeSpecName: "kube-api-access-dmmlv") pod "e0ec8158-156a-469b-b09e-59eb47e6e037" (UID: "e0ec8158-156a-469b-b09e-59eb47e6e037"). InnerVolumeSpecName "kube-api-access-dmmlv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:56:35.918675 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.918641    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8f5ld\" (UniqueName: \"kubernetes.io/projected/2d924e8c-6760-47d0-9053-4861a67eaebb-kube-api-access-8f5ld\") pod \"2d924e8c-6760-47d0-9053-4861a67eaebb\" (UID: \"2d924e8c-6760-47d0-9053-4861a67eaebb\") "
Sep 08 15:56:35.918850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.918830    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dmmlv\" (UniqueName: \"kubernetes.io/projected/e0ec8158-156a-469b-b09e-59eb47e6e037-kube-api-access-dmmlv\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:35.918850 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.918842    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/2d924e8c-6760-47d0-9053-4861a67eaebb-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:35.918926 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.918850    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e0ec8158-156a-469b-b09e-59eb47e6e037-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:35.920683 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.920660    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d924e8c-6760-47d0-9053-4861a67eaebb-kube-api-access-8f5ld" (OuterVolumeSpecName: "kube-api-access-8f5ld") pod "2d924e8c-6760-47d0-9053-4861a67eaebb" (UID: "2d924e8c-6760-47d0-9053-4861a67eaebb"). InnerVolumeSpecName "kube-api-access-8f5ld". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:56:35.954318 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:35.954227    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:36.020325 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.020291    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8f5ld\" (UniqueName: \"kubernetes.io/projected/2d924e8c-6760-47d0-9053-4861a67eaebb-kube-api-access-8f5ld\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:36.136009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.135979    2579 generic.go:356] "Generic (PLEG): container finished" podID="2d924e8c-6760-47d0-9053-4861a67eaebb" containerID="41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070" exitCode=0
Sep 08 15:56:36.136168 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.136015    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"
Sep 08 15:56:36.136168 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.136057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8" event={"ID":"2d924e8c-6760-47d0-9053-4861a67eaebb","Type":"ContainerDied","Data":"41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070"}
Sep 08 15:56:36.136168 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.136119    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8" event={"ID":"2d924e8c-6760-47d0-9053-4861a67eaebb","Type":"ContainerDied","Data":"2392faded280958afe4e7ac87a1867955003feea4198066ed58e31be39233091"}
Sep 08 15:56:36.136168 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.136144    2579 scope.go:117] "RemoveContainer" containerID="41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070"
Sep 08 15:56:36.137483 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.137461    2579 generic.go:356] "Generic (PLEG): container finished" podID="e0ec8158-156a-469b-b09e-59eb47e6e037" containerID="4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1" exitCode=0
Sep 08 15:56:36.137550 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.137517    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"
Sep 08 15:56:36.137600 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.137559    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb" event={"ID":"e0ec8158-156a-469b-b09e-59eb47e6e037","Type":"ContainerDied","Data":"4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1"}
Sep 08 15:56:36.137648 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.137619    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb" event={"ID":"e0ec8158-156a-469b-b09e-59eb47e6e037","Type":"ContainerDied","Data":"24c6e2210c8949298be1ad6f5764c78fd9d1b8159c82311d37ccf64f04b23744"}
Sep 08 15:56:36.145787 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.145768    2579 scope.go:117] "RemoveContainer" containerID="41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070"
Sep 08 15:56:36.146087 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:56:36.146065    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070\": container with ID starting with 41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070 not found: ID does not exist" containerID="41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070"
Sep 08 15:56:36.146134 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.146095    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070"} err="failed to get container status \"41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070\": rpc error: code = NotFound desc = could not find container \"41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070\": container with ID starting with 41706ddb4f7ec3c9aff3b71b00c1a6df07b8a617b31a1dd21d002f8f7a8db070 not found: ID does not exist"
Sep 08 15:56:36.146134 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.146112    2579 scope.go:117] "RemoveContainer" containerID="4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1"
Sep 08 15:56:36.154052 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.154021    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"]
Sep 08 15:56:36.154691 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.154637    2579 scope.go:117] "RemoveContainer" containerID="4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1"
Sep 08 15:56:36.155160 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:56:36.155131    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1\": container with ID starting with 4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1 not found: ID does not exist" containerID="4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1"
Sep 08 15:56:36.155261 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.155170    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1"} err="failed to get container status \"4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1\": rpc error: code = NotFound desc = could not find container \"4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1\": container with ID starting with 4c27b17c1c937ce5eed6e15858a3ab815fadf891012815a1246131c77736e5e1 not found: ID does not exist"
Sep 08 15:56:36.157798 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.157779    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-api-a-dfa395-7bd86bc9cd-lp5b8"]
Sep 08 15:56:36.169548 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.169521    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"]
Sep 08 15:56:36.176375 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:36.176351    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-api-a-dfa395-6b68b5db75-sqpxb"]
Sep 08 15:56:38.114846 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:38.114809    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d924e8c-6760-47d0-9053-4861a67eaebb" path="/var/lib/kubelet/pods/2d924e8c-6760-47d0-9053-4861a67eaebb/volumes"
Sep 08 15:56:38.115247 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:38.115232    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0ec8158-156a-469b-b09e-59eb47e6e037" path="/var/lib/kubelet/pods/e0ec8158-156a-469b-b09e-59eb47e6e037/volumes"
Sep 08 15:56:42.064784 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:42.064742    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:42.170388 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:42.170332    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:42.367354 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:42.367304    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:43.507587 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:43.507548    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:46.606923 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.606883    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/mt-curl-7781-3fb493"]
Sep 08 15:56:46.607519 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.607498    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0ec8158-156a-469b-b09e-59eb47e6e037" containerName="payload-processing"
Sep 08 15:56:46.607605 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.607523    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0ec8158-156a-469b-b09e-59eb47e6e037" containerName="payload-processing"
Sep 08 15:56:46.607605 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.607554    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d924e8c-6760-47d0-9053-4861a67eaebb" containerName="payload-pre-processing"
Sep 08 15:56:46.607605 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.607564    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d924e8c-6760-47d0-9053-4861a67eaebb" containerName="payload-pre-processing"
Sep 08 15:56:46.607754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.607679    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0ec8158-156a-469b-b09e-59eb47e6e037" containerName="payload-processing"
Sep 08 15:56:46.607754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.607692    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d924e8c-6760-47d0-9053-4861a67eaebb" containerName="payload-pre-processing"
Sep 08 15:56:46.612424 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.612404    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-3fb493"
Sep 08 15:56:46.615327 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.615300    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-6hc5f\""
Sep 08 15:56:46.617577 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.617554    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7781-3fb493"]
Sep 08 15:56:46.725185 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.725149    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qz9dr\" (UniqueName: \"kubernetes.io/projected/e50ac118-b298-440d-a62e-e3db88fefcce-kube-api-access-qz9dr\") pod \"mt-curl-7781-3fb493\" (UID: \"e50ac118-b298-440d-a62e-e3db88fefcce\") " pod="opendatahub/mt-curl-7781-3fb493"
Sep 08 15:56:46.826417 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.826361    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qz9dr\" (UniqueName: \"kubernetes.io/projected/e50ac118-b298-440d-a62e-e3db88fefcce-kube-api-access-qz9dr\") pod \"mt-curl-7781-3fb493\" (UID: \"e50ac118-b298-440d-a62e-e3db88fefcce\") " pod="opendatahub/mt-curl-7781-3fb493"
Sep 08 15:56:46.835154 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.835122    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qz9dr\" (UniqueName: \"kubernetes.io/projected/e50ac118-b298-440d-a62e-e3db88fefcce-kube-api-access-qz9dr\") pod \"mt-curl-7781-3fb493\" (UID: \"e50ac118-b298-440d-a62e-e3db88fefcce\") " pod="opendatahub/mt-curl-7781-3fb493"
Sep 08 15:56:46.923429 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:46.923327    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-3fb493"
Sep 08 15:56:47.202794 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:47.202769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/mt-curl-7781-3fb493"]
Sep 08 15:56:47.204719 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:56:47.204687    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode50ac118_b298_440d_a62e_e3db88fefcce.slice/crio-96344d7728666eff3f5e06867c9a2a7e375089a689758641203d52adb4919ce9 WatchSource:0}: Error finding container 96344d7728666eff3f5e06867c9a2a7e375089a689758641203d52adb4919ce9: Status 404 returned error can't find the container with id 96344d7728666eff3f5e06867c9a2a7e375089a689758641203d52adb4919ce9
Sep 08 15:56:48.215822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:48.215726    2579 generic.go:356] "Generic (PLEG): container finished" podID="e50ac118-b298-440d-a62e-e3db88fefcce" containerID="aebdfe83414e339480e1b12bf01ff9d7a0630b4601c8f7a15418a7545744a292" exitCode=0
Sep 08 15:56:48.216269 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:48.215823    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7781-3fb493" event={"ID":"e50ac118-b298-440d-a62e-e3db88fefcce","Type":"ContainerDied","Data":"aebdfe83414e339480e1b12bf01ff9d7a0630b4601c8f7a15418a7545744a292"}
Sep 08 15:56:48.216269 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:48.215870    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/mt-curl-7781-3fb493" event={"ID":"e50ac118-b298-440d-a62e-e3db88fefcce","Type":"ContainerStarted","Data":"96344d7728666eff3f5e06867c9a2a7e375089a689758641203d52adb4919ce9"}
Sep 08 15:56:48.364919 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:48.364886    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:49.355601 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:49.355575    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-3fb493"
Sep 08 15:56:49.374223 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:49.374094    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_mt-curl-7781-3fb493_e50ac118-b298-440d-a62e-e3db88fefcce/mt-curl-7781-3fb493/0.log"
Sep 08 15:56:49.398540 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:49.398499    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/mt-curl-7781-3fb493"]
Sep 08 15:56:49.400954 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:49.400923    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/mt-curl-7781-3fb493"]
Sep 08 15:56:49.450732 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:49.450688    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qz9dr\" (UniqueName: \"kubernetes.io/projected/e50ac118-b298-440d-a62e-e3db88fefcce-kube-api-access-qz9dr\") pod \"e50ac118-b298-440d-a62e-e3db88fefcce\" (UID: \"e50ac118-b298-440d-a62e-e3db88fefcce\") "
Sep 08 15:56:49.452781 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:49.452748    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e50ac118-b298-440d-a62e-e3db88fefcce-kube-api-access-qz9dr" (OuterVolumeSpecName: "kube-api-access-qz9dr") pod "e50ac118-b298-440d-a62e-e3db88fefcce" (UID: "e50ac118-b298-440d-a62e-e3db88fefcce"). InnerVolumeSpecName "kube-api-access-qz9dr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:56:49.551998 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:49.551889    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qz9dr\" (UniqueName: \"kubernetes.io/projected/e50ac118-b298-440d-a62e-e3db88fefcce-kube-api-access-qz9dr\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:49.630525 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:49.630483    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:56:50.116592 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:50.116550    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e50ac118-b298-440d-a62e-e3db88fefcce" path="/var/lib/kubelet/pods/e50ac118-b298-440d-a62e-e3db88fefcce/volumes"
Sep 08 15:56:50.229021 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:50.228990    2579 scope.go:117] "RemoveContainer" containerID="aebdfe83414e339480e1b12bf01ff9d7a0630b4601c8f7a15418a7545744a292"
Sep 08 15:56:50.229021 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:50.229012    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/mt-curl-7781-3fb493"
Sep 08 15:56:51.487898 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:51.487862    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:52.439238 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:52.439187    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:58.163757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.163726    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"]
Sep 08 15:56:58.164257 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.164033    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw" podUID="fa938c06-9112-4d27-bfbf-b8c3032dcf69" containerName="maas-api" containerID="cri-o://fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b" gracePeriod=30
Sep 08 15:56:58.192559 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.192528    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:58.262027 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.261950    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:58.427348 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.427285    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:56:58.539820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.539778    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7v5qr\" (UniqueName: \"kubernetes.io/projected/fa938c06-9112-4d27-bfbf-b8c3032dcf69-kube-api-access-7v5qr\") pod \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") "
Sep 08 15:56:58.540038 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.539906    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls\") pod \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") "
Sep 08 15:56:58.540038 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.539937    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-metrics-certs\") pod \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") "
Sep 08 15:56:58.540182 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.540062    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa938c06-9112-4d27-bfbf-b8c3032dcf69-openshift-service-ca\") pod \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\" (UID: \"fa938c06-9112-4d27-bfbf-b8c3032dcf69\") "
Sep 08 15:56:58.540581 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.540542    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fa938c06-9112-4d27-bfbf-b8c3032dcf69-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "fa938c06-9112-4d27-bfbf-b8c3032dcf69" (UID: "fa938c06-9112-4d27-bfbf-b8c3032dcf69"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:56:58.542421 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.542383    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "fa938c06-9112-4d27-bfbf-b8c3032dcf69" (UID: "fa938c06-9112-4d27-bfbf-b8c3032dcf69"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:56:58.542548 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.542455    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "fa938c06-9112-4d27-bfbf-b8c3032dcf69" (UID: "fa938c06-9112-4d27-bfbf-b8c3032dcf69"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:56:58.542548 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.542476    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fa938c06-9112-4d27-bfbf-b8c3032dcf69-kube-api-access-7v5qr" (OuterVolumeSpecName: "kube-api-access-7v5qr") pod "fa938c06-9112-4d27-bfbf-b8c3032dcf69" (UID: "fa938c06-9112-4d27-bfbf-b8c3032dcf69"). InnerVolumeSpecName "kube-api-access-7v5qr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:56:58.641214 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.641174    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:58.641214 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.641208    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/fa938c06-9112-4d27-bfbf-b8c3032dcf69-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:58.641214 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.641218    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/fa938c06-9112-4d27-bfbf-b8c3032dcf69-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:58.641455 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.641228    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7v5qr\" (UniqueName: \"kubernetes.io/projected/fa938c06-9112-4d27-bfbf-b8c3032dcf69-kube-api-access-7v5qr\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:56:58.746789 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.746699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:58.847424 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:58.847383    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:56:59.286388 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.286354    2579 generic.go:356] "Generic (PLEG): container finished" podID="fa938c06-9112-4d27-bfbf-b8c3032dcf69" containerID="fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b" exitCode=0
Sep 08 15:56:59.286793 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.286423    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"
Sep 08 15:56:59.286793 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.286439    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw" event={"ID":"fa938c06-9112-4d27-bfbf-b8c3032dcf69","Type":"ContainerDied","Data":"fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b"}
Sep 08 15:56:59.286793 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.286496    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw" event={"ID":"fa938c06-9112-4d27-bfbf-b8c3032dcf69","Type":"ContainerDied","Data":"7f874571231b793864aeb84a9a5169e060fd7fdc13a5a128d739f764c9215865"}
Sep 08 15:56:59.286793 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.286520    2579 scope.go:117] "RemoveContainer" containerID="fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b"
Sep 08 15:56:59.296551 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.296534    2579 scope.go:117] "RemoveContainer" containerID="fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b"
Sep 08 15:56:59.296860 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:56:59.296835    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b\": container with ID starting with fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b not found: ID does not exist" containerID="fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b"
Sep 08 15:56:59.296934 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.296875    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b"} err="failed to get container status \"fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b\": rpc error: code = NotFound desc = could not find container \"fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b\": container with ID starting with fac985712a531c67e52007a92746feb34e724d6394057a9dca05cc854214809b not found: ID does not exist"
Sep 08 15:56:59.308273 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.308248    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"]
Sep 08 15:56:59.314841 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:56:59.314817    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-9a16f5-598b5d9594-lhgvw"]
Sep 08 15:57:00.114702 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:00.114668    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fa938c06-9112-4d27-bfbf-b8c3032dcf69" path="/var/lib/kubelet/pods/fa938c06-9112-4d27-bfbf-b8c3032dcf69/volumes"
Sep 08 15:57:03.923653 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:03.923611    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:57:04.473831 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:04.473793    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:05.192871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:05.192837    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:05.291371 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:05.291334    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:05.442477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:05.442441    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"]
Sep 08 15:57:05.442725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:05.442700    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy" containerID="cri-o://1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc" gracePeriod=30
Sep 08 15:57:05.455929 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:05.455901    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:06.053687 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:06.053636    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:10.502918 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.502881    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:10.717948 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.717878    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:57:10.857523 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43efa711-8602-4463-8689-ad05b727bcdd-istio-podinfo\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.857754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857562    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-data\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.857754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857587    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-istio-token\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.857754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857610    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-credential-socket\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.857754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43efa711-8602-4463-8689-ad05b727bcdd-istiod-ca-cert\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.857754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857699    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-envoy\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.857754 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857727    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m8cgp\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-kube-api-access-m8cgp\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.858134 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857774    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-socket\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.858134 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.857802    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-certs\") pod \"43efa711-8602-4463-8689-ad05b727bcdd\" (UID: \"43efa711-8602-4463-8689-ad05b727bcdd\") "
Sep 08 15:57:10.858134 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.858003    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-data" (OuterVolumeSpecName: "istio-data") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:57:10.858134 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.858113    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:57:10.858357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.858181    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:10.858357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.858206    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:57:10.858357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.858233    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43efa711-8602-4463-8689-ad05b727bcdd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:57:10.858357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.858327    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:57:10.860120 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.860071    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-kube-api-access-m8cgp" (OuterVolumeSpecName: "kube-api-access-m8cgp") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "kube-api-access-m8cgp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:57:10.860120 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.860102    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:57:10.860281 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.860186    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-istio-token" (OuterVolumeSpecName: "istio-token") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:57:10.860281 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.860196    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43efa711-8602-4463-8689-ad05b727bcdd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43efa711-8602-4463-8689-ad05b727bcdd" (UID: "43efa711-8602-4463-8689-ad05b727bcdd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 15:57:10.959659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.959627    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:10.959659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.959655    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:10.959659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.959666    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43efa711-8602-4463-8689-ad05b727bcdd-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:10.959905 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.959674    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:10.959905 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.959683    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:10.959905 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.959692    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43efa711-8602-4463-8689-ad05b727bcdd-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:10.959905 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.959700    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43efa711-8602-4463-8689-ad05b727bcdd-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:10.959905 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:10.959708    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m8cgp\" (UniqueName: \"kubernetes.io/projected/43efa711-8602-4463-8689-ad05b727bcdd-kube-api-access-m8cgp\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:11.362833 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.362798    2579 generic.go:356] "Generic (PLEG): container finished" podID="43efa711-8602-4463-8689-ad05b727bcdd" containerID="1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc" exitCode=0
Sep 08 15:57:11.363077 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.362861    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"
Sep 08 15:57:11.363077 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.362894    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" event={"ID":"43efa711-8602-4463-8689-ad05b727bcdd","Type":"ContainerDied","Data":"1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc"}
Sep 08 15:57:11.363077 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.362956    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j" event={"ID":"43efa711-8602-4463-8689-ad05b727bcdd","Type":"ContainerDied","Data":"9485060e44433602d0ac4c8700321ec158765561c4578730d1f64175063c591c"}
Sep 08 15:57:11.363077 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.362997    2579 scope.go:117] "RemoveContainer" containerID="1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc"
Sep 08 15:57:11.374126 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.374108    2579 scope.go:117] "RemoveContainer" containerID="c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091"
Sep 08 15:57:11.382935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.382918    2579 scope.go:117] "RemoveContainer" containerID="1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc"
Sep 08 15:57:11.383264 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:57:11.383240    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc\": container with ID starting with 1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc not found: ID does not exist" containerID="1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc"
Sep 08 15:57:11.383314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.383273    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc"} err="failed to get container status \"1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc\": rpc error: code = NotFound desc = could not find container \"1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc\": container with ID starting with 1fa99ed7458647cf35f1a2243fe5f3a46bd0fe65949d931ab044531cd65ad7fc not found: ID does not exist"
Sep 08 15:57:11.383314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.383290    2579 scope.go:117] "RemoveContainer" containerID="c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091"
Sep 08 15:57:11.383515 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:57:11.383501    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091\": container with ID starting with c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091 not found: ID does not exist" containerID="c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091"
Sep 08 15:57:11.383561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.383516    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091"} err="failed to get container status \"c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091\": rpc error: code = NotFound desc = could not find container \"c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091\": container with ID starting with c3e2f1098b76448fe59636edbd72c6123286de239560436c511ffb6884518091 not found: ID does not exist"
Sep 08 15:57:11.388484 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.388462    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"]
Sep 08 15:57:11.392258 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:11.392236    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-9a16f5-openshift-default-65ff96fd54-csq4j"]
Sep 08 15:57:12.114628 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:12.114594    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43efa711-8602-4463-8689-ad05b727bcdd" path="/var/lib/kubelet/pods/43efa711-8602-4463-8689-ad05b727bcdd/volumes"
Sep 08 15:57:15.970922 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:15.970888    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:16.510828 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.510797    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"]
Sep 08 15:57:16.511101 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.511013    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4" podUID="a7370dc4-8313-436b-84fa-4e69b8b4ab1a" containerName="maas-api" containerID="cri-o://0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234" gracePeriod=30
Sep 08 15:57:16.531762 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.531716    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:16.554100 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.554067    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"]
Sep 08 15:57:16.554334 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.554302    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq" podUID="8ae13590-55a4-4b19-9d51-3acd14a70ed3" containerName="payload-processing" containerID="cri-o://2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933" gracePeriod=30
Sep 08 15:57:16.562346 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.562318    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"]
Sep 08 15:57:16.562561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.562539    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6" podUID="ae80a8e8-b0af-4720-9c4f-31aab74cb516" containerName="payload-pre-processing" containerID="cri-o://4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901" gracePeriod=30
Sep 08 15:57:16.603815 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.603776    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:16.663871 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.663834    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:16.723183 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.723147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:16.824642 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.824609    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:57:16.862024 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.861999    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:57:16.880337 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.880304    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:57:16.911878 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.911846    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-metrics-certs\") pod \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") "
Sep 08 15:57:16.912069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.911920    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae13590-55a4-4b19-9d51-3acd14a70ed3-plugins-config-volume\") pod \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\" (UID: \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\") "
Sep 08 15:57:16.912069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.911986    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gf6lb\" (UniqueName: \"kubernetes.io/projected/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-kube-api-access-gf6lb\") pod \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") "
Sep 08 15:57:16.912069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912023    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae80a8e8-b0af-4720-9c4f-31aab74cb516-plugins-config-volume\") pod \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\" (UID: \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\") "
Sep 08 15:57:16.912069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912051    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lh7n6\" (UniqueName: \"kubernetes.io/projected/ae80a8e8-b0af-4720-9c4f-31aab74cb516-kube-api-access-lh7n6\") pod \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\" (UID: \"ae80a8e8-b0af-4720-9c4f-31aab74cb516\") "
Sep 08 15:57:16.912314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912105    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-openshift-service-ca\") pod \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") "
Sep 08 15:57:16.912314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912157    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls\") pod \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\" (UID: \"a7370dc4-8313-436b-84fa-4e69b8b4ab1a\") "
Sep 08 15:57:16.912314 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912210    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5sx9p\" (UniqueName: \"kubernetes.io/projected/8ae13590-55a4-4b19-9d51-3acd14a70ed3-kube-api-access-5sx9p\") pod \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\" (UID: \"8ae13590-55a4-4b19-9d51-3acd14a70ed3\") "
Sep 08 15:57:16.912472 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912370    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8ae13590-55a4-4b19-9d51-3acd14a70ed3-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "8ae13590-55a4-4b19-9d51-3acd14a70ed3" (UID: "8ae13590-55a4-4b19-9d51-3acd14a70ed3"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:57:16.912528 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912440    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ae80a8e8-b0af-4720-9c4f-31aab74cb516-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "ae80a8e8-b0af-4720-9c4f-31aab74cb516" (UID: "ae80a8e8-b0af-4720-9c4f-31aab74cb516"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:57:16.912608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912587    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/8ae13590-55a4-4b19-9d51-3acd14a70ed3-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:16.912608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.912582    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "a7370dc4-8313-436b-84fa-4e69b8b4ab1a" (UID: "a7370dc4-8313-436b-84fa-4e69b8b4ab1a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:57:16.914639 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.914596    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae80a8e8-b0af-4720-9c4f-31aab74cb516-kube-api-access-lh7n6" (OuterVolumeSpecName: "kube-api-access-lh7n6") pod "ae80a8e8-b0af-4720-9c4f-31aab74cb516" (UID: "ae80a8e8-b0af-4720-9c4f-31aab74cb516"). InnerVolumeSpecName "kube-api-access-lh7n6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:57:16.914758 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.914705    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-kube-api-access-gf6lb" (OuterVolumeSpecName: "kube-api-access-gf6lb") pod "a7370dc4-8313-436b-84fa-4e69b8b4ab1a" (UID: "a7370dc4-8313-436b-84fa-4e69b8b4ab1a"). InnerVolumeSpecName "kube-api-access-gf6lb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:57:16.914809 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.914773    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "a7370dc4-8313-436b-84fa-4e69b8b4ab1a" (UID: "a7370dc4-8313-436b-84fa-4e69b8b4ab1a"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:57:16.914881 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.914861    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "a7370dc4-8313-436b-84fa-4e69b8b4ab1a" (UID: "a7370dc4-8313-436b-84fa-4e69b8b4ab1a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:57:16.914924 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:16.914911    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8ae13590-55a4-4b19-9d51-3acd14a70ed3-kube-api-access-5sx9p" (OuterVolumeSpecName: "kube-api-access-5sx9p") pod "8ae13590-55a4-4b19-9d51-3acd14a70ed3" (UID: "8ae13590-55a4-4b19-9d51-3acd14a70ed3"). InnerVolumeSpecName "kube-api-access-5sx9p". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:57:17.013549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.013512    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:17.013549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.013544    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5sx9p\" (UniqueName: \"kubernetes.io/projected/8ae13590-55a4-4b19-9d51-3acd14a70ed3-kube-api-access-5sx9p\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:17.013549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.013553    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:17.013549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.013561    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gf6lb\" (UniqueName: \"kubernetes.io/projected/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-kube-api-access-gf6lb\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:17.014064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.013570    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/ae80a8e8-b0af-4720-9c4f-31aab74cb516-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:17.014064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.013580    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lh7n6\" (UniqueName: \"kubernetes.io/projected/ae80a8e8-b0af-4720-9c4f-31aab74cb516-kube-api-access-lh7n6\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:17.014064 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.013589    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a7370dc4-8313-436b-84fa-4e69b8b4ab1a-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:57:17.088165 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.088131    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:17.401745 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.401648    2579 generic.go:356] "Generic (PLEG): container finished" podID="8ae13590-55a4-4b19-9d51-3acd14a70ed3" containerID="2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933" exitCode=0
Sep 08 15:57:17.401745 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.401701    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"
Sep 08 15:57:17.402008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.401753    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq" event={"ID":"8ae13590-55a4-4b19-9d51-3acd14a70ed3","Type":"ContainerDied","Data":"2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933"}
Sep 08 15:57:17.402008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.401818    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq" event={"ID":"8ae13590-55a4-4b19-9d51-3acd14a70ed3","Type":"ContainerDied","Data":"b24c58d6d7a7ee8af49907207f409d259dad71306828b6453290f79aa4474d18"}
Sep 08 15:57:17.402008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.401855    2579 scope.go:117] "RemoveContainer" containerID="2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933"
Sep 08 15:57:17.403660 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.403490    2579 generic.go:356] "Generic (PLEG): container finished" podID="a7370dc4-8313-436b-84fa-4e69b8b4ab1a" containerID="0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234" exitCode=0
Sep 08 15:57:17.403660 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.403550    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"
Sep 08 15:57:17.403660 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.403552    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4" event={"ID":"a7370dc4-8313-436b-84fa-4e69b8b4ab1a","Type":"ContainerDied","Data":"0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234"}
Sep 08 15:57:17.403899 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.403663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4" event={"ID":"a7370dc4-8313-436b-84fa-4e69b8b4ab1a","Type":"ContainerDied","Data":"3e93a7732d8f59983f9d5a34d71e1dbd54b2390c5de023130d5661860e500450"}
Sep 08 15:57:17.405138 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.405115    2579 generic.go:356] "Generic (PLEG): container finished" podID="ae80a8e8-b0af-4720-9c4f-31aab74cb516" containerID="4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901" exitCode=0
Sep 08 15:57:17.405269 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.405146    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6" event={"ID":"ae80a8e8-b0af-4720-9c4f-31aab74cb516","Type":"ContainerDied","Data":"4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901"}
Sep 08 15:57:17.405269 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.405165    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"
Sep 08 15:57:17.405269 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.405191    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6" event={"ID":"ae80a8e8-b0af-4720-9c4f-31aab74cb516","Type":"ContainerDied","Data":"ea38fe0f8f1fd5ec43d321f35ba6ba1dbe1c9fe7195ca034063cde278ec5df8a"}
Sep 08 15:57:17.414290 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.414230    2579 scope.go:117] "RemoveContainer" containerID="2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933"
Sep 08 15:57:17.414649 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:57:17.414618    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933\": container with ID starting with 2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933 not found: ID does not exist" containerID="2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933"
Sep 08 15:57:17.414761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.414655    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933"} err="failed to get container status \"2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933\": rpc error: code = NotFound desc = could not find container \"2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933\": container with ID starting with 2f1b4b75502a27828c325d60776d879e8f8cdfbc4fbb1dc9d05b01dc39af6933 not found: ID does not exist"
Sep 08 15:57:17.414761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.414684    2579 scope.go:117] "RemoveContainer" containerID="0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234"
Sep 08 15:57:17.425751 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.425733    2579 scope.go:117] "RemoveContainer" containerID="0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234"
Sep 08 15:57:17.426156 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:57:17.426051    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234\": container with ID starting with 0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234 not found: ID does not exist" containerID="0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234"
Sep 08 15:57:17.426156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.426113    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234"} err="failed to get container status \"0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234\": rpc error: code = NotFound desc = could not find container \"0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234\": container with ID starting with 0004e13c404502cde93dafc0e987c3baa4a285ebbcfcf5a23516b1a65fc68234 not found: ID does not exist"
Sep 08 15:57:17.426156 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.426134    2579 scope.go:117] "RemoveContainer" containerID="4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901"
Sep 08 15:57:17.429006 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.428985    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"]
Sep 08 15:57:17.435565 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.435549    2579 scope.go:117] "RemoveContainer" containerID="4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901"
Sep 08 15:57:17.435865 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:57:17.435841    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901\": container with ID starting with 4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901 not found: ID does not exist" containerID="4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901"
Sep 08 15:57:17.435927 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.435872    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901"} err="failed to get container status \"4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901\": rpc error: code = NotFound desc = could not find container \"4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901\": container with ID starting with 4114f3b3f97798ba7e38c838809db9a30d271262a1fd8a3879ad5b43d1639901 not found: ID does not exist"
Sep 08 15:57:17.436781 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.436760    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w2-be2aba-d878bbcdf-cspw4"]
Sep 08 15:57:17.447227 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.447202    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"]
Sep 08 15:57:17.451103 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.451082    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-shared-a-w2-be2aba-bcc99cb7-5bctq"]
Sep 08 15:57:17.461863 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.461839    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"]
Sep 08 15:57:17.466112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.466090    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-shared-a-w2-be2aba-8694fd6866-9hwf6"]
Sep 08 15:57:17.635681 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:17.635647    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:57:18.119426 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:18.119395    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8ae13590-55a4-4b19-9d51-3acd14a70ed3" path="/var/lib/kubelet/pods/8ae13590-55a4-4b19-9d51-3acd14a70ed3/volumes"
Sep 08 15:57:18.119808 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:18.119764    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a7370dc4-8313-436b-84fa-4e69b8b4ab1a" path="/var/lib/kubelet/pods/a7370dc4-8313-436b-84fa-4e69b8b4ab1a/volumes"
Sep 08 15:57:18.120096 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:18.120083    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae80a8e8-b0af-4720-9c4f-31aab74cb516" path="/var/lib/kubelet/pods/ae80a8e8-b0af-4720-9c4f-31aab74cb516/volumes"
Sep 08 15:57:22.819520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:22.819479    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:23.122720 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:23.122679    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:23.190121 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:23.190088    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:23.574883 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:23.574854    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:28.219542 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:28.219505    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:57:34.059358 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:34.059324    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:34.143811 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:34.143771    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:34.211806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:34.211764    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:34.267491 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:34.267459    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:34.649748 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:34.649711    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:37.731455 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:37.731410    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:57:40.291129 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:40.291095    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:40.391629 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:40.391595    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:40.575266 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:40.575238    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:42.131098 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:42.131017    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:52.893726 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:52.893684    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:57:53.228790 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:57:53.228700    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:58:02.822833 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:02.822794    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:58:12.741641 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:12.741602    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:58:13.657249 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:13.657210    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:19.230904 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:19.230865    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:20.241509 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:20.241473    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:20.722504 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:20.722471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:21.029402 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029322    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"]
Sep 08 15:58:21.029737 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029724    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fa938c06-9112-4d27-bfbf-b8c3032dcf69" containerName="maas-api"
Sep 08 15:58:21.029780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029738    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fa938c06-9112-4d27-bfbf-b8c3032dcf69" containerName="maas-api"
Sep 08 15:58:21.029780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029752    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7370dc4-8313-436b-84fa-4e69b8b4ab1a" containerName="maas-api"
Sep 08 15:58:21.029780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029758    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7370dc4-8313-436b-84fa-4e69b8b4ab1a" containerName="maas-api"
Sep 08 15:58:21.029780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029767    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy"
Sep 08 15:58:21.029780 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029772    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029783    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae80a8e8-b0af-4720-9c4f-31aab74cb516" containerName="payload-pre-processing"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029789    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae80a8e8-b0af-4720-9c4f-31aab74cb516" containerName="payload-pre-processing"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029801    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e50ac118-b298-440d-a62e-e3db88fefcce" containerName="mt-curl-7781-3fb493"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029806    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e50ac118-b298-440d-a62e-e3db88fefcce" containerName="mt-curl-7781-3fb493"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029814    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8ae13590-55a4-4b19-9d51-3acd14a70ed3" containerName="payload-processing"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029819    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="8ae13590-55a4-4b19-9d51-3acd14a70ed3" containerName="payload-processing"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029876    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="8ae13590-55a4-4b19-9d51-3acd14a70ed3" containerName="payload-processing"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029881    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029888    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7370dc4-8313-436b-84fa-4e69b8b4ab1a" containerName="maas-api"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029893    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fa938c06-9112-4d27-bfbf-b8c3032dcf69" containerName="maas-api"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029898    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029903    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae80a8e8-b0af-4720-9c4f-31aab74cb516" containerName="payload-pre-processing"
Sep 08 15:58:21.029935 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.029908    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e50ac118-b298-440d-a62e-e3db88fefcce" containerName="mt-curl-7781-3fb493"
Sep 08 15:58:21.032903 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.032885    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.035769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.035749    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Sep 08 15:58:21.035839 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.035755    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-a-e0da5a-openshift-default-dockercfg-2p7pc\""
Sep 08 15:58:21.047650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.047625    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"]
Sep 08 15:58:21.057516 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.057487    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:21.107190 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107148    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-podinfo\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.107378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107203    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-credential-socket\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.107378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107232    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-token\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.107378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107262    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istiod-ca-cert\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.107378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107288    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-data\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.107534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107370    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-socket\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.107534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107419    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-envoy\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.107534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107446    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-certs\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.107534 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.107476    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tw47\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-kube-api-access-2tw47\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.208870 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.208833    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tw47\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-kube-api-access-2tw47\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209088 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.208906    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-podinfo\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209088 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.208932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-credential-socket\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209088 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.208949    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-token\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209275 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209098    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istiod-ca-cert\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209275 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209151    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-data\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209275 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209206    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-socket\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209275 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209248    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-envoy\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209480 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209290    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-certs\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209480 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209385    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-credential-socket\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209480 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209453    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-data\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209621 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209558    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-socket\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209696 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209648    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-certs\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.209807 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.209787    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istiod-ca-cert\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.211399 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.211371    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-envoy\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.211561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.211546    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-podinfo\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.217375 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.217354    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tw47\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-kube-api-access-2tw47\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.217495 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.217479    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-token\") pod \"e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") " pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.280918 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.280823    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:21.342936 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.342900    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:21.620007 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.619981    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"]
Sep 08 15:58:21.621412 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:58:21.621383    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4358f83c_ae4f_4adc_99fe_b9ae7d4f2d49.slice/crio-5dd465eeee79318f49b7db7accfed94fcd8475ed387089a8dce1418ec07570bc WatchSource:0}: Error finding container 5dd465eeee79318f49b7db7accfed94fcd8475ed387089a8dce1418ec07570bc: Status 404 returned error can't find the container with id 5dd465eeee79318f49b7db7accfed94fcd8475ed387089a8dce1418ec07570bc
Sep 08 15:58:21.623719 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.623687    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:58:21.623806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.623754    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:58:21.623806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.623781    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:58:21.777288 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.777230    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" event={"ID":"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49","Type":"ContainerStarted","Data":"a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8"}
Sep 08 15:58:21.777480 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.777301    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" event={"ID":"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49","Type":"ContainerStarted","Data":"5dd465eeee79318f49b7db7accfed94fcd8475ed387089a8dce1418ec07570bc"}
Sep 08 15:58:21.802210 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:21.802117    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" podStartSLOduration=0.802096326 podStartE2EDuration="802.096326ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:58:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:58:21.801631804 +0000 UTC m=+1562.162174570" watchObservedRunningTime="2026-09-08 15:58:21.802096326 +0000 UTC m=+1562.162639106"
Sep 08 15:58:22.343522 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:22.343484    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:22.348647 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:22.348622    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:22.783477 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:22.783391    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:22.784400 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:22.784380    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:23.230654 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:23.230614    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:58:23.758706 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:23.758671    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:23.853384 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:23.853350    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:24.268806 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:24.268767    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:25.043584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.043550    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:25.141110 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.141072    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:25.700119 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.700082    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:25.790892 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.790844    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:25.792602 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.792575    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"]
Sep 08 15:58:25.793017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.793003    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy"
Sep 08 15:58:25.793017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.793017    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="43efa711-8602-4463-8689-ad05b727bcdd" containerName="istio-proxy"
Sep 08 15:58:25.796215 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.796196    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:25.798869 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.798851    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-a-e0da5a\""
Sep 08 15:58:25.809538 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.809517    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"]
Sep 08 15:58:25.833290 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.833260    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"]
Sep 08 15:58:25.836796 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.836778    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:25.840429 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.840411    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-a-e0da5a-dockercfg-lfhfw\""
Sep 08 15:58:25.848831 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.848807    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e793211a-7229-4356-8098-baa42f7a1225-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m\" (UID: \"e793211a-7229-4356-8098-baa42f7a1225\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:25.848925 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.848847    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkhg4\" (UniqueName: \"kubernetes.io/projected/e793211a-7229-4356-8098-baa42f7a1225-kube-api-access-jkhg4\") pod \"payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m\" (UID: \"e793211a-7229-4356-8098-baa42f7a1225\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:25.850937 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.850916    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"]
Sep 08 15:58:25.950233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.950148    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkhg4\" (UniqueName: \"kubernetes.io/projected/e793211a-7229-4356-8098-baa42f7a1225-kube-api-access-jkhg4\") pod \"payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m\" (UID: \"e793211a-7229-4356-8098-baa42f7a1225\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:25.950233 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.950200    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07a6760b-a57b-4819-a209-fe35da625a90-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv\" (UID: \"07a6760b-a57b-4819-a209-fe35da625a90\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:25.950439 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.950252    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gh996\" (UniqueName: \"kubernetes.io/projected/07a6760b-a57b-4819-a209-fe35da625a90-kube-api-access-gh996\") pod \"payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv\" (UID: \"07a6760b-a57b-4819-a209-fe35da625a90\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:25.950439 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.950294    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e793211a-7229-4356-8098-baa42f7a1225-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m\" (UID: \"e793211a-7229-4356-8098-baa42f7a1225\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:25.951004 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.950957    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e793211a-7229-4356-8098-baa42f7a1225-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m\" (UID: \"e793211a-7229-4356-8098-baa42f7a1225\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:25.958803 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:25.958773    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkhg4\" (UniqueName: \"kubernetes.io/projected/e793211a-7229-4356-8098-baa42f7a1225-kube-api-access-jkhg4\") pod \"payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m\" (UID: \"e793211a-7229-4356-8098-baa42f7a1225\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:26.050928 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.050894    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gh996\" (UniqueName: \"kubernetes.io/projected/07a6760b-a57b-4819-a209-fe35da625a90-kube-api-access-gh996\") pod \"payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv\" (UID: \"07a6760b-a57b-4819-a209-fe35da625a90\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:26.051371 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.051058    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07a6760b-a57b-4819-a209-fe35da625a90-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv\" (UID: \"07a6760b-a57b-4819-a209-fe35da625a90\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:26.051804 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.051786    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07a6760b-a57b-4819-a209-fe35da625a90-plugins-config-volume\") pod \"payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv\" (UID: \"07a6760b-a57b-4819-a209-fe35da625a90\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:26.059650 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.059630    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gh996\" (UniqueName: \"kubernetes.io/projected/07a6760b-a57b-4819-a209-fe35da625a90-kube-api-access-gh996\") pod \"payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv\" (UID: \"07a6760b-a57b-4819-a209-fe35da625a90\") " pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:26.107112 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.107080    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:26.147034 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.146999    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:26.389385 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.389358    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"]
Sep 08 15:58:26.391258 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:58:26.391229    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode793211a_7229_4356_8098_baa42f7a1225.slice/crio-679cda0db99f572b4355d4a70e4263d918c893ed6258893cfde9c27831375467 WatchSource:0}: Error finding container 679cda0db99f572b4355d4a70e4263d918c893ed6258893cfde9c27831375467: Status 404 returned error can't find the container with id 679cda0db99f572b4355d4a70e4263d918c893ed6258893cfde9c27831375467
Sep 08 15:58:26.460812 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.460787    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"]
Sep 08 15:58:26.462056 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:58:26.462037    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a6760b_a57b_4819_a209_fe35da625a90.slice/crio-725e67eea86412d8d87f85b0be1f4f67aa0e77bb7fa21a787729d6a7a6c8c70e WatchSource:0}: Error finding container 725e67eea86412d8d87f85b0be1f4f67aa0e77bb7fa21a787729d6a7a6c8c70e: Status 404 returned error can't find the container with id 725e67eea86412d8d87f85b0be1f4f67aa0e77bb7fa21a787729d6a7a6c8c70e
Sep 08 15:58:26.806892 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.806622    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv" event={"ID":"07a6760b-a57b-4819-a209-fe35da625a90","Type":"ContainerStarted","Data":"6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e"}
Sep 08 15:58:26.806892 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.806688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv" event={"ID":"07a6760b-a57b-4819-a209-fe35da625a90","Type":"ContainerStarted","Data":"725e67eea86412d8d87f85b0be1f4f67aa0e77bb7fa21a787729d6a7a6c8c70e"}
Sep 08 15:58:26.806892 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.806739    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:26.808416 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.808391    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m" event={"ID":"e793211a-7229-4356-8098-baa42f7a1225","Type":"ContainerStarted","Data":"9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b"}
Sep 08 15:58:26.808558 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.808434    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m" event={"ID":"e793211a-7229-4356-8098-baa42f7a1225","Type":"ContainerStarted","Data":"679cda0db99f572b4355d4a70e4263d918c893ed6258893cfde9c27831375467"}
Sep 08 15:58:26.808558 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.808471    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:26.826943 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.826890    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv" podStartSLOduration=1.826874434 podStartE2EDuration="1.826874434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:58:26.824594372 +0000 UTC m=+1567.185137137" watchObservedRunningTime="2026-09-08 15:58:26.826874434 +0000 UTC m=+1567.187417243"
Sep 08 15:58:26.844017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:26.843971    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m" podStartSLOduration=1.843946502 podStartE2EDuration="1.843946502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:58:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:58:26.841830097 +0000 UTC m=+1567.202372861" watchObservedRunningTime="2026-09-08 15:58:26.843946502 +0000 UTC m=+1567.204489267"
Sep 08 15:58:37.559730 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:37.559685    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:58:37.817915 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:37.817815    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 15:58:37.818211 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:37.818187    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 15:58:38.825121 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:38.825086    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Sep 08 15:58:38.825505 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:38.825137    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Sep 08 15:58:39.891633 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:39.891601    2579 generic.go:356] "Generic (PLEG): container finished" podID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerID="a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8" exitCode=0
Sep 08 15:58:39.892207 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:39.891643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" event={"ID":"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49","Type":"ContainerDied","Data":"a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8"}
Sep 08 15:58:39.892289 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:39.892200    2579 scope.go:117] "RemoveContainer" containerID="a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8"
Sep 08 15:58:39.893315 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:39.893284    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:58:39.893413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:39.893353    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:58:39.893413 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:39.893387    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:58:40.900775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:40.900735    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" event={"ID":"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49","Type":"ContainerStarted","Data":"626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f"}
Sep 08 15:58:41.344063 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:41.344018    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:41.344333 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:41.344306    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 08 15:58:41.344422 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:41.344371    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 08 15:58:42.343541 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:42.343503    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 08 15:58:42.343932 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:42.343556    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 08 15:58:43.344083 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:43.344027    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 08 15:58:43.344585 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:43.344106    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 08 15:58:44.343572 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:44.343534    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 08 15:58:44.343753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:44.343600    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 08 15:58:45.344155 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:45.344119    2579 patch_prober.go:28] interesting pod/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused" start-of-body=
Sep 08 15:58:45.344542 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:45.344179    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.84:15021/healthz/ready\": dial tcp 10.132.0.84:15021: connect: connection refused"
Sep 08 15:58:46.347795 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:46.347762    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:46.348262 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:46.348070    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:46.348732 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:46.348716    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 15:58:47.922839 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:47.922802    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:47.985345 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:47.985314    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:48.806553 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:48.806520    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:49.492811 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:49.492774    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:49.916169 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:49.916128    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:49.981594 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:49.981561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:52.978222 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:52.978187    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:53.063690 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:53.063649    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:54.213812 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:54.213777    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:54.308228 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:54.308186    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:54.407334 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:54.407300    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:54.962364 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:54.962327    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:55.101646 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.101608    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:55.225036 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.224938    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"]
Sep 08 15:58:55.228542 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.228521    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.231448 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.231426    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-b-a3a348-dockercfg-z4x5k\""
Sep 08 15:58:55.231571 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.231551    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-b-a3a348\""
Sep 08 15:58:55.247234 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.247205    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"]
Sep 08 15:58:55.250800 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.250776    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"]
Sep 08 15:58:55.250926 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.250902    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:55.275429 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.275401    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"]
Sep 08 15:58:55.335627 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.335582    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjpbb\" (UniqueName: \"kubernetes.io/projected/9c1c3770-d704-418d-b3fd-8de51a16db35-kube-api-access-qjpbb\") pod \"payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf\" (UID: \"9c1c3770-d704-418d-b3fd-8de51a16db35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.335829 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.335701    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1c3770-d704-418d-b3fd-8de51a16db35-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf\" (UID: \"9c1c3770-d704-418d-b3fd-8de51a16db35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.335829 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.335773    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b0d5201-e82e-4add-9ea7-1c40c1728428-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv\" (UID: \"3b0d5201-e82e-4add-9ea7-1c40c1728428\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:55.335829 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.335802    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xk726\" (UniqueName: \"kubernetes.io/projected/3b0d5201-e82e-4add-9ea7-1c40c1728428-kube-api-access-xk726\") pod \"payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv\" (UID: \"3b0d5201-e82e-4add-9ea7-1c40c1728428\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:55.436933 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.436895    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b0d5201-e82e-4add-9ea7-1c40c1728428-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv\" (UID: \"3b0d5201-e82e-4add-9ea7-1c40c1728428\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:55.437143 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.436947    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xk726\" (UniqueName: \"kubernetes.io/projected/3b0d5201-e82e-4add-9ea7-1c40c1728428-kube-api-access-xk726\") pod \"payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv\" (UID: \"3b0d5201-e82e-4add-9ea7-1c40c1728428\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:55.437143 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.437035    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjpbb\" (UniqueName: \"kubernetes.io/projected/9c1c3770-d704-418d-b3fd-8de51a16db35-kube-api-access-qjpbb\") pod \"payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf\" (UID: \"9c1c3770-d704-418d-b3fd-8de51a16db35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.437143 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.437056    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1c3770-d704-418d-b3fd-8de51a16db35-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf\" (UID: \"9c1c3770-d704-418d-b3fd-8de51a16db35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.437693 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.437674    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1c3770-d704-418d-b3fd-8de51a16db35-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf\" (UID: \"9c1c3770-d704-418d-b3fd-8de51a16db35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.437743 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.437712    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b0d5201-e82e-4add-9ea7-1c40c1728428-plugins-config-volume\") pod \"payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv\" (UID: \"3b0d5201-e82e-4add-9ea7-1c40c1728428\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:55.451011 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.450981    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xk726\" (UniqueName: \"kubernetes.io/projected/3b0d5201-e82e-4add-9ea7-1c40c1728428-kube-api-access-xk726\") pod \"payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv\" (UID: \"3b0d5201-e82e-4add-9ea7-1c40c1728428\") " pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:55.451284 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.451262    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjpbb\" (UniqueName: \"kubernetes.io/projected/9c1c3770-d704-418d-b3fd-8de51a16db35-kube-api-access-qjpbb\") pod \"payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf\" (UID: \"9c1c3770-d704-418d-b3fd-8de51a16db35\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.541087 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.540998    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.564362 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.564329    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:55.838862 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.838833    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"]
Sep 08 15:58:55.839541 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:58:55.839494    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c1c3770_d704_418d_b3fd_8de51a16db35.slice/crio-95a5a4451c699ea2a823e34a369ff1c9cba883726ada59f97c88c590155e8fa5 WatchSource:0}: Error finding container 95a5a4451c699ea2a823e34a369ff1c9cba883726ada59f97c88c590155e8fa5: Status 404 returned error can't find the container with id 95a5a4451c699ea2a823e34a369ff1c9cba883726ada59f97c88c590155e8fa5
Sep 08 15:58:55.862066 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.862041    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"]
Sep 08 15:58:55.863206 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:58:55.863180    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b0d5201_e82e_4add_9ea7_1c40c1728428.slice/crio-70644ddbc0433e991f9491f634742918760fd0b29f1f1081e98ca9b34bc7ba22 WatchSource:0}: Error finding container 70644ddbc0433e991f9491f634742918760fd0b29f1f1081e98ca9b34bc7ba22: Status 404 returned error can't find the container with id 70644ddbc0433e991f9491f634742918760fd0b29f1f1081e98ca9b34bc7ba22
Sep 08 15:58:55.993030 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.992989    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf" event={"ID":"9c1c3770-d704-418d-b3fd-8de51a16db35","Type":"ContainerStarted","Data":"ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5"}
Sep 08 15:58:55.993240 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.993057    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf" event={"ID":"9c1c3770-d704-418d-b3fd-8de51a16db35","Type":"ContainerStarted","Data":"95a5a4451c699ea2a823e34a369ff1c9cba883726ada59f97c88c590155e8fa5"}
Sep 08 15:58:55.993240 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.993218    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:58:55.995004 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.994950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv" event={"ID":"3b0d5201-e82e-4add-9ea7-1c40c1728428","Type":"ContainerStarted","Data":"cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf"}
Sep 08 15:58:55.995157 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.995021    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv" event={"ID":"3b0d5201-e82e-4add-9ea7-1c40c1728428","Type":"ContainerStarted","Data":"70644ddbc0433e991f9491f634742918760fd0b29f1f1081e98ca9b34bc7ba22"}
Sep 08 15:58:55.995157 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:55.995043    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:58:56.030038 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:56.029976    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf" podStartSLOduration=1.029945878 podStartE2EDuration="1.029945878s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:58:56.027469086 +0000 UTC m=+1596.388011852" watchObservedRunningTime="2026-09-08 15:58:56.029945878 +0000 UTC m=+1596.390488644"
Sep 08 15:58:56.057452 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:56.057391    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv" podStartSLOduration=1.05736701 podStartE2EDuration="1.05736701s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:58:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:58:56.055192899 +0000 UTC m=+1596.415735661" watchObservedRunningTime="2026-09-08 15:58:56.05736701 +0000 UTC m=+1596.417909778"
Sep 08 15:58:56.955637 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:56.955604    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:57.112046 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:57.112001    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:57.212152 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:57.212048    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:57.493580 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:57.493469    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:58:57.601729 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:58:57.601691    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:00.746257 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:00.746220    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:59:01.869224 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:01.869181    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:02.028536 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:02.028496    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:02.683175 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:02.683113    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:03.081710 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:03.081680    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:03.475023 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:03.474913    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:05.308877 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:05.308841    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:07.005515 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:07.005480    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 15:59:07.005923 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:07.005569    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 15:59:07.121458 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:07.121416    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:08.730350 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:08.730303    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:12.362575 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:12.362481    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:12.501466 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:12.501432    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:12.616832 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:12.616698    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:13.125774 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:13.125737    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vbf66"]
Sep 08 15:59:13.125979 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:13.125945    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66" podUID="7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b" containerName="manager" containerID="cri-o://cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5" gracePeriod=10
Sep 08 15:59:13.379034 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:13.378949    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:59:13.510725 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:13.510683    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gxtxw\" (UniqueName: \"kubernetes.io/projected/7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b-kube-api-access-gxtxw\") pod \"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b\" (UID: \"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b\") "
Sep 08 15:59:13.513179 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:13.513139    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b-kube-api-access-gxtxw" (OuterVolumeSpecName: "kube-api-access-gxtxw") pod "7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b" (UID: "7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b"). InnerVolumeSpecName "kube-api-access-gxtxw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:59:13.612192 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:13.612145    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gxtxw\" (UniqueName: \"kubernetes.io/projected/7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b-kube-api-access-gxtxw\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:59:14.107040 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.107002    2579 generic.go:356] "Generic (PLEG): container finished" podID="7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b" containerID="cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5" exitCode=0
Sep 08 15:59:14.107198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.107050    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66"
Sep 08 15:59:14.107198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.107058    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66" event={"ID":"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b","Type":"ContainerDied","Data":"cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5"}
Sep 08 15:59:14.107198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.107102    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-68d88948d8-vbf66" event={"ID":"7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b","Type":"ContainerDied","Data":"9a25da2dd226b340a70ddfaa20ff57fdb0e207a38daed66dcc1abc0ebd29ae4b"}
Sep 08 15:59:14.107198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.107124    2579 scope.go:117] "RemoveContainer" containerID="cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5"
Sep 08 15:59:14.117466 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.117436    2579 scope.go:117] "RemoveContainer" containerID="cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5"
Sep 08 15:59:14.117800 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:59:14.117765    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5\": container with ID starting with cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5 not found: ID does not exist" containerID="cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5"
Sep 08 15:59:14.117895 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.117807    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5"} err="failed to get container status \"cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5\": rpc error: code = NotFound desc = could not find container \"cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5\": container with ID starting with cc1adcabda785532f5ecc4eb717fac6967e119fe98bf6fa2a1a4847bd112f9a5 not found: ID does not exist"
Sep 08 15:59:14.137659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.137623    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vbf66"]
Sep 08 15:59:14.141922 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:14.141893    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-operator-68d88948d8-vbf66"]
Sep 08 15:59:16.117053 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:16.117015    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b" path="/var/lib/kubelet/pods/7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b/volumes"
Sep 08 15:59:16.870025 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:16.869985    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:16.947464 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:16.947420    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:17.355109 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:17.355080    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:17.464208 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:17.464168    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:18.008264 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:18.008230    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:22.261738 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:22.261699    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:22.322877 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:22.322825    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:22.670999 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:22.670946    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:22.771124 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:22.771087    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:23.095478 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:23.095424    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:23.206520 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:23.206476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:23.369475 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:23.369395    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv_3b0d5201-e82e-4add-9ea7-1c40c1728428/payload-processing/0.log"
Sep 08 15:59:23.749719 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:23.749622    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"]
Sep 08 15:59:23.749933 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:23.749907    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm" podUID="f6d111e5-0008-4732-b38c-076d1ebcc88b" containerName="manager" containerID="cri-o://f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd" gracePeriod=10
Sep 08 15:59:23.768667 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:23.768637    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"]
Sep 08 15:59:23.768895 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:23.768872    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4" podUID="15f75a79-8e08-4552-a0a4-193ca2931ec2" containerName="manager" containerID="cri-o://257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee" gracePeriod=10
Sep 08 15:59:24.048423 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.048396    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:59:24.138515 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.138487    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:59:24.176110 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.176080    2579 generic.go:356] "Generic (PLEG): container finished" podID="f6d111e5-0008-4732-b38c-076d1ebcc88b" containerID="f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd" exitCode=0
Sep 08 15:59:24.176307 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.176131    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"
Sep 08 15:59:24.176307 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.176171    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm" event={"ID":"f6d111e5-0008-4732-b38c-076d1ebcc88b","Type":"ContainerDied","Data":"f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd"}
Sep 08 15:59:24.176307 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.176235    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-5985564776-f68xm" event={"ID":"f6d111e5-0008-4732-b38c-076d1ebcc88b","Type":"ContainerDied","Data":"d2c6181e132ee1989b38ab003a327c85245d7263d8041869f1e4d40d62c1c13f"}
Sep 08 15:59:24.176307 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.176265    2579 scope.go:117] "RemoveContainer" containerID="f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd"
Sep 08 15:59:24.178093 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.178071    2579 generic.go:356] "Generic (PLEG): container finished" podID="15f75a79-8e08-4552-a0a4-193ca2931ec2" containerID="257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee" exitCode=0
Sep 08 15:59:24.178289 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.178113    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"
Sep 08 15:59:24.178289 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.178122    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4" event={"ID":"15f75a79-8e08-4552-a0a4-193ca2931ec2","Type":"ContainerDied","Data":"257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee"}
Sep 08 15:59:24.178289 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.178152    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4" event={"ID":"15f75a79-8e08-4552-a0a4-193ca2931ec2","Type":"ContainerDied","Data":"e5337c6e696dedb9ad280b65bcbd022c732973b81e597fb84375d6f49aabcbc5"}
Sep 08 15:59:24.186659 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.186639    2579 scope.go:117] "RemoveContainer" containerID="f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd"
Sep 08 15:59:24.186941 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:59:24.186923    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd\": container with ID starting with f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd not found: ID does not exist" containerID="f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd"
Sep 08 15:59:24.187020 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.186951    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd"} err="failed to get container status \"f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd\": rpc error: code = NotFound desc = could not find container \"f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd\": container with ID starting with f084b98153ba2bb6b7f9b15f20a6542c01bb1a05aaa493614023983438bb5cbd not found: ID does not exist"
Sep 08 15:59:24.187020 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.186988    2579 scope.go:117] "RemoveContainer" containerID="257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee"
Sep 08 15:59:24.196280 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.196249    2579 scope.go:117] "RemoveContainer" containerID="257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee"
Sep 08 15:59:24.196557 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:59:24.196538    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee\": container with ID starting with 257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee not found: ID does not exist" containerID="257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee"
Sep 08 15:59:24.196616 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.196564    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee"} err="failed to get container status \"257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee\": rpc error: code = NotFound desc = could not find container \"257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee\": container with ID starting with 257d23187901dd39e2621aa02c2bf6e3c9e93a4bd50b4e4c2e65c5e3b7d484ee not found: ID does not exist"
Sep 08 15:59:24.218073 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.218048    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6cb6\" (UniqueName: \"kubernetes.io/projected/f6d111e5-0008-4732-b38c-076d1ebcc88b-kube-api-access-d6cb6\") pod \"f6d111e5-0008-4732-b38c-076d1ebcc88b\" (UID: \"f6d111e5-0008-4732-b38c-076d1ebcc88b\") "
Sep 08 15:59:24.219996 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.219972    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6d111e5-0008-4732-b38c-076d1ebcc88b-kube-api-access-d6cb6" (OuterVolumeSpecName: "kube-api-access-d6cb6") pod "f6d111e5-0008-4732-b38c-076d1ebcc88b" (UID: "f6d111e5-0008-4732-b38c-076d1ebcc88b"). InnerVolumeSpecName "kube-api-access-d6cb6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:59:24.318557 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.318466    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bztqj\" (UniqueName: \"kubernetes.io/projected/15f75a79-8e08-4552-a0a4-193ca2931ec2-kube-api-access-bztqj\") pod \"15f75a79-8e08-4552-a0a4-193ca2931ec2\" (UID: \"15f75a79-8e08-4552-a0a4-193ca2931ec2\") "
Sep 08 15:59:24.318714 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.318564    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15f75a79-8e08-4552-a0a4-193ca2931ec2-extensions-socket-volume\") pod \"15f75a79-8e08-4552-a0a4-193ca2931ec2\" (UID: \"15f75a79-8e08-4552-a0a4-193ca2931ec2\") "
Sep 08 15:59:24.318798 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.318787    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6cb6\" (UniqueName: \"kubernetes.io/projected/f6d111e5-0008-4732-b38c-076d1ebcc88b-kube-api-access-d6cb6\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:59:24.318996 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.318945    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/15f75a79-8e08-4552-a0a4-193ca2931ec2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "15f75a79-8e08-4552-a0a4-193ca2931ec2" (UID: "15f75a79-8e08-4552-a0a4-193ca2931ec2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 15:59:24.320576 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.320555    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15f75a79-8e08-4552-a0a4-193ca2931ec2-kube-api-access-bztqj" (OuterVolumeSpecName: "kube-api-access-bztqj") pod "15f75a79-8e08-4552-a0a4-193ca2931ec2" (UID: "15f75a79-8e08-4552-a0a4-193ca2931ec2"). InnerVolumeSpecName "kube-api-access-bztqj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:59:24.419626 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.419590    2579 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/15f75a79-8e08-4552-a0a4-193ca2931ec2-extensions-socket-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:59:24.419626 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.419620    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bztqj\" (UniqueName: \"kubernetes.io/projected/15f75a79-8e08-4552-a0a4-193ca2931ec2-kube-api-access-bztqj\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:59:24.504741 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.504704    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"]
Sep 08 15:59:24.509803 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.509777    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-5985564776-f68xm"]
Sep 08 15:59:24.529091 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.529067    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"]
Sep 08 15:59:24.539267 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:24.539244    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5b65f94d4c-qd4d4"]
Sep 08 15:59:25.450221 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450189    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 15:59:25.450630 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450617    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15f75a79-8e08-4552-a0a4-193ca2931ec2" containerName="manager"
Sep 08 15:59:25.450674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450631    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="15f75a79-8e08-4552-a0a4-193ca2931ec2" containerName="manager"
Sep 08 15:59:25.450674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450647    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b" containerName="manager"
Sep 08 15:59:25.450674 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450655    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b" containerName="manager"
Sep 08 15:59:25.450775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450675    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6d111e5-0008-4732-b38c-076d1ebcc88b" containerName="manager"
Sep 08 15:59:25.450775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450682    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6d111e5-0008-4732-b38c-076d1ebcc88b" containerName="manager"
Sep 08 15:59:25.450775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450752    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="15f75a79-8e08-4552-a0a4-193ca2931ec2" containerName="manager"
Sep 08 15:59:25.450775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450762    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5b8fd0-23f6-4e7c-a0f4-2b6f8b4e756b" containerName="manager"
Sep 08 15:59:25.450775 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.450768    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6d111e5-0008-4732-b38c-076d1ebcc88b" containerName="manager"
Sep 08 15:59:25.455769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.455747    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:25.468507 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.468480    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 15:59:25.539315 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.539282    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 15:59:25.632264 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.632206    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb-config-file\") pod \"limitador-limitador-84994f7ffc-fhxwq\" (UID: \"e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:25.632264 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.632261    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kf94d\" (UniqueName: \"kubernetes.io/projected/e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb-kube-api-access-kf94d\") pod \"limitador-limitador-84994f7ffc-fhxwq\" (UID: \"e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:25.733450 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.733340    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb-config-file\") pod \"limitador-limitador-84994f7ffc-fhxwq\" (UID: \"e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:25.733450 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.733388    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kf94d\" (UniqueName: \"kubernetes.io/projected/e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb-kube-api-access-kf94d\") pod \"limitador-limitador-84994f7ffc-fhxwq\" (UID: \"e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:25.734006 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.733953    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb-config-file\") pod \"limitador-limitador-84994f7ffc-fhxwq\" (UID: \"e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:25.746666 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.746634    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kf94d\" (UniqueName: \"kubernetes.io/projected/e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb-kube-api-access-kf94d\") pod \"limitador-limitador-84994f7ffc-fhxwq\" (UID: \"e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb\") " pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:25.766395 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:25.766361    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:26.043782 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:26.043756    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 15:59:26.045179 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:59:26.045148    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2ec3574_bc6c_4c1b_bca2_3ed85b046cdb.slice/crio-4317c25b904252b9e23b5c7084a0141e132efa98e5bb1222f1ca9b2fa7c84798 WatchSource:0}: Error finding container 4317c25b904252b9e23b5c7084a0141e132efa98e5bb1222f1ca9b2fa7c84798: Status 404 returned error can't find the container with id 4317c25b904252b9e23b5c7084a0141e132efa98e5bb1222f1ca9b2fa7c84798
Sep 08 15:59:26.120931 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:26.120891    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15f75a79-8e08-4552-a0a4-193ca2931ec2" path="/var/lib/kubelet/pods/15f75a79-8e08-4552-a0a4-193ca2931ec2/volumes"
Sep 08 15:59:26.121319 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:26.121303    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6d111e5-0008-4732-b38c-076d1ebcc88b" path="/var/lib/kubelet/pods/f6d111e5-0008-4732-b38c-076d1ebcc88b/volumes"
Sep 08 15:59:26.192940 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:26.192900    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq" event={"ID":"e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb","Type":"ContainerStarted","Data":"4317c25b904252b9e23b5c7084a0141e132efa98e5bb1222f1ca9b2fa7c84798"}
Sep 08 15:59:27.627624 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.627546    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"]
Sep 08 15:59:27.631185 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.631166    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.634143 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.634123    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e0da5a\"/\"kube-root-ca.crt\""
Sep 08 15:59:27.635293 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.635260    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e0da5a\"/\"ipp-route-e0da5a-kserve-self-signed-certs\""
Sep 08 15:59:27.635293 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.635287    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-ipp-a-e0da5a\"/\"default-dockercfg-62mkt\""
Sep 08 15:59:27.635454 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.635349    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-ipp-a-e0da5a\"/\"openshift-service-ca.crt\""
Sep 08 15:59:27.643757 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.643734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"]
Sep 08 15:59:27.658229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.658195    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:27.754504 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.754468    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-dshm\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.754504 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.754508    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tmp-dir\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.754769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.754535    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khk97\" (UniqueName: \"kubernetes.io/projected/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-kube-api-access-khk97\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.754769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.754656    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-model-cache\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.754769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.754691    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-home\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.754769 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.754752    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tls-certs\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.855762 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.855726    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-model-cache\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.855762 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.855761    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-home\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.856069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.855811    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tls-certs\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.856069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.855844    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-dshm\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.856069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.855862    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tmp-dir\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.856069 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.855886    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khk97\" (UniqueName: \"kubernetes.io/projected/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-kube-api-access-khk97\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.856299 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.856263    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-model-cache\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.856356 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.856295    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-home\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.856356 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.856322    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tmp-dir\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.858225 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.858200    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-dshm\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.858356 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.858339    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tls-certs\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.863919 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.863894    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khk97\" (UniqueName: \"kubernetes.io/projected/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-kube-api-access-khk97\") pod \"ipp-route-e0da5a-kserve-86646bd8c5-pmp2t\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") " pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:27.940825 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:27.940735    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:28.206633 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:28.206541    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq" event={"ID":"e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb","Type":"ContainerStarted","Data":"1470dd6c411666182193e32f0f74071c8e21c76b803a55135988950e130b8909"}
Sep 08 15:59:28.206805 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:28.206732    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:28.214838 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:28.214812    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"]
Sep 08 15:59:28.215266 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:59:28.215245    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb87c9c71_0180_4b91_a5bb_733ad3dbaa1d.slice/crio-9a48e2254c5379cd212d1d9dff363a160d74938fc5ab17f35deae921123df072 WatchSource:0}: Error finding container 9a48e2254c5379cd212d1d9dff363a160d74938fc5ab17f35deae921123df072: Status 404 returned error can't find the container with id 9a48e2254c5379cd212d1d9dff363a160d74938fc5ab17f35deae921123df072
Sep 08 15:59:28.225915 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:28.225868    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq" podStartSLOduration=1.945700998 podStartE2EDuration="3.225853132s" totalImagesPullingTime="1.280152134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:59:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:59:28.224878295 +0000 UTC m=+1628.585421060" watchObservedRunningTime="2026-09-08 15:59:28.225853132 +0000 UTC m=+1628.586395937"
Sep 08 15:59:29.216578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:29.216539    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t" event={"ID":"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d","Type":"ContainerStarted","Data":"38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e"}
Sep 08 15:59:29.216578 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:29.216586    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t" event={"ID":"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d","Type":"ContainerStarted","Data":"9a48e2254c5379cd212d1d9dff363a160d74938fc5ab17f35deae921123df072"}
Sep 08 15:59:29.234008 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:29.233930    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t" podStartSLOduration=2.233914433 podStartE2EDuration="2.233914433s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:59:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:59:29.232620889 +0000 UTC m=+1629.593163659" watchObservedRunningTime="2026-09-08 15:59:29.233914433 +0000 UTC m=+1629.594457198"
Sep 08 15:59:29.870576 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:29.870544    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:29.929689 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:29.929654    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:30.890168 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:30.890131    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7654c9c68c-rttcz"]
Sep 08 15:59:30.893720 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:30.893703    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7654c9c68c-rttcz"
Sep 08 15:59:30.902062 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:30.902034    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7654c9c68c-rttcz"]
Sep 08 15:59:30.985354 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:30.985319    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j28nv\" (UniqueName: \"kubernetes.io/projected/2212135f-fc9d-44ac-a2fb-e416ceb4a6d5-kube-api-access-j28nv\") pod \"authorino-7654c9c68c-rttcz\" (UID: \"2212135f-fc9d-44ac-a2fb-e416ceb4a6d5\") " pod="kuadrant-system/authorino-7654c9c68c-rttcz"
Sep 08 15:59:30.985545 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:30.985463    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2212135f-fc9d-44ac-a2fb-e416ceb4a6d5-tls-cert\") pod \"authorino-7654c9c68c-rttcz\" (UID: \"2212135f-fc9d-44ac-a2fb-e416ceb4a6d5\") " pod="kuadrant-system/authorino-7654c9c68c-rttcz"
Sep 08 15:59:31.086009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:31.085950    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2212135f-fc9d-44ac-a2fb-e416ceb4a6d5-tls-cert\") pod \"authorino-7654c9c68c-rttcz\" (UID: \"2212135f-fc9d-44ac-a2fb-e416ceb4a6d5\") " pod="kuadrant-system/authorino-7654c9c68c-rttcz"
Sep 08 15:59:31.086181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:31.086054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j28nv\" (UniqueName: \"kubernetes.io/projected/2212135f-fc9d-44ac-a2fb-e416ceb4a6d5-kube-api-access-j28nv\") pod \"authorino-7654c9c68c-rttcz\" (UID: \"2212135f-fc9d-44ac-a2fb-e416ceb4a6d5\") " pod="kuadrant-system/authorino-7654c9c68c-rttcz"
Sep 08 15:59:31.088498 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:31.088474    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/2212135f-fc9d-44ac-a2fb-e416ceb4a6d5-tls-cert\") pod \"authorino-7654c9c68c-rttcz\" (UID: \"2212135f-fc9d-44ac-a2fb-e416ceb4a6d5\") " pod="kuadrant-system/authorino-7654c9c68c-rttcz"
Sep 08 15:59:31.094357 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:31.094336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j28nv\" (UniqueName: \"kubernetes.io/projected/2212135f-fc9d-44ac-a2fb-e416ceb4a6d5-kube-api-access-j28nv\") pod \"authorino-7654c9c68c-rttcz\" (UID: \"2212135f-fc9d-44ac-a2fb-e416ceb4a6d5\") " pod="kuadrant-system/authorino-7654c9c68c-rttcz"
Sep 08 15:59:31.204712 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:31.204615    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7654c9c68c-rttcz"
Sep 08 15:59:31.484767 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:31.484734    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7654c9c68c-rttcz"]
Sep 08 15:59:31.486187 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:59:31.486158    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2212135f_fc9d_44ac_a2fb_e416ceb4a6d5.slice/crio-78fb7bc87be9d26585f50861df130057329053de76365acfb6e86497e8364828 WatchSource:0}: Error finding container 78fb7bc87be9d26585f50861df130057329053de76365acfb6e86497e8364828: Status 404 returned error can't find the container with id 78fb7bc87be9d26585f50861df130057329053de76365acfb6e86497e8364828
Sep 08 15:59:32.235009 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:32.234951    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7654c9c68c-rttcz" event={"ID":"2212135f-fc9d-44ac-a2fb-e416ceb4a6d5","Type":"ContainerStarted","Data":"78fb7bc87be9d26585f50861df130057329053de76365acfb6e86497e8364828"}
Sep 08 15:59:34.248716 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.248642    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7654c9c68c-rttcz" event={"ID":"2212135f-fc9d-44ac-a2fb-e416ceb4a6d5","Type":"ContainerStarted","Data":"94058090378bf230f7e93159102ddc90f40fd9a30df11e494d8167ea45155f9a"}
Sep 08 15:59:34.269630 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.268904    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7654c9c68c-rttcz" podStartSLOduration=2.442410272 podStartE2EDuration="4.268878456s" totalImagesPullingTime="1.826468184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:59:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:59:34.266778463 +0000 UTC m=+1634.627321274" watchObservedRunningTime="2026-09-08 15:59:34.268878456 +0000 UTC m=+1634.629421224"
Sep 08 15:59:34.304238 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.304198    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d96b94bbf-86wfx"]
Sep 08 15:59:34.304721 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.304691    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6d96b94bbf-86wfx" podUID="a4ac399a-17a9-4b6a-9ff3-455460342317" containerName="authorino" containerID="cri-o://f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028" gracePeriod=30
Sep 08 15:59:34.587978 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.587931    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:59:34.621746 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.621715    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k4swl\" (UniqueName: \"kubernetes.io/projected/a4ac399a-17a9-4b6a-9ff3-455460342317-kube-api-access-k4swl\") pod \"a4ac399a-17a9-4b6a-9ff3-455460342317\" (UID: \"a4ac399a-17a9-4b6a-9ff3-455460342317\") "
Sep 08 15:59:34.621913 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.621781    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4ac399a-17a9-4b6a-9ff3-455460342317-tls-cert\") pod \"a4ac399a-17a9-4b6a-9ff3-455460342317\" (UID: \"a4ac399a-17a9-4b6a-9ff3-455460342317\") "
Sep 08 15:59:34.623909 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.623880    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a4ac399a-17a9-4b6a-9ff3-455460342317-kube-api-access-k4swl" (OuterVolumeSpecName: "kube-api-access-k4swl") pod "a4ac399a-17a9-4b6a-9ff3-455460342317" (UID: "a4ac399a-17a9-4b6a-9ff3-455460342317"). InnerVolumeSpecName "kube-api-access-k4swl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:59:34.635057 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.635020    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a4ac399a-17a9-4b6a-9ff3-455460342317-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a4ac399a-17a9-4b6a-9ff3-455460342317" (UID: "a4ac399a-17a9-4b6a-9ff3-455460342317"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 15:59:34.723394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.723357    2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a4ac399a-17a9-4b6a-9ff3-455460342317-tls-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:59:34.723394 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:34.723388    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k4swl\" (UniqueName: \"kubernetes.io/projected/a4ac399a-17a9-4b6a-9ff3-455460342317-kube-api-access-k4swl\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:59:35.257331 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.257281    2579 generic.go:356] "Generic (PLEG): container finished" podID="a4ac399a-17a9-4b6a-9ff3-455460342317" containerID="f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028" exitCode=0
Sep 08 15:59:35.257331 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.257329    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d96b94bbf-86wfx"
Sep 08 15:59:35.257883 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.257352    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d96b94bbf-86wfx" event={"ID":"a4ac399a-17a9-4b6a-9ff3-455460342317","Type":"ContainerDied","Data":"f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028"}
Sep 08 15:59:35.257883 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.257408    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d96b94bbf-86wfx" event={"ID":"a4ac399a-17a9-4b6a-9ff3-455460342317","Type":"ContainerDied","Data":"038013b9eedc960cd6cfaf3d66b73797035b053a4f197b712f34ea6a4703f1bd"}
Sep 08 15:59:35.257883 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.257430    2579 scope.go:117] "RemoveContainer" containerID="f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028"
Sep 08 15:59:35.269738 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.269715    2579 scope.go:117] "RemoveContainer" containerID="f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028"
Sep 08 15:59:35.270113 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:59:35.270089    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028\": container with ID starting with f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028 not found: ID does not exist" containerID="f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028"
Sep 08 15:59:35.270198 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.270127    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028"} err="failed to get container status \"f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028\": rpc error: code = NotFound desc = could not find container \"f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028\": container with ID starting with f7b881cd1b47ff0d651f16f160ccdd6d281261a55091b1922767df7b38f0c028 not found: ID does not exist"
Sep 08 15:59:35.281244 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.281214    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d96b94bbf-86wfx"]
Sep 08 15:59:35.285649 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.285620    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d96b94bbf-86wfx"]
Sep 08 15:59:35.667908 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.667869    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:35.790021 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:35.789982    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:36.114125 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:36.114089    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a4ac399a-17a9-4b6a-9ff3-455460342317" path="/var/lib/kubelet/pods/a4ac399a-17a9-4b6a-9ff3-455460342317/volumes"
Sep 08 15:59:37.941694 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:37.941652    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:37.942181 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:37.941745    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:37.954706 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:37.954681    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:38.295640 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:38.295560    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 15:59:39.217603 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.217563    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"
Sep 08 15:59:39.261655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.261616    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:59:39.261837 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.261810    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk" podUID="b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e" containerName="limitador" containerID="cri-o://b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83" gracePeriod=30
Sep 08 15:59:39.820424 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.820362    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:59:39.870489 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.870459    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jck8g\" (UniqueName: \"kubernetes.io/projected/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-kube-api-access-jck8g\") pod \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\" (UID: \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\") "
Sep 08 15:59:39.870652 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.870511    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-config-file\") pod \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\" (UID: \"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e\") "
Sep 08 15:59:39.870920 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.870894    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-config-file" (OuterVolumeSpecName: "config-file") pod "b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e" (UID: "b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 15:59:39.872643 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.872617    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-kube-api-access-jck8g" (OuterVolumeSpecName: "kube-api-access-jck8g") pod "b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e" (UID: "b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e"). InnerVolumeSpecName "kube-api-access-jck8g". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 15:59:39.971212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.971180    2579 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-config-file\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:59:39.971212 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:39.971207    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jck8g\" (UniqueName: \"kubernetes.io/projected/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e-kube-api-access-jck8g\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 15:59:40.077286 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.077250    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:40.135320 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.135280    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:40.297259 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.297228    2579 generic.go:356] "Generic (PLEG): container finished" podID="b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e" containerID="b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83" exitCode=0
Sep 08 15:59:40.297655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.297277    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"
Sep 08 15:59:40.297655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.297311    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk" event={"ID":"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e","Type":"ContainerDied","Data":"b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83"}
Sep 08 15:59:40.297655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.297359    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk" event={"ID":"b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e","Type":"ContainerDied","Data":"33cf1ac3557346826dd31cc8b009e0f9b8e04ecfb576a1b23cbab76ed692c15f"}
Sep 08 15:59:40.297655 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.297383    2579 scope.go:117] "RemoveContainer" containerID="b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83"
Sep 08 15:59:40.306250 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.306231    2579 scope.go:117] "RemoveContainer" containerID="b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83"
Sep 08 15:59:40.306530 ip-10-0-134-78 kubenswrapper[2579]: E0908 15:59:40.306506    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83\": container with ID starting with b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83 not found: ID does not exist" containerID="b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83"
Sep 08 15:59:40.306619 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.306542    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83"} err="failed to get container status \"b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83\": rpc error: code = NotFound desc = could not find container \"b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83\": container with ID starting with b397c52f56266d5782481e4d21dab031d47eeeba121e67bed91ba6eda92a6c83 not found: ID does not exist"
Sep 08 15:59:40.314401 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.314372    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:59:40.318274 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.318251    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-85d9db4d5d-kv5fk"]
Sep 08 15:59:40.453496 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.453403    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:40.511478 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:40.511446    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:42.120940 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:42.120907    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e" path="/var/lib/kubelet/pods/b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e/volumes"
Sep 08 15:59:46.061352 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:46.061312    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:46.128147 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:46.128105    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:46.462625 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:46.462590    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:46.833543 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:46.833509    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:46.933515 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:46.933476    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:47.792608 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.792568    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"]
Sep 08 15:59:47.793026 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.792976    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a4ac399a-17a9-4b6a-9ff3-455460342317" containerName="authorino"
Sep 08 15:59:47.793026 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.792988    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="a4ac399a-17a9-4b6a-9ff3-455460342317" containerName="authorino"
Sep 08 15:59:47.793026 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.793016    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e" containerName="limitador"
Sep 08 15:59:47.793026 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.793021    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e" containerName="limitador"
Sep 08 15:59:47.793161 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.793078    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="a4ac399a-17a9-4b6a-9ff3-455460342317" containerName="authorino"
Sep 08 15:59:47.793161 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.793088    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b02fb12b-aaeb-4e3d-8e56-03c7a546ab1e" containerName="limitador"
Sep 08 15:59:47.797460 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.797444    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.806753 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.806727    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"]
Sep 08 15:59:47.857532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.857494    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/734346ed-87c2-41c9-9788-097b79ae330a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.857532 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.857534    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/734346ed-87c2-41c9-9788-097b79ae330a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.857788 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.857600    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kp6c\" (UniqueName: \"kubernetes.io/projected/734346ed-87c2-41c9-9788-097b79ae330a-kube-api-access-9kp6c\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.958365 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.958329    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/734346ed-87c2-41c9-9788-097b79ae330a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.958365 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.958366    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/734346ed-87c2-41c9-9788-097b79ae330a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.958630 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.958415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kp6c\" (UniqueName: \"kubernetes.io/projected/734346ed-87c2-41c9-9788-097b79ae330a-kube-api-access-9kp6c\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.959091 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.959065    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/734346ed-87c2-41c9-9788-097b79ae330a-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.960886 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.960866    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/734346ed-87c2-41c9-9788-097b79ae330a-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:47.966820 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:47.966796    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kp6c\" (UniqueName: \"kubernetes.io/projected/734346ed-87c2-41c9-9788-097b79ae330a-kube-api-access-9kp6c\") pod \"kuadrant-console-plugin-fbdd4f445-vrhkk\" (UID: \"734346ed-87c2-41c9-9788-097b79ae330a\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:48.107865 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:48.107827    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"
Sep 08 15:59:48.214354 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:48.214322    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:48.315841 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:48.315800    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:48.381923 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:48.381888    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk"]
Sep 08 15:59:48.383707 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:59:48.382485    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod734346ed_87c2_41c9_9788_097b79ae330a.slice/crio-d28584d6a1696603d73018f159333a90e844546f07f20acf6ba48201e28fd142 WatchSource:0}: Error finding container d28584d6a1696603d73018f159333a90e844546f07f20acf6ba48201e28fd142: Status 404 returned error can't find the container with id d28584d6a1696603d73018f159333a90e844546f07f20acf6ba48201e28fd142
Sep 08 15:59:49.353411 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:49.353377    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk" event={"ID":"734346ed-87c2-41c9-9788-097b79ae330a","Type":"ContainerStarted","Data":"d28584d6a1696603d73018f159333a90e844546f07f20acf6ba48201e28fd142"}
Sep 08 15:59:52.544883 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:52.544842    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:52.613105 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:52.613043    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:55.416884 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:55.416850    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk" event={"ID":"734346ed-87c2-41c9-9788-097b79ae330a","Type":"ContainerStarted","Data":"5b088bcf3b14854dc4445818242901eb6f44979bb70feb36a4e4bc53fef0a980"}
Sep 08 15:59:55.436272 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:55.436219    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-vrhkk" podStartSLOduration=2.160884159 podStartE2EDuration="8.436203287s" totalImagesPullingTime="6.275319128s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:59:55.433755121 +0000 UTC m=+1655.794297887" watchObservedRunningTime="2026-09-08 15:59:55.436203287 +0000 UTC m=+1655.796746052"
Sep 08 15:59:55.466017 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:55.465981    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"]
Sep 08 15:59:55.466189 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:55.466173    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9" podUID="aa46a3da-3121-4db0-b7ff-0016ee0bfd28" containerName="kuadrant-console-plugin" containerID="cri-o://6bb8783b289b1aef43dc4d1af0f017209adeceb7adea3a300c6d05c476f73ebc" gracePeriod=30
Sep 08 15:59:55.814386 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:55.814282    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv_07a6760b-a57b-4819-a209-fe35da625a90/payload-processing/0.log"
Sep 08 15:59:56.090310 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:56.090273    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv_3b0d5201-e82e-4add-9ea7-1c40c1728428/payload-processing/0.log"
Sep 08 15:59:56.389438 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:56.389345    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:56.427633 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:56.427604    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 15:59:56.890396 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:56.890363    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"]
Sep 08 15:59:56.894549 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:56.894529    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:56.898561 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:56.898540    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ipp-cleanup-7a907b-openshift-default-dockercfg-qv628\""
Sep 08 15:59:56.929378 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:56.929338    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"]
Sep 08 15:59:56.941229 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:56.941199    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:57.075271 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075231    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hk82t\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-kube-api-access-hk82t\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.075459 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075284    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.075459 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075366    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-token\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.075459 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075411    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-envoy\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.075599 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075522    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-data\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.075599 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075576    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-credential-socket\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.075693 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075608    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-certs\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.075735 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075699    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-podinfo\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.075771 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.075755    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-socket\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.160595 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.160490    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 15:59:57.176581 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176545    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-podinfo\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.176581 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176589    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-socket\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.176822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176609    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hk82t\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-kube-api-access-hk82t\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.176822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176719    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.176822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176771    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-token\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.176822 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176809    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-envoy\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.177076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176858    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-data\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.177076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176899    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-credential-socket\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.177076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.176932    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-certs\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.177076 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.177043    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-socket\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.177324 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.177298    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-certs\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.177411 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.177333    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-credential-socket\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.177538 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.177516    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istiod-ca-cert\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.177595 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.177579    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-data\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.179528 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.179501    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-envoy\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.179653 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.179638    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-podinfo\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.194311 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.194282    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-token\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.195117 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.195093    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hk82t\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-kube-api-access-hk82t\") pod \"e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") " pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.204973 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.204936    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:57.488376 ip-10-0-134-78 kubenswrapper[2579]: W0908 15:59:57.488348    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod172fe338_85a3_4b70_9d33_e8eb4796d2ea.slice/crio-4a859098c52972dc398946c23645bcb087e0da4931ca370574962b2debd2171a WatchSource:0}: Error finding container 4a859098c52972dc398946c23645bcb087e0da4931ca370574962b2debd2171a: Status 404 returned error can't find the container with id 4a859098c52972dc398946c23645bcb087e0da4931ca370574962b2debd2171a
Sep 08 15:59:57.489924 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.489900    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"]
Sep 08 15:59:57.490714 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.490686    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:59:57.490761 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.490748    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:59:57.490821 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:57.490776    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 15:59:58.437398 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:58.437357    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" event={"ID":"172fe338-85a3-4b70-9d33-e8eb4796d2ea","Type":"ContainerStarted","Data":"a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4"}
Sep 08 15:59:58.437584 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:58.437423    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" event={"ID":"172fe338-85a3-4b70-9d33-e8eb4796d2ea","Type":"ContainerStarted","Data":"4a859098c52972dc398946c23645bcb087e0da4931ca370574962b2debd2171a"}
Sep 08 15:59:58.459204 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:58.459160    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" podStartSLOduration=2.459145018 podStartE2EDuration="2.459145018s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 15:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 15:59:58.45690351 +0000 UTC m=+1658.817446276" watchObservedRunningTime="2026-09-08 15:59:58.459145018 +0000 UTC m=+1658.819687784"
Sep 08 15:59:59.205785 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:59.205741    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:59.211825 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:59.211795    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:59.443710 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:59.443676    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 15:59:59.444824 ip-10-0-134-78 kubenswrapper[2579]: I0908 15:59:59.444798    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 16:00:00.139896 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.139860    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"]
Sep 08 16:00:00.145694 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.145671    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"
Sep 08 16:00:00.148276 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.148254    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-vcp9j\""
Sep 08 16:00:00.159260 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.159043    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"
Sep 08 16:00:00.159512 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.159485    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"]
Sep 08 16:00:00.436730 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.436696    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"]
Sep 08 16:00:00.438135 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:00:00.438100    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d559c92_0eb2_4c9b_af2f_1b8c2ae63d58.slice/crio-b0278a8709df608e83d255bdd9988abd203df99c0074f081dfa0fa0168afa38d WatchSource:0}: Error finding container b0278a8709df608e83d255bdd9988abd203df99c0074f081dfa0fa0168afa38d: Status 404 returned error can't find the container with id b0278a8709df608e83d255bdd9988abd203df99c0074f081dfa0fa0168afa38d
Sep 08 16:00:00.450613 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.450575    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp" event={"ID":"5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58","Type":"ContainerStarted","Data":"b0278a8709df608e83d255bdd9988abd203df99c0074f081dfa0fa0168afa38d"}
Sep 08 16:00:00.658666 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.658625    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:00.757930 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:00.757829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:01.618294 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.618257    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"]
Sep 08 16:00:01.625150 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.625120    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.627849 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.627825    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-ipp-cleanup-7a907b-serving-cert\""
Sep 08 16:00:01.634453 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.634424    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"]
Sep 08 16:00:01.723262 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.723221    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.723440 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.723283    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc5d656-c79a-45dc-a05a-edef4afe3f52-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.723440 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.723301    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.723440 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.723350    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c69zr\" (UniqueName: \"kubernetes.io/projected/bfc5d656-c79a-45dc-a05a-edef4afe3f52-kube-api-access-c69zr\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.824283 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.824243    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.824498 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.824327    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc5d656-c79a-45dc-a05a-edef4afe3f52-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.824498 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:01.824409    2579 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-serving-cert: secret "maas-api-e2e-ipp-cleanup-7a907b-serving-cert" not found
Sep 08 16:00:01.824498 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.824445    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.824498 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:01.824473    2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls podName:bfc5d656-c79a-45dc-a05a-edef4afe3f52 nodeName:}" failed. No retries permitted until 2026-09-08 16:00:02.324456233 +0000 UTC m=+1662.684998979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls") pod "maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq" (UID: "bfc5d656-c79a-45dc-a05a-edef4afe3f52") : secret "maas-api-e2e-ipp-cleanup-7a907b-serving-cert" not found
Sep 08 16:00:01.824746 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.824506    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c69zr\" (UniqueName: \"kubernetes.io/projected/bfc5d656-c79a-45dc-a05a-edef4afe3f52-kube-api-access-c69zr\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.825021 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.825002    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc5d656-c79a-45dc-a05a-edef4afe3f52-openshift-service-ca\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.826877 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.826853    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-metrics-certs\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.847378 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.847349    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c69zr\" (UniqueName: \"kubernetes.io/projected/bfc5d656-c79a-45dc-a05a-edef4afe3f52-kube-api-access-c69zr\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:01.948114 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:01.948016    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:02.253195 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.253106    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:02.313902 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.313863    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"]
Sep 08 16:00:02.318371 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.318351    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:02.321101 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.321076    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins-e2e-ipp-cleanup-7a907b\""
Sep 08 16:00:02.321205 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.321108    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-e2e-ipp-cleanup-7a907b-dockercfg-z8q74\""
Sep 08 16:00:02.326101 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.326070    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"]
Sep 08 16:00:02.329179 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.329150    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/015e078e-222e-412d-8fcb-c09e54f44905-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc\" (UID: \"015e078e-222e-412d-8fcb-c09e54f44905\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:02.329317 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.329213    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:02.329386 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.329345    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrc2f\" (UniqueName: \"kubernetes.io/projected/015e078e-222e-412d-8fcb-c09e54f44905-kube-api-access-xrc2f\") pod \"payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc\" (UID: \"015e078e-222e-412d-8fcb-c09e54f44905\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:02.331793 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.331763    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls\") pod \"maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") " pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:02.345738 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.345703    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"]
Sep 08 16:00:02.349823 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.349797    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:02.358879 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.358851    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"]
Sep 08 16:00:02.430324 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.430276    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/015e078e-222e-412d-8fcb-c09e54f44905-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc\" (UID: \"015e078e-222e-412d-8fcb-c09e54f44905\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:02.430547 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.430408    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwx4\" (UniqueName: \"kubernetes.io/projected/549b9225-e92b-4696-810d-ae8f04106299-kube-api-access-nbwx4\") pod \"payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v\" (UID: \"549b9225-e92b-4696-810d-ae8f04106299\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:02.430547 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.430486    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/549b9225-e92b-4696-810d-ae8f04106299-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v\" (UID: \"549b9225-e92b-4696-810d-ae8f04106299\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:02.430662 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.430568    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrc2f\" (UniqueName: \"kubernetes.io/projected/015e078e-222e-412d-8fcb-c09e54f44905-kube-api-access-xrc2f\") pod \"payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc\" (UID: \"015e078e-222e-412d-8fcb-c09e54f44905\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:02.431289 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.431259    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/015e078e-222e-412d-8fcb-c09e54f44905-plugins-config-volume\") pod \"payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc\" (UID: \"015e078e-222e-412d-8fcb-c09e54f44905\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:02.439260 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.439225    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrc2f\" (UniqueName: \"kubernetes.io/projected/015e078e-222e-412d-8fcb-c09e54f44905-kube-api-access-xrc2f\") pod \"payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc\" (UID: \"015e078e-222e-412d-8fcb-c09e54f44905\") " pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:02.500368 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.500328    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:02.531514 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.531405    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwx4\" (UniqueName: \"kubernetes.io/projected/549b9225-e92b-4696-810d-ae8f04106299-kube-api-access-nbwx4\") pod \"payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v\" (UID: \"549b9225-e92b-4696-810d-ae8f04106299\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:02.531514 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.531474    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/549b9225-e92b-4696-810d-ae8f04106299-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v\" (UID: \"549b9225-e92b-4696-810d-ae8f04106299\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:02.532218 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.532194    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/549b9225-e92b-4696-810d-ae8f04106299-plugins-config-volume\") pod \"payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v\" (UID: \"549b9225-e92b-4696-810d-ae8f04106299\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:02.539391 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.539361    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:02.541238 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.541214    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwx4\" (UniqueName: \"kubernetes.io/projected/549b9225-e92b-4696-810d-ae8f04106299-kube-api-access-nbwx4\") pod \"payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v\" (UID: \"549b9225-e92b-4696-810d-ae8f04106299\") " pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:02.632496 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.632457    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:02.662336 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.662301    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:02.817014 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.816980    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"]
Sep 08 16:00:02.817869 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:00:02.817843    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbfc5d656_c79a_45dc_a05a_edef4afe3f52.slice/crio-7bdea8eac43f03b9cc05f5a49906c1c3e3931ee378bbe5711bbe8e2422ca2335 WatchSource:0}: Error finding container 7bdea8eac43f03b9cc05f5a49906c1c3e3931ee378bbe5711bbe8e2422ca2335: Status 404 returned error can't find the container with id 7bdea8eac43f03b9cc05f5a49906c1c3e3931ee378bbe5711bbe8e2422ca2335
Sep 08 16:00:02.910155 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.910127    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"]
Sep 08 16:00:02.912400 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:00:02.912360    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod015e078e_222e_412d_8fcb_c09e54f44905.slice/crio-7da8ad81a18e9813d59840d9ba2967b447be86076d4f2bf03471613e4ddc2de8 WatchSource:0}: Error finding container 7da8ad81a18e9813d59840d9ba2967b447be86076d4f2bf03471613e4ddc2de8: Status 404 returned error can't find the container with id 7da8ad81a18e9813d59840d9ba2967b447be86076d4f2bf03471613e4ddc2de8
Sep 08 16:00:02.947477 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:02.947447    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"]
Sep 08 16:00:02.950151 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:00:02.950126    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod549b9225_e92b_4696_810d_ae8f04106299.slice/crio-c52d1eebe9a637b578cc3ef0bbf1f147464dc4c2b1cea5e170ad922f1d4eab73 WatchSource:0}: Error finding container c52d1eebe9a637b578cc3ef0bbf1f147464dc4c2b1cea5e170ad922f1d4eab73: Status 404 returned error can't find the container with id c52d1eebe9a637b578cc3ef0bbf1f147464dc4c2b1cea5e170ad922f1d4eab73
Sep 08 16:00:03.471982 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.471922    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc" event={"ID":"015e078e-222e-412d-8fcb-c09e54f44905","Type":"ContainerStarted","Data":"b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf"}
Sep 08 16:00:03.472169 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.472012    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc" event={"ID":"015e078e-222e-412d-8fcb-c09e54f44905","Type":"ContainerStarted","Data":"7da8ad81a18e9813d59840d9ba2967b447be86076d4f2bf03471613e4ddc2de8"}
Sep 08 16:00:03.472169 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.472053    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:03.473694 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.473663    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq" event={"ID":"bfc5d656-c79a-45dc-a05a-edef4afe3f52","Type":"ContainerStarted","Data":"7bdea8eac43f03b9cc05f5a49906c1c3e3931ee378bbe5711bbe8e2422ca2335"}
Sep 08 16:00:03.475688 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.475657    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v" event={"ID":"549b9225-e92b-4696-810d-ae8f04106299","Type":"ContainerStarted","Data":"a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad"}
Sep 08 16:00:03.475825 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.475702    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v" event={"ID":"549b9225-e92b-4696-810d-ae8f04106299","Type":"ContainerStarted","Data":"c52d1eebe9a637b578cc3ef0bbf1f147464dc4c2b1cea5e170ad922f1d4eab73"}
Sep 08 16:00:03.475825 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.475807    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:03.491715 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.491654    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc" podStartSLOduration=1.491635678 podStartE2EDuration="1.491635678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:00:03.48908848 +0000 UTC m=+1663.849631247" watchObservedRunningTime="2026-09-08 16:00:03.491635678 +0000 UTC m=+1663.852178440"
Sep 08 16:00:03.505403 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:03.505343    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v" podStartSLOduration=1.505325807 podStartE2EDuration="1.505325807s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:00:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:00:03.504496329 +0000 UTC m=+1663.865039095" watchObservedRunningTime="2026-09-08 16:00:03.505325807 +0000 UTC m=+1663.865868572"
Sep 08 16:00:04.484357 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:04.484261    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq" event={"ID":"bfc5d656-c79a-45dc-a05a-edef4afe3f52","Type":"ContainerStarted","Data":"4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274"}
Sep 08 16:00:04.484806 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:04.484582    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:04.505970 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:04.505899    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq" podStartSLOduration=2.207224689 podStartE2EDuration="3.505880207s" totalImagesPullingTime="1.298655518s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:00:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:00:04.503231082 +0000 UTC m=+1664.863773847" watchObservedRunningTime="2026-09-08 16:00:04.505880207 +0000 UTC m=+1664.866422977"
Sep 08 16:00:10.200699 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:10.200657    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:00:10.495818 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:10.495710    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:14.492582 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:14.492432    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:14.493246 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:14.493114    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:15.555677 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:15.555643    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp" event={"ID":"5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58","Type":"ContainerStarted","Data":"bf258c8794c50689c70e311a035d5388080c970bc168e900a2efe4e02a28a99f"}
Sep 08 16:00:15.572488 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:15.572425    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp" podStartSLOduration=0.932293973 podStartE2EDuration="15.572404136s" totalImagesPullingTime="14.640110163s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:00:15.571016962 +0000 UTC m=+1675.931559727" watchObservedRunningTime="2026-09-08 16:00:15.572404136 +0000 UTC m=+1675.932946902"
Sep 08 16:00:16.563188 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:16.563150    2579 generic.go:356] "Generic (PLEG): container finished" podID="5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58" containerID="bf258c8794c50689c70e311a035d5388080c970bc168e900a2efe4e02a28a99f" exitCode=0
Sep 08 16:00:16.563602 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:16.563193    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp" event={"ID":"5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58","Type":"ContainerDied","Data":"bf258c8794c50689c70e311a035d5388080c970bc168e900a2efe4e02a28a99f"}
Sep 08 16:00:17.734745 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:17.734713    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"
Sep 08 16:00:18.601390 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:18.601360    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"
Sep 08 16:00:18.601595 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:18.601407    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp" event={"ID":"5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58","Type":"ContainerDied","Data":"b0278a8709df608e83d255bdd9988abd203df99c0074f081dfa0fa0168afa38d"}
Sep 08 16:00:18.601595 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:18.601460    2579 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b0278a8709df608e83d255bdd9988abd203df99c0074f081dfa0fa0168afa38d"
Sep 08 16:00:21.621059 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:21.621027    2579 generic.go:356] "Generic (PLEG): container finished" podID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerID="a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4" exitCode=0
Sep 08 16:00:21.621490 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:21.621105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" event={"ID":"172fe338-85a3-4b70-9d33-e8eb4796d2ea","Type":"ContainerDied","Data":"a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4"}
Sep 08 16:00:21.621591 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:21.621575    2579 scope.go:117] "RemoveContainer" containerID="a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4"
Sep 08 16:00:21.622753 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:21.622723    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 16:00:21.622819 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:21.622798    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 16:00:21.622856 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:21.622830    2579 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236204Ki","pods":"250"}
Sep 08 16:00:22.628999 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:22.628948    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" event={"ID":"172fe338-85a3-4b70-9d33-e8eb4796d2ea","Type":"ContainerStarted","Data":"1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66"}
Sep 08 16:00:23.206108 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:23.206068    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 16:00:23.206350 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:23.206323    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 08 16:00:23.206424 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:23.206380    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 08 16:00:24.205426 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:24.205391    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 08 16:00:24.205831 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:24.205448    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 08 16:00:25.206148 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.206103    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 08 16:00:25.206646 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.206161    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 08 16:00:25.473028 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.472999    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:25.648169 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.648135    2579 generic.go:356] "Generic (PLEG): container finished" podID="aa46a3da-3121-4db0-b7ff-0016ee0bfd28" containerID="6bb8783b289b1aef43dc4d1af0f017209adeceb7adea3a300c6d05c476f73ebc" exitCode=137
Sep 08 16:00:25.648331 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.648210    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9" event={"ID":"aa46a3da-3121-4db0-b7ff-0016ee0bfd28","Type":"ContainerDied","Data":"6bb8783b289b1aef43dc4d1af0f017209adeceb7adea3a300c6d05c476f73ebc"}
Sep 08 16:00:25.857322 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.857287    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 16:00:25.999496 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.999407    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-plugin-serving-cert\") pod \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") "
Sep 08 16:00:25.999496 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.999479    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-nginx-conf\") pod \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") "
Sep 08 16:00:25.999736 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:25.999553    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xn9km\" (UniqueName: \"kubernetes.io/projected/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-kube-api-access-xn9km\") pod \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\" (UID: \"aa46a3da-3121-4db0-b7ff-0016ee0bfd28\") "
Sep 08 16:00:26.001582 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.001550    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-plugin-serving-cert" (OuterVolumeSpecName: "plugin-serving-cert") pod "aa46a3da-3121-4db0-b7ff-0016ee0bfd28" (UID: "aa46a3da-3121-4db0-b7ff-0016ee0bfd28"). InnerVolumeSpecName "plugin-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:00:26.001696 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.001615    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-kube-api-access-xn9km" (OuterVolumeSpecName: "kube-api-access-xn9km") pod "aa46a3da-3121-4db0-b7ff-0016ee0bfd28" (UID: "aa46a3da-3121-4db0-b7ff-0016ee0bfd28"). InnerVolumeSpecName "kube-api-access-xn9km". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:26.004801 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.004775    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-nginx-conf" (OuterVolumeSpecName: "nginx-conf") pod "aa46a3da-3121-4db0-b7ff-0016ee0bfd28" (UID: "aa46a3da-3121-4db0-b7ff-0016ee0bfd28"). InnerVolumeSpecName "nginx-conf". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:26.100490 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.100445    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xn9km\" (UniqueName: \"kubernetes.io/projected/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-kube-api-access-xn9km\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:26.100490 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.100482    2579 reconciler_common.go:299] "Volume detached for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-plugin-serving-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:26.100490 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.100494    2579 reconciler_common.go:299] "Volume detached for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/aa46a3da-3121-4db0-b7ff-0016ee0bfd28-nginx-conf\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:26.206191 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.206154    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 08 16:00:26.206589 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.206223    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 08 16:00:26.656377 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.656351    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"
Sep 08 16:00:26.656377 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.656371    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9" event={"ID":"aa46a3da-3121-4db0-b7ff-0016ee0bfd28","Type":"ContainerDied","Data":"560d505ffadd6c2b50f6853edbdb866d965528a63311df5ecdfe1bb85898d569"}
Sep 08 16:00:26.656604 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.656418    2579 scope.go:117] "RemoveContainer" containerID="6bb8783b289b1aef43dc4d1af0f017209adeceb7adea3a300c6d05c476f73ebc"
Sep 08 16:00:26.675127 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.675091    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"]
Sep 08 16:00:26.684630 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:26.684591    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-598f86468b-mkbz9"]
Sep 08 16:00:27.206184 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:27.206145    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused" start-of-body=
Sep 08 16:00:27.206372 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:27.206214    2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.93:15021/healthz/ready\": dial tcp 10.132.0.93:15021: connect: connection refused"
Sep 08 16:00:28.115143 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:28.115103    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa46a3da-3121-4db0-b7ff-0016ee0bfd28" path="/var/lib/kubelet/pods/aa46a3da-3121-4db0-b7ff-0016ee0bfd28/volumes"
Sep 08 16:00:28.209761 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:28.209729    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 16:00:28.210168 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:28.210009    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 16:00:28.210794 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:28.210777    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 16:00:32.284193 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.284157    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"]
Sep 08 16:00:32.284642 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.284414    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq" podUID="bfc5d656-c79a-45dc-a05a-edef4afe3f52" containerName="maas-api" containerID="cri-o://4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274" gracePeriod=30
Sep 08 16:00:32.318102 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.318067    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:32.339586 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.339558    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"]
Sep 08 16:00:32.339790 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.339768    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v" podUID="549b9225-e92b-4696-810d-ae8f04106299" containerName="payload-processing" containerID="cri-o://a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad" gracePeriod=30
Sep 08 16:00:32.351167 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.351136    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"]
Sep 08 16:00:32.351412 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.351377    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc" podUID="015e078e-222e-412d-8fcb-c09e54f44905" containerName="payload-pre-processing" containerID="cri-o://b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf" gracePeriod=30
Sep 08 16:00:32.415700 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.415653    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:32.526931 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.526891    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:32.601979 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.601829    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:32.609039 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.609014    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:32.652570 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.652543    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:32.654833 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.654809    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nbwx4\" (UniqueName: \"kubernetes.io/projected/549b9225-e92b-4696-810d-ae8f04106299-kube-api-access-nbwx4\") pod \"549b9225-e92b-4696-810d-ae8f04106299\" (UID: \"549b9225-e92b-4696-810d-ae8f04106299\") "
Sep 08 16:00:32.654940 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.654845    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls\") pod \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") "
Sep 08 16:00:32.654940 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.654875    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-metrics-certs\") pod \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") "
Sep 08 16:00:32.655071 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.655034    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c69zr\" (UniqueName: \"kubernetes.io/projected/bfc5d656-c79a-45dc-a05a-edef4afe3f52-kube-api-access-c69zr\") pod \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") "
Sep 08 16:00:32.655147 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.655131    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc5d656-c79a-45dc-a05a-edef4afe3f52-openshift-service-ca\") pod \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\" (UID: \"bfc5d656-c79a-45dc-a05a-edef4afe3f52\") "
Sep 08 16:00:32.655223 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.655207    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/549b9225-e92b-4696-810d-ae8f04106299-plugins-config-volume\") pod \"549b9225-e92b-4696-810d-ae8f04106299\" (UID: \"549b9225-e92b-4696-810d-ae8f04106299\") "
Sep 08 16:00:32.655669 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.655636    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bfc5d656-c79a-45dc-a05a-edef4afe3f52-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "bfc5d656-c79a-45dc-a05a-edef4afe3f52" (UID: "bfc5d656-c79a-45dc-a05a-edef4afe3f52"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:32.655669 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.655657    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/549b9225-e92b-4696-810d-ae8f04106299-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "549b9225-e92b-4696-810d-ae8f04106299" (UID: "549b9225-e92b-4696-810d-ae8f04106299"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:32.657446 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.657411    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "bfc5d656-c79a-45dc-a05a-edef4afe3f52" (UID: "bfc5d656-c79a-45dc-a05a-edef4afe3f52"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:00:32.657552 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.657458    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfc5d656-c79a-45dc-a05a-edef4afe3f52-kube-api-access-c69zr" (OuterVolumeSpecName: "kube-api-access-c69zr") pod "bfc5d656-c79a-45dc-a05a-edef4afe3f52" (UID: "bfc5d656-c79a-45dc-a05a-edef4afe3f52"). InnerVolumeSpecName "kube-api-access-c69zr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:32.657670 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.657543    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "bfc5d656-c79a-45dc-a05a-edef4afe3f52" (UID: "bfc5d656-c79a-45dc-a05a-edef4afe3f52"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:00:32.657670 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.657552    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/549b9225-e92b-4696-810d-ae8f04106299-kube-api-access-nbwx4" (OuterVolumeSpecName: "kube-api-access-nbwx4") pod "549b9225-e92b-4696-810d-ae8f04106299" (UID: "549b9225-e92b-4696-810d-ae8f04106299"). InnerVolumeSpecName "kube-api-access-nbwx4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:32.666272 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.666250    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:32.696471 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.696438    2579 generic.go:356] "Generic (PLEG): container finished" podID="bfc5d656-c79a-45dc-a05a-edef4afe3f52" containerID="4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274" exitCode=0
Sep 08 16:00:32.696656 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.696535    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq" event={"ID":"bfc5d656-c79a-45dc-a05a-edef4afe3f52","Type":"ContainerDied","Data":"4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274"}
Sep 08 16:00:32.696656 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.696614    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq" event={"ID":"bfc5d656-c79a-45dc-a05a-edef4afe3f52","Type":"ContainerDied","Data":"7bdea8eac43f03b9cc05f5a49906c1c3e3931ee378bbe5711bbe8e2422ca2335"}
Sep 08 16:00:32.696656 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.696646    2579 scope.go:117] "RemoveContainer" containerID="4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274"
Sep 08 16:00:32.696837 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.696798    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"
Sep 08 16:00:32.698826 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.698799    2579 generic.go:356] "Generic (PLEG): container finished" podID="549b9225-e92b-4696-810d-ae8f04106299" containerID="a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad" exitCode=0
Sep 08 16:00:32.698949 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.698847    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"
Sep 08 16:00:32.698949 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.698890    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v" event={"ID":"549b9225-e92b-4696-810d-ae8f04106299","Type":"ContainerDied","Data":"a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad"}
Sep 08 16:00:32.698949 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.698941    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v" event={"ID":"549b9225-e92b-4696-810d-ae8f04106299","Type":"ContainerDied","Data":"c52d1eebe9a637b578cc3ef0bbf1f147464dc4c2b1cea5e170ad922f1d4eab73"}
Sep 08 16:00:32.700529 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.700505    2579 generic.go:356] "Generic (PLEG): container finished" podID="015e078e-222e-412d-8fcb-c09e54f44905" containerID="b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf" exitCode=0
Sep 08 16:00:32.700647 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.700604    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"
Sep 08 16:00:32.700647 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.700629    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc" event={"ID":"015e078e-222e-412d-8fcb-c09e54f44905","Type":"ContainerDied","Data":"b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf"}
Sep 08 16:00:32.700769 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.700674    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc" event={"ID":"015e078e-222e-412d-8fcb-c09e54f44905","Type":"ContainerDied","Data":"7da8ad81a18e9813d59840d9ba2967b447be86076d4f2bf03471613e4ddc2de8"}
Sep 08 16:00:32.707505 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.707482    2579 scope.go:117] "RemoveContainer" containerID="4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274"
Sep 08 16:00:32.707782 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:32.707767    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274\": container with ID starting with 4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274 not found: ID does not exist" containerID="4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274"
Sep 08 16:00:32.707858 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.707793    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274"} err="failed to get container status \"4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274\": rpc error: code = NotFound desc = could not find container \"4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274\": container with ID starting with 4138cf2c43b7cd7e22641cdfc6ce9d4a356a160d6f0327f5afd35194b2eda274 not found: ID does not exist"
Sep 08 16:00:32.707858 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.707815    2579 scope.go:117] "RemoveContainer" containerID="a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad"
Sep 08 16:00:32.720490 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.720447    2579 scope.go:117] "RemoveContainer" containerID="a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad"
Sep 08 16:00:32.721527 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:32.721498    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad\": container with ID starting with a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad not found: ID does not exist" containerID="a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad"
Sep 08 16:00:32.721663 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.721537    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad"} err="failed to get container status \"a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad\": rpc error: code = NotFound desc = could not find container \"a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad\": container with ID starting with a1512d6cbf05c89221617cf927be8e899e684e0dab20d1c4ea18e676d3a3a9ad not found: ID does not exist"
Sep 08 16:00:32.721663 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.721563    2579 scope.go:117] "RemoveContainer" containerID="b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf"
Sep 08 16:00:32.726684 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.726661    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"]
Sep 08 16:00:32.730826 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.730804    2579 scope.go:117] "RemoveContainer" containerID="b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf"
Sep 08 16:00:32.731031 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.731008    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-ipp-cleanup-7a907b-5c7d4dbddc-twzkq"]
Sep 08 16:00:32.731151 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:32.731131    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf\": container with ID starting with b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf not found: ID does not exist" containerID="b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf"
Sep 08 16:00:32.731205 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.731158    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf"} err="failed to get container status \"b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf\": rpc error: code = NotFound desc = could not find container \"b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf\": container with ID starting with b9d38db1f9a745394c39cb86149942b6e0211c472c0578491e5fbab028df84cf not found: ID does not exist"
Sep 08 16:00:32.739761 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.739675    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"]
Sep 08 16:00:32.742208 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.742189    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-cleanup-7a907b-54c996fc8c-t5d8v"]
Sep 08 16:00:32.756633 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.756612    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xrc2f\" (UniqueName: \"kubernetes.io/projected/015e078e-222e-412d-8fcb-c09e54f44905-kube-api-access-xrc2f\") pod \"015e078e-222e-412d-8fcb-c09e54f44905\" (UID: \"015e078e-222e-412d-8fcb-c09e54f44905\") "
Sep 08 16:00:32.756708 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.756644    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/015e078e-222e-412d-8fcb-c09e54f44905-plugins-config-volume\") pod \"015e078e-222e-412d-8fcb-c09e54f44905\" (UID: \"015e078e-222e-412d-8fcb-c09e54f44905\") "
Sep 08 16:00:32.756825 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.756814    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/549b9225-e92b-4696-810d-ae8f04106299-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:32.756863 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.756827    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nbwx4\" (UniqueName: \"kubernetes.io/projected/549b9225-e92b-4696-810d-ae8f04106299-kube-api-access-nbwx4\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:32.756863 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.756836    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:32.756863 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.756844    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bfc5d656-c79a-45dc-a05a-edef4afe3f52-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:32.756863 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.756853    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c69zr\" (UniqueName: \"kubernetes.io/projected/bfc5d656-c79a-45dc-a05a-edef4afe3f52-kube-api-access-c69zr\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:32.756863 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.756861    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bfc5d656-c79a-45dc-a05a-edef4afe3f52-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:32.757056 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.757033    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/015e078e-222e-412d-8fcb-c09e54f44905-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "015e078e-222e-412d-8fcb-c09e54f44905" (UID: "015e078e-222e-412d-8fcb-c09e54f44905"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:32.758597 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.758578    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/015e078e-222e-412d-8fcb-c09e54f44905-kube-api-access-xrc2f" (OuterVolumeSpecName: "kube-api-access-xrc2f") pod "015e078e-222e-412d-8fcb-c09e54f44905" (UID: "015e078e-222e-412d-8fcb-c09e54f44905"). InnerVolumeSpecName "kube-api-access-xrc2f". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:32.858281 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.858250    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xrc2f\" (UniqueName: \"kubernetes.io/projected/015e078e-222e-412d-8fcb-c09e54f44905-kube-api-access-xrc2f\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:32.858281 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.858279    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/015e078e-222e-412d-8fcb-c09e54f44905-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:32.884772 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:32.884732    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:33.023535 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:33.023502    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"]
Sep 08 16:00:33.027617 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:33.027587    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-cleanup-7a907b-65dff97694-8k8cc"]
Sep 08 16:00:34.114596 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:34.114562    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="015e078e-222e-412d-8fcb-c09e54f44905" path="/var/lib/kubelet/pods/015e078e-222e-412d-8fcb-c09e54f44905/volumes"
Sep 08 16:00:34.114985 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:34.114919    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="549b9225-e92b-4696-810d-ae8f04106299" path="/var/lib/kubelet/pods/549b9225-e92b-4696-810d-ae8f04106299/volumes"
Sep 08 16:00:34.115322 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:34.115305    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfc5d656-c79a-45dc-a05a-edef4afe3f52" path="/var/lib/kubelet/pods/bfc5d656-c79a-45dc-a05a-edef4afe3f52/volumes"
Sep 08 16:00:36.396370 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:36.396334    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:00:38.662244 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:38.662212    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:38.785386 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:38.785345    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:38.848477 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:38.848440    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"]
Sep 08 16:00:38.848759 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:38.848728    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy" containerID="cri-o://1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66" gracePeriod=30
Sep 08 16:00:38.881956 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:38.879375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:42.764815 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:42.764732    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:43.212407 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:43.212359    2579 patch_prober.go:28] interesting pod/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Sep 08 16:00:43.212583 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:43.212435    2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Sep 08 16:00:44.102301 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.102273    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 16:00:44.165785 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.165693    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-data\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.165785 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.165769    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-socket\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.166053 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.165808    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-credential-socket\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.166053 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.165829    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-podinfo\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.166053 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.165850    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istiod-ca-cert\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.166053 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.165895    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-certs\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.166053 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166003    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-data" (OuterVolumeSpecName: "istio-data") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:44.166053 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166033    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-token\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.166380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166117    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-envoy\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.166380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166124    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:44.166380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166154    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hk82t\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-kube-api-access-hk82t\") pod \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\" (UID: \"172fe338-85a3-4b70-9d33-e8eb4796d2ea\") "
Sep 08 16:00:44.166380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166156    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:44.166380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166192    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:44.166380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166304    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:44.166683 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166495    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.166683 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166518    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.166683 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166531    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.166683 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166544    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.166683 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.166558    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.168305 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.168222    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:00:44.168421 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.168347    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-token" (OuterVolumeSpecName: "istio-token") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:44.168421 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.168347    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-kube-api-access-hk82t" (OuterVolumeSpecName: "kube-api-access-hk82t") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "kube-api-access-hk82t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:44.168421 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.168365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "172fe338-85a3-4b70-9d33-e8eb4796d2ea" (UID: "172fe338-85a3-4b70-9d33-e8eb4796d2ea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:00:44.268122 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.268083    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.268122 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.268114    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.268122 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.268124    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hk82t\" (UniqueName: \"kubernetes.io/projected/172fe338-85a3-4b70-9d33-e8eb4796d2ea-kube-api-access-hk82t\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.268360 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.268136    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/172fe338-85a3-4b70-9d33-e8eb4796d2ea-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:44.774050 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.774015    2579 generic.go:356] "Generic (PLEG): container finished" podID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerID="1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66" exitCode=0
Sep 08 16:00:44.774209 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.774069    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"
Sep 08 16:00:44.774209 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.774105    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" event={"ID":"172fe338-85a3-4b70-9d33-e8eb4796d2ea","Type":"ContainerDied","Data":"1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66"}
Sep 08 16:00:44.774209 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.774162    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6" event={"ID":"172fe338-85a3-4b70-9d33-e8eb4796d2ea","Type":"ContainerDied","Data":"4a859098c52972dc398946c23645bcb087e0da4931ca370574962b2debd2171a"}
Sep 08 16:00:44.774209 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.774186    2579 scope.go:117] "RemoveContainer" containerID="1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66"
Sep 08 16:00:44.784695 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.784676    2579 scope.go:117] "RemoveContainer" containerID="a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4"
Sep 08 16:00:44.793237 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.793214    2579 scope.go:117] "RemoveContainer" containerID="1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66"
Sep 08 16:00:44.793489 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:44.793464    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66\": container with ID starting with 1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66 not found: ID does not exist" containerID="1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66"
Sep 08 16:00:44.793537 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.793507    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66"} err="failed to get container status \"1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66\": rpc error: code = NotFound desc = could not find container \"1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66\": container with ID starting with 1803b32062196cae36e6572745c36a3aa1ea6dc88b6505a65140fc6236510c66 not found: ID does not exist"
Sep 08 16:00:44.793537 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.793526    2579 scope.go:117] "RemoveContainer" containerID="a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4"
Sep 08 16:00:44.793787 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:44.793769    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4\": container with ID starting with a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4 not found: ID does not exist" containerID="a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4"
Sep 08 16:00:44.793822 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.793793    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4"} err="failed to get container status \"a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4\": rpc error: code = NotFound desc = could not find container \"a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4\": container with ID starting with a122b9ae418d7e3f302aca877529ee381e4e2ae4c55bb078dfd2c5f78506cfa4 not found: ID does not exist"
Sep 08 16:00:44.797578 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.797555    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"]
Sep 08 16:00:44.803545 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:44.803525    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-cleanup-7a907b-openshift-default-6cc45f64b4-pn2q6"]
Sep 08 16:00:46.115248 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:46.115217    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" path="/var/lib/kubelet/pods/172fe338-85a3-4b70-9d33-e8eb4796d2ea/volumes"
Sep 08 16:00:55.506952 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:55.506917    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:00:58.071812 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.071707    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"]
Sep 08 16:00:58.072645 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.072585    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv" podUID="07a6760b-a57b-4819-a209-fe35da625a90" containerName="payload-processing" containerID="cri-o://6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e" gracePeriod=30
Sep 08 16:00:58.076988 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.076941    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"]
Sep 08 16:00:58.077251 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.077201    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m" podUID="e793211a-7229-4356-8098-baa42f7a1225" containerName="payload-pre-processing" containerID="cri-o://9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b" gracePeriod=30
Sep 08 16:00:58.342971 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.342931    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 16:00:58.360015 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.359989    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 16:00:58.403715 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.403681    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07a6760b-a57b-4819-a209-fe35da625a90-plugins-config-volume\") pod \"07a6760b-a57b-4819-a209-fe35da625a90\" (UID: \"07a6760b-a57b-4819-a209-fe35da625a90\") "
Sep 08 16:00:58.403907 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.403819    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gh996\" (UniqueName: \"kubernetes.io/projected/07a6760b-a57b-4819-a209-fe35da625a90-kube-api-access-gh996\") pod \"07a6760b-a57b-4819-a209-fe35da625a90\" (UID: \"07a6760b-a57b-4819-a209-fe35da625a90\") "
Sep 08 16:00:58.404132 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.404107    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/07a6760b-a57b-4819-a209-fe35da625a90-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "07a6760b-a57b-4819-a209-fe35da625a90" (UID: "07a6760b-a57b-4819-a209-fe35da625a90"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:58.404237 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.404216    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/07a6760b-a57b-4819-a209-fe35da625a90-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:58.405790 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.405771    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07a6760b-a57b-4819-a209-fe35da625a90-kube-api-access-gh996" (OuterVolumeSpecName: "kube-api-access-gh996") pod "07a6760b-a57b-4819-a209-fe35da625a90" (UID: "07a6760b-a57b-4819-a209-fe35da625a90"). InnerVolumeSpecName "kube-api-access-gh996". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:58.505297 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.505258    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jkhg4\" (UniqueName: \"kubernetes.io/projected/e793211a-7229-4356-8098-baa42f7a1225-kube-api-access-jkhg4\") pod \"e793211a-7229-4356-8098-baa42f7a1225\" (UID: \"e793211a-7229-4356-8098-baa42f7a1225\") "
Sep 08 16:00:58.505297 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.505305    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e793211a-7229-4356-8098-baa42f7a1225-plugins-config-volume\") pod \"e793211a-7229-4356-8098-baa42f7a1225\" (UID: \"e793211a-7229-4356-8098-baa42f7a1225\") "
Sep 08 16:00:58.505558 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.505481    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gh996\" (UniqueName: \"kubernetes.io/projected/07a6760b-a57b-4819-a209-fe35da625a90-kube-api-access-gh996\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:58.505752 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.505725    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e793211a-7229-4356-8098-baa42f7a1225-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "e793211a-7229-4356-8098-baa42f7a1225" (UID: "e793211a-7229-4356-8098-baa42f7a1225"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:00:58.507390 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.507368    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e793211a-7229-4356-8098-baa42f7a1225-kube-api-access-jkhg4" (OuterVolumeSpecName: "kube-api-access-jkhg4") pod "e793211a-7229-4356-8098-baa42f7a1225" (UID: "e793211a-7229-4356-8098-baa42f7a1225"). InnerVolumeSpecName "kube-api-access-jkhg4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:00:58.606935 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.606843    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jkhg4\" (UniqueName: \"kubernetes.io/projected/e793211a-7229-4356-8098-baa42f7a1225-kube-api-access-jkhg4\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:58.606935 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.606874    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e793211a-7229-4356-8098-baa42f7a1225-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:00:58.858615 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.858523    2579 generic.go:356] "Generic (PLEG): container finished" podID="07a6760b-a57b-4819-a209-fe35da625a90" containerID="6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e" exitCode=0
Sep 08 16:00:58.858615 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.858564    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"
Sep 08 16:00:58.858857 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.858613    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv" event={"ID":"07a6760b-a57b-4819-a209-fe35da625a90","Type":"ContainerDied","Data":"6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e"}
Sep 08 16:00:58.858857 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.858671    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv" event={"ID":"07a6760b-a57b-4819-a209-fe35da625a90","Type":"ContainerDied","Data":"725e67eea86412d8d87f85b0be1f4f67aa0e77bb7fa21a787729d6a7a6c8c70e"}
Sep 08 16:00:58.858857 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.858700    2579 scope.go:117] "RemoveContainer" containerID="6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e"
Sep 08 16:00:58.859983 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.859929    2579 generic.go:356] "Generic (PLEG): container finished" podID="e793211a-7229-4356-8098-baa42f7a1225" containerID="9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b" exitCode=0
Sep 08 16:00:58.860088 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.859983    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m" event={"ID":"e793211a-7229-4356-8098-baa42f7a1225","Type":"ContainerDied","Data":"9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b"}
Sep 08 16:00:58.860088 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.860015    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m" event={"ID":"e793211a-7229-4356-8098-baa42f7a1225","Type":"ContainerDied","Data":"679cda0db99f572b4355d4a70e4263d918c893ed6258893cfde9c27831375467"}
Sep 08 16:00:58.860088 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.860059    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"
Sep 08 16:00:58.868705 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.868593    2579 scope.go:117] "RemoveContainer" containerID="6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e"
Sep 08 16:00:58.869004 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:58.868977    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e\": container with ID starting with 6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e not found: ID does not exist" containerID="6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e"
Sep 08 16:00:58.869089 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.869014    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e"} err="failed to get container status \"6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e\": rpc error: code = NotFound desc = could not find container \"6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e\": container with ID starting with 6935b4b1fe8348682599584f3d1e9526e0b4004372096f445d10a32c389acc7e not found: ID does not exist"
Sep 08 16:00:58.869089 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.869031    2579 scope.go:117] "RemoveContainer" containerID="9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b"
Sep 08 16:00:58.878005 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.877986    2579 scope.go:117] "RemoveContainer" containerID="9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b"
Sep 08 16:00:58.878322 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:00:58.878301    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b\": container with ID starting with 9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b not found: ID does not exist" containerID="9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b"
Sep 08 16:00:58.878402 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.878332    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b"} err="failed to get container status \"9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b\": rpc error: code = NotFound desc = could not find container \"9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b\": container with ID starting with 9b4fe9549e11ac22d67885957a56c6f28004339e0b761f86fcb2047f1ce11e7b not found: ID does not exist"
Sep 08 16:00:58.891516 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.891494    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"]
Sep 08 16:00:58.895624 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.895604    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-a-e0da5a-5f4fcb98cd-kdg4m"]
Sep 08 16:00:58.907040 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.907018    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"]
Sep 08 16:00:58.911865 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:58.911843    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-a-e0da5a-5768455f65-wqgjv"]
Sep 08 16:00:59.284230 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:59.284140    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:00:59.340837 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:00:59.340806    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:00.113634 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:00.113602    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07a6760b-a57b-4819-a209-fe35da625a90" path="/var/lib/kubelet/pods/07a6760b-a57b-4819-a209-fe35da625a90/volumes"
Sep 08 16:01:00.113955 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:00.113943    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e793211a-7229-4356-8098-baa42f7a1225" path="/var/lib/kubelet/pods/e793211a-7229-4356-8098-baa42f7a1225/volumes"
Sep 08 16:01:03.573356 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:03.573318    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"]
Sep 08 16:01:03.613978 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:03.613928    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:07.902002 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:07.901954    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:01:18.593898 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.593850    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t" podUID="b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" containerName="main" containerID="cri-o://38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e" gracePeriod=45
Sep 08 16:01:18.841416 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.841390    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 16:01:18.901704 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.901604    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-khk97\" (UniqueName: \"kubernetes.io/projected/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-kube-api-access-khk97\") pod \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") "
Sep 08 16:01:18.901704 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.901675    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-home\") pod \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") "
Sep 08 16:01:18.901913 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.901739    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tmp-dir\") pod \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") "
Sep 08 16:01:18.901913 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.901795    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-model-cache\") pod \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") "
Sep 08 16:01:18.901913 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.901827    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-dshm\") pod \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") "
Sep 08 16:01:18.901913 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.901853    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tls-certs\") pod \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\" (UID: \"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d\") "
Sep 08 16:01:18.902139 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.901936    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-home" (OuterVolumeSpecName: "home") pod "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" (UID: "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:18.902139 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.902092    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" (UID: "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:18.902139 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.902109    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-model-cache" (OuterVolumeSpecName: "model-cache") pod "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" (UID: "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:18.902294 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.902280    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-home\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:18.902353 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.902323    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tmp-dir\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:18.902353 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.902339    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-model-cache\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:18.904109 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.904069    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-dshm" (OuterVolumeSpecName: "dshm") pod "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" (UID: "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:18.904109 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.904098    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-kube-api-access-khk97" (OuterVolumeSpecName: "kube-api-access-khk97") pod "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" (UID: "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d"). InnerVolumeSpecName "kube-api-access-khk97". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:01:18.904256 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.904123    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" (UID: "b87c9c71-0180-4b91-a5bb-733ad3dbaa1d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:01:18.983556 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.983519    2579 generic.go:356] "Generic (PLEG): container finished" podID="b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" containerID="38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e" exitCode=0
Sep 08 16:01:18.983749 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.983568    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"
Sep 08 16:01:18.983749 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.983607    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t" event={"ID":"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d","Type":"ContainerDied","Data":"38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e"}
Sep 08 16:01:18.983749 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.983653    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t" event={"ID":"b87c9c71-0180-4b91-a5bb-733ad3dbaa1d","Type":"ContainerDied","Data":"9a48e2254c5379cd212d1d9dff363a160d74938fc5ab17f35deae921123df072"}
Sep 08 16:01:18.983749 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.983681    2579 scope.go:117] "RemoveContainer" containerID="38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e"
Sep 08 16:01:18.993180 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.993158    2579 scope.go:117] "RemoveContainer" containerID="38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e"
Sep 08 16:01:18.993476 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:01:18.993458    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e\": container with ID starting with 38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e not found: ID does not exist" containerID="38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e"
Sep 08 16:01:18.993526 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:18.993486    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e"} err="failed to get container status \"38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e\": rpc error: code = NotFound desc = could not find container \"38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e\": container with ID starting with 38d828105ae6a364c2cf49f7130e6dc2a282bebb4c1f2a627a84861d5df4cd1e not found: ID does not exist"
Sep 08 16:01:19.004019 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:19.003991    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-khk97\" (UniqueName: \"kubernetes.io/projected/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-kube-api-access-khk97\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:19.004019 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:19.004019    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-dshm\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:19.004185 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:19.004034    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d-tls-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:19.005657 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:19.005636    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"]
Sep 08 16:01:19.009686 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:19.009662    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-ipp-a-e0da5a/ipp-route-e0da5a-kserve-86646bd8c5-pmp2t"]
Sep 08 16:01:20.115761 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:20.115723    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" path="/var/lib/kubelet/pods/b87c9c71-0180-4b91-a5bb-733ad3dbaa1d/volumes"
Sep 08 16:01:40.690655 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:40.690609    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:40.810552 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:40.810516    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:43.164826 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:43.164786    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:46.314473 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:46.314429    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:46.410507 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:46.410471    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:46.624684 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:46.624649    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"]
Sep 08 16:01:46.624877 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:46.624854    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy" containerID="cri-o://626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f" gracePeriod=30
Sep 08 16:01:46.655425 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:46.655391    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:47.093647 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:47.093612    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:51.888418 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:51.888352    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 16:01:52.006832 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.006794    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-credential-socket\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.006832 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.006838    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-certs\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.007103 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.006877    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-socket\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.007103 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.006913    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2tw47\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-kube-api-access-2tw47\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.007103 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.006985    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-podinfo\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.007103 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007048    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:52.007312 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007110    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istiod-ca-cert\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.007312 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007149    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-envoy\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.007312 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007206    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-data\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.007312 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007232    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-token\") pod \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\" (UID: \"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49\") "
Sep 08 16:01:52.007312 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007232    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:52.007312 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007248    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:52.007619 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007482    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-data" (OuterVolumeSpecName: "istio-data") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:52.007619 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007529    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:01:52.007730 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007628    2579 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-credential-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.007730 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007645    2579 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.007730 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007659    2579 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-workload-socket\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.007730 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007672    2579 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istiod-ca-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.007730 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.007684    2579 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-data\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.009235 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.009209    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-kube-api-access-2tw47" (OuterVolumeSpecName: "kube-api-access-2tw47") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "kube-api-access-2tw47". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:01:52.009360 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.009287    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-token" (OuterVolumeSpecName: "istio-token") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:01:52.009423 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.009357    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:01:52.009423 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.009365    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" (UID: "4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Sep 08 16:01:52.108189 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.108153    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2tw47\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-kube-api-access-2tw47\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.108351 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.108204    2579 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-podinfo\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.108351 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.108228    2579 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-envoy\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.108351 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.108330    2579 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49-istio-token\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:52.163692 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.163601    2579 generic.go:356] "Generic (PLEG): container finished" podID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerID="626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f" exitCode=0
Sep 08 16:01:52.163692 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.163649    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"
Sep 08 16:01:52.163886 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.163688    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" event={"ID":"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49","Type":"ContainerDied","Data":"626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f"}
Sep 08 16:01:52.163886 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.163740    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv" event={"ID":"4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49","Type":"ContainerDied","Data":"5dd465eeee79318f49b7db7accfed94fcd8475ed387089a8dce1418ec07570bc"}
Sep 08 16:01:52.163886 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.163764    2579 scope.go:117] "RemoveContainer" containerID="626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f"
Sep 08 16:01:52.172785 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.172768    2579 scope.go:117] "RemoveContainer" containerID="a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8"
Sep 08 16:01:52.180670 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.180615    2579 scope.go:117] "RemoveContainer" containerID="626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f"
Sep 08 16:01:52.181069 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:01:52.180997    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f\": container with ID starting with 626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f not found: ID does not exist" containerID="626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f"
Sep 08 16:01:52.181069 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.181040    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f"} err="failed to get container status \"626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f\": rpc error: code = NotFound desc = could not find container \"626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f\": container with ID starting with 626d078a1f06e0089144e77065645b7fc5fccbbfc2bd6625bde80ccfc170117f not found: ID does not exist"
Sep 08 16:01:52.181221 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.181075    2579 scope.go:117] "RemoveContainer" containerID="a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8"
Sep 08 16:01:52.181356 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:01:52.181338    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8\": container with ID starting with a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8 not found: ID does not exist" containerID="a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8"
Sep 08 16:01:52.181396 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.181362    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8"} err="failed to get container status \"a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8\": rpc error: code = NotFound desc = could not find container \"a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8\": container with ID starting with a45f10ee28cfa1256245ead0d93c409407f1bf5112af740211cebbb387de12e8 not found: ID does not exist"
Sep 08 16:01:52.182795 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.182776    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"]
Sep 08 16:01:52.187012 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:52.186989    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ipp-a-e0da5a-openshift-default-f568fcb74-w58gv"]
Sep 08 16:01:54.113684 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:54.113647    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" path="/var/lib/kubelet/pods/4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49/volumes"
Sep 08 16:01:57.480837 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.480791    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:57.481791 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.481766    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"]
Sep 08 16:01:57.484146 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.484123    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ipp-b-a3a348-29814720-45bfp"]
Sep 08 16:01:57.503903 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.503873    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"]
Sep 08 16:01:57.504177 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.504152    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv" podUID="3b0d5201-e82e-4add-9ea7-1c40c1728428" containerName="payload-processing" containerID="cri-o://cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf" gracePeriod=30
Sep 08 16:01:57.513207 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.513181    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"]
Sep 08 16:01:57.513423 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.513402    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf" podUID="9c1c3770-d704-418d-b3fd-8de51a16db35" containerName="payload-pre-processing" containerID="cri-o://ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5" gracePeriod=30
Sep 08 16:01:57.546857 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.546826    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:57.620249 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.619943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:57.684478 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.684363    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:57.780670 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.780641    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 16:01:57.783502 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.783484    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 16:01:57.962360 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.962332    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b0d5201-e82e-4add-9ea7-1c40c1728428-plugins-config-volume\") pod \"3b0d5201-e82e-4add-9ea7-1c40c1728428\" (UID: \"3b0d5201-e82e-4add-9ea7-1c40c1728428\") "
Sep 08 16:01:57.962539 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.962394    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xk726\" (UniqueName: \"kubernetes.io/projected/3b0d5201-e82e-4add-9ea7-1c40c1728428-kube-api-access-xk726\") pod \"3b0d5201-e82e-4add-9ea7-1c40c1728428\" (UID: \"3b0d5201-e82e-4add-9ea7-1c40c1728428\") "
Sep 08 16:01:57.962539 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.962437    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1c3770-d704-418d-b3fd-8de51a16db35-plugins-config-volume\") pod \"9c1c3770-d704-418d-b3fd-8de51a16db35\" (UID: \"9c1c3770-d704-418d-b3fd-8de51a16db35\") "
Sep 08 16:01:57.962539 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.962473    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qjpbb\" (UniqueName: \"kubernetes.io/projected/9c1c3770-d704-418d-b3fd-8de51a16db35-kube-api-access-qjpbb\") pod \"9c1c3770-d704-418d-b3fd-8de51a16db35\" (UID: \"9c1c3770-d704-418d-b3fd-8de51a16db35\") "
Sep 08 16:01:57.962796 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.962765    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b0d5201-e82e-4add-9ea7-1c40c1728428-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "3b0d5201-e82e-4add-9ea7-1c40c1728428" (UID: "3b0d5201-e82e-4add-9ea7-1c40c1728428"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:01:57.962862 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.962829    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c1c3770-d704-418d-b3fd-8de51a16db35-plugins-config-volume" (OuterVolumeSpecName: "plugins-config-volume") pod "9c1c3770-d704-418d-b3fd-8de51a16db35" (UID: "9c1c3770-d704-418d-b3fd-8de51a16db35"). InnerVolumeSpecName "plugins-config-volume". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:01:57.964579 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.964556    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c1c3770-d704-418d-b3fd-8de51a16db35-kube-api-access-qjpbb" (OuterVolumeSpecName: "kube-api-access-qjpbb") pod "9c1c3770-d704-418d-b3fd-8de51a16db35" (UID: "9c1c3770-d704-418d-b3fd-8de51a16db35"). InnerVolumeSpecName "kube-api-access-qjpbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:01:57.964672 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:57.964582    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b0d5201-e82e-4add-9ea7-1c40c1728428-kube-api-access-xk726" (OuterVolumeSpecName: "kube-api-access-xk726") pod "3b0d5201-e82e-4add-9ea7-1c40c1728428" (UID: "3b0d5201-e82e-4add-9ea7-1c40c1728428"). InnerVolumeSpecName "kube-api-access-xk726". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:01:58.063423 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.063347    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xk726\" (UniqueName: \"kubernetes.io/projected/3b0d5201-e82e-4add-9ea7-1c40c1728428-kube-api-access-xk726\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:58.063423 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.063373    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9c1c3770-d704-418d-b3fd-8de51a16db35-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:58.063423 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.063384    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qjpbb\" (UniqueName: \"kubernetes.io/projected/9c1c3770-d704-418d-b3fd-8de51a16db35-kube-api-access-qjpbb\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:58.063423 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.063392    2579 reconciler_common.go:299] "Volume detached for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/3b0d5201-e82e-4add-9ea7-1c40c1728428-plugins-config-volume\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:01:58.113560 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.113517    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58" path="/var/lib/kubelet/pods/5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58/volumes"
Sep 08 16:01:58.116705 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.116672    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:01:58.199465 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.199435    2579 generic.go:356] "Generic (PLEG): container finished" podID="9c1c3770-d704-418d-b3fd-8de51a16db35" containerID="ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5" exitCode=0
Sep 08 16:01:58.199628 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.199490    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"
Sep 08 16:01:58.199628 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.199503    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf" event={"ID":"9c1c3770-d704-418d-b3fd-8de51a16db35","Type":"ContainerDied","Data":"ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5"}
Sep 08 16:01:58.199628 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.199558    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf" event={"ID":"9c1c3770-d704-418d-b3fd-8de51a16db35","Type":"ContainerDied","Data":"95a5a4451c699ea2a823e34a369ff1c9cba883726ada59f97c88c590155e8fa5"}
Sep 08 16:01:58.199628 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.199592    2579 scope.go:117] "RemoveContainer" containerID="ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5"
Sep 08 16:01:58.200949 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.200927    2579 generic.go:356] "Generic (PLEG): container finished" podID="3b0d5201-e82e-4add-9ea7-1c40c1728428" containerID="cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf" exitCode=0
Sep 08 16:01:58.201076 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.200981    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"
Sep 08 16:01:58.201076 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.201000    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv" event={"ID":"3b0d5201-e82e-4add-9ea7-1c40c1728428","Type":"ContainerDied","Data":"cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf"}
Sep 08 16:01:58.201076 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.201050    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv" event={"ID":"3b0d5201-e82e-4add-9ea7-1c40c1728428","Type":"ContainerDied","Data":"70644ddbc0433e991f9491f634742918760fd0b29f1f1081e98ca9b34bc7ba22"}
Sep 08 16:01:58.209131 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.209113    2579 scope.go:117] "RemoveContainer" containerID="ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5"
Sep 08 16:01:58.209383 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:01:58.209366    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5\": container with ID starting with ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5 not found: ID does not exist" containerID="ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5"
Sep 08 16:01:58.209455 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.209389    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5"} err="failed to get container status \"ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5\": rpc error: code = NotFound desc = could not find container \"ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5\": container with ID starting with ae231c215e3fb17abd84cb58dde5fadc3610adefbd3312380d1ac5a04723b3c5 not found: ID does not exist"
Sep 08 16:01:58.209455 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.209431    2579 scope.go:117] "RemoveContainer" containerID="cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf"
Sep 08 16:01:58.216991 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.216975    2579 scope.go:117] "RemoveContainer" containerID="cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf"
Sep 08 16:01:58.217244 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:01:58.217225    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf\": container with ID starting with cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf not found: ID does not exist" containerID="cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf"
Sep 08 16:01:58.217287 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.217250    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf"} err="failed to get container status \"cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf\": rpc error: code = NotFound desc = could not find container \"cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf\": container with ID starting with cd6a18a8561ea754eb6c0ac436aa18a013da48d6de3aa9cfddb7be769c456dbf not found: ID does not exist"
Sep 08 16:01:58.228738 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.228709    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"]
Sep 08 16:01:58.230805 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.230782    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-pre-processing-e2e-ipp-b-a3a348-b4f9cfc9d-qdxxf"]
Sep 08 16:01:58.236281 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.236260    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"]
Sep 08 16:01:58.239765 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:01:58.239747    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/payload-processing-e2e-ipp-b-a3a348-576b764df5-dn9rv"]
Sep 08 16:02:00.114710 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:00.114678    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b0d5201-e82e-4add-9ea7-1c40c1728428" path="/var/lib/kubelet/pods/3b0d5201-e82e-4add-9ea7-1c40c1728428/volumes"
Sep 08 16:02:00.115101 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:00.115040    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c1c3770-d704-418d-b3fd-8de51a16db35" path="/var/lib/kubelet/pods/9c1c3770-d704-418d-b3fd-8de51a16db35/volumes"
Sep 08 16:02:00.405098 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:00.405017    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:02:03.878771 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:03.878741    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:03.979945 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:03.979899    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:04.160619 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:04.160532    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:04.673807 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:04.673768    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:05.582187 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:05.582147    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:05.645476 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:05.645445    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:11.075632 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:11.075596    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:14.659917 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:14.659831    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:15.054046 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.053943    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:15.170130 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.170098    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"]
Sep 08 16:02:15.170355 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.170332    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6" podUID="6ec94781-7493-46e7-8c0d-5a9db08bbf06" containerName="maas-api" containerID="cri-o://b8b634b0787ece8f0d33d4d360a62a0c8205db32e90ff25cdeb19bb68c574145" gracePeriod=30
Sep 08 16:02:15.295865 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.295828    2579 generic.go:356] "Generic (PLEG): container finished" podID="6ec94781-7493-46e7-8c0d-5a9db08bbf06" containerID="b8b634b0787ece8f0d33d4d360a62a0c8205db32e90ff25cdeb19bb68c574145" exitCode=0
Sep 08 16:02:15.296037 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.295905    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6" event={"ID":"6ec94781-7493-46e7-8c0d-5a9db08bbf06","Type":"ContainerDied","Data":"b8b634b0787ece8f0d33d4d360a62a0c8205db32e90ff25cdeb19bb68c574145"}
Sep 08 16:02:15.420953 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.420927    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 16:02:15.521556 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.521526    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-metrics-certs\") pod \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") "
Sep 08 16:02:15.521749 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.521570    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec94781-7493-46e7-8c0d-5a9db08bbf06-openshift-service-ca\") pod \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") "
Sep 08 16:02:15.521749 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.521608    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6jzj\" (UniqueName: \"kubernetes.io/projected/6ec94781-7493-46e7-8c0d-5a9db08bbf06-kube-api-access-n6jzj\") pod \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") "
Sep 08 16:02:15.521749 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.521708    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls\") pod \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\" (UID: \"6ec94781-7493-46e7-8c0d-5a9db08bbf06\") "
Sep 08 16:02:15.522015 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.521984    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6ec94781-7493-46e7-8c0d-5a9db08bbf06-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "6ec94781-7493-46e7-8c0d-5a9db08bbf06" (UID: "6ec94781-7493-46e7-8c0d-5a9db08bbf06"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:02:15.523668 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.523640    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "6ec94781-7493-46e7-8c0d-5a9db08bbf06" (UID: "6ec94781-7493-46e7-8c0d-5a9db08bbf06"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:02:15.523784 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.523759    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "6ec94781-7493-46e7-8c0d-5a9db08bbf06" (UID: "6ec94781-7493-46e7-8c0d-5a9db08bbf06"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:02:15.523855 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.523832    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6ec94781-7493-46e7-8c0d-5a9db08bbf06-kube-api-access-n6jzj" (OuterVolumeSpecName: "kube-api-access-n6jzj") pod "6ec94781-7493-46e7-8c0d-5a9db08bbf06" (UID: "6ec94781-7493-46e7-8c0d-5a9db08bbf06"). InnerVolumeSpecName "kube-api-access-n6jzj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:02:15.622404 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.622330    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6jzj\" (UniqueName: \"kubernetes.io/projected/6ec94781-7493-46e7-8c0d-5a9db08bbf06-kube-api-access-n6jzj\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:15.622404 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.622357    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:15.622404 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.622366    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6ec94781-7493-46e7-8c0d-5a9db08bbf06-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:15.622404 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:15.622375    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6ec94781-7493-46e7-8c0d-5a9db08bbf06-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:16.302946 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:16.302913    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"
Sep 08 16:02:16.303388 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:16.302950    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6" event={"ID":"6ec94781-7493-46e7-8c0d-5a9db08bbf06","Type":"ContainerDied","Data":"14b70d8220c1a1ef3fb2b865c8afd61b846c4b0c79b6009cd8f468cb64c3ec6b"}
Sep 08 16:02:16.303388 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:16.303056    2579 scope.go:117] "RemoveContainer" containerID="b8b634b0787ece8f0d33d4d360a62a0c8205db32e90ff25cdeb19bb68c574145"
Sep 08 16:02:16.321369 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:16.321340    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"]
Sep 08 16:02:16.329183 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:16.329153    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-w3-b30e99-6857b6dd47-7ngw6"]
Sep 08 16:02:16.522717 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:16.522637    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:16.633661 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:16.633633    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:18.000110 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:18.000065    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:02:18.114129 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:18.114093    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6ec94781-7493-46e7-8c0d-5a9db08bbf06" path="/var/lib/kubelet/pods/6ec94781-7493-46e7-8c0d-5a9db08bbf06/volumes"
Sep 08 16:02:21.712295 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:21.712253    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:21.770853 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:21.770820    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:21.984391 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:21.984299    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:22.494519 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:22.494480    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:32.771942 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:32.771903    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"]
Sep 08 16:02:32.772405 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:32.772169    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4" podUID="7762d22d-1011-4030-b1e5-18aaeaf64036" containerName="maas-api" containerID="cri-o://d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b" gracePeriod=30
Sep 08 16:02:32.818538 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:32.818501    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:32.917581 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:32.917543    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:33.012567 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.012542    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:33.023758 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.023702    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 16:02:33.085187 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.085152    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:33.188703 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.188672    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-maas-api-tls\") pod \"7762d22d-1011-4030-b1e5-18aaeaf64036\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") "
Sep 08 16:02:33.188899 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.188719    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7762d22d-1011-4030-b1e5-18aaeaf64036-openshift-service-ca\") pod \"7762d22d-1011-4030-b1e5-18aaeaf64036\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") "
Sep 08 16:02:33.188899 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.188752    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-metrics-certs\") pod \"7762d22d-1011-4030-b1e5-18aaeaf64036\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") "
Sep 08 16:02:33.188899 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.188876    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njb78\" (UniqueName: \"kubernetes.io/projected/7762d22d-1011-4030-b1e5-18aaeaf64036-kube-api-access-njb78\") pod \"7762d22d-1011-4030-b1e5-18aaeaf64036\" (UID: \"7762d22d-1011-4030-b1e5-18aaeaf64036\") "
Sep 08 16:02:33.189154 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.189122    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7762d22d-1011-4030-b1e5-18aaeaf64036-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "7762d22d-1011-4030-b1e5-18aaeaf64036" (UID: "7762d22d-1011-4030-b1e5-18aaeaf64036"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:02:33.190869 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.190838    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "7762d22d-1011-4030-b1e5-18aaeaf64036" (UID: "7762d22d-1011-4030-b1e5-18aaeaf64036"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:02:33.191045 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.191019    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7762d22d-1011-4030-b1e5-18aaeaf64036-kube-api-access-njb78" (OuterVolumeSpecName: "kube-api-access-njb78") pod "7762d22d-1011-4030-b1e5-18aaeaf64036" (UID: "7762d22d-1011-4030-b1e5-18aaeaf64036"). InnerVolumeSpecName "kube-api-access-njb78". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:02:33.191180 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.191150    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "7762d22d-1011-4030-b1e5-18aaeaf64036" (UID: "7762d22d-1011-4030-b1e5-18aaeaf64036"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:02:33.290770 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.290672    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njb78\" (UniqueName: \"kubernetes.io/projected/7762d22d-1011-4030-b1e5-18aaeaf64036-kube-api-access-njb78\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:33.290770 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.290759    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:33.291032 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.290786    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/7762d22d-1011-4030-b1e5-18aaeaf64036-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:33.291032 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.290796    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/7762d22d-1011-4030-b1e5-18aaeaf64036-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:33.400823 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.400787    2579 generic.go:356] "Generic (PLEG): container finished" podID="7762d22d-1011-4030-b1e5-18aaeaf64036" containerID="d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b" exitCode=0
Sep 08 16:02:33.400823 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.400826    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"
Sep 08 16:02:33.401126 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.400868    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4" event={"ID":"7762d22d-1011-4030-b1e5-18aaeaf64036","Type":"ContainerDied","Data":"d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b"}
Sep 08 16:02:33.401126 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.400929    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4" event={"ID":"7762d22d-1011-4030-b1e5-18aaeaf64036","Type":"ContainerDied","Data":"d32dd39e74fd243545d2bd260d39e6392bdc34e926e794515f0f964dda61ece3"}
Sep 08 16:02:33.401126 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.400985    2579 scope.go:117] "RemoveContainer" containerID="d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b"
Sep 08 16:02:33.410380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.410359    2579 scope.go:117] "RemoveContainer" containerID="d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b"
Sep 08 16:02:33.410650 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:02:33.410628    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b\": container with ID starting with d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b not found: ID does not exist" containerID="d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b"
Sep 08 16:02:33.410700 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.410660    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b"} err="failed to get container status \"d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b\": rpc error: code = NotFound desc = could not find container \"d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b\": container with ID starting with d2141853c189c8b48095ffc8b237868423263c6e88a8bdd6e2fa7c420798cc3b not found: ID does not exist"
Sep 08 16:02:33.424045 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.424016    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"]
Sep 08 16:02:33.430512 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:33.430485    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-w3-642d3b-644b95fcc7-w9gv4"]
Sep 08 16:02:34.113638 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:34.113606    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7762d22d-1011-4030-b1e5-18aaeaf64036" path="/var/lib/kubelet/pods/7762d22d-1011-4030-b1e5-18aaeaf64036/volumes"
Sep 08 16:02:34.723592 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:34.723561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:35.302878 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:35.302842    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:02:39.448444 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:39.448407    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:39.510480 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:39.510443    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:39.719289 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:39.719206    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:02:42.281864 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.281824    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-95sj5"]
Sep 08 16:02:42.282432 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.282055    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74dcff4f44-95sj5" podUID="2d99fef5-d96d-4f40-8122-0576c5066f9d" containerName="manager" containerID="cri-o://92a70a2f5e51756d7f6df36c24de178984df039701815bf0818730b526066063" gracePeriod=30
Sep 08 16:02:42.451679 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.451648    2579 generic.go:356] "Generic (PLEG): container finished" podID="2d99fef5-d96d-4f40-8122-0576c5066f9d" containerID="92a70a2f5e51756d7f6df36c24de178984df039701815bf0818730b526066063" exitCode=0
Sep 08 16:02:42.451829 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.451722    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-95sj5" event={"ID":"2d99fef5-d96d-4f40-8122-0576c5066f9d","Type":"ContainerDied","Data":"92a70a2f5e51756d7f6df36c24de178984df039701815bf0818730b526066063"}
Sep 08 16:02:42.537579 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.537513    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 16:02:42.572084 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.572047    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-metrics-certs\") pod \"2d99fef5-d96d-4f40-8122-0576c5066f9d\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") "
Sep 08 16:02:42.572273 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.572089    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-webhook-cert\") pod \"2d99fef5-d96d-4f40-8122-0576c5066f9d\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") "
Sep 08 16:02:42.572273 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.572139    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9w4wx\" (UniqueName: \"kubernetes.io/projected/2d99fef5-d96d-4f40-8122-0576c5066f9d-kube-api-access-9w4wx\") pod \"2d99fef5-d96d-4f40-8122-0576c5066f9d\" (UID: \"2d99fef5-d96d-4f40-8122-0576c5066f9d\") "
Sep 08 16:02:42.574177 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.574140    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "2d99fef5-d96d-4f40-8122-0576c5066f9d" (UID: "2d99fef5-d96d-4f40-8122-0576c5066f9d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:02:42.574339 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.574274    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "2d99fef5-d96d-4f40-8122-0576c5066f9d" (UID: "2d99fef5-d96d-4f40-8122-0576c5066f9d"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:02:42.574612 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.574591    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2d99fef5-d96d-4f40-8122-0576c5066f9d-kube-api-access-9w4wx" (OuterVolumeSpecName: "kube-api-access-9w4wx") pod "2d99fef5-d96d-4f40-8122-0576c5066f9d" (UID: "2d99fef5-d96d-4f40-8122-0576c5066f9d"). InnerVolumeSpecName "kube-api-access-9w4wx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:02:42.673714 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.673660    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9w4wx\" (UniqueName: \"kubernetes.io/projected/2d99fef5-d96d-4f40-8122-0576c5066f9d-kube-api-access-9w4wx\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:42.673714 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.673695    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:42.673714 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:42.673709    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2d99fef5-d96d-4f40-8122-0576c5066f9d-webhook-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:02:43.458522 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:43.458485    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-95sj5"
Sep 08 16:02:43.458522 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:43.458507    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-95sj5" event={"ID":"2d99fef5-d96d-4f40-8122-0576c5066f9d","Type":"ContainerDied","Data":"199c070f39c8bba8d99e8234f5abe8b65f0d33d3302c5116b7043c2fe0d96b0e"}
Sep 08 16:02:43.459089 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:43.458584    2579 scope.go:117] "RemoveContainer" containerID="92a70a2f5e51756d7f6df36c24de178984df039701815bf0818730b526066063"
Sep 08 16:02:43.479556 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:43.479531    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-95sj5"]
Sep 08 16:02:43.483526 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:43.483504    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-95sj5"]
Sep 08 16:02:43.905565 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:43.905523    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:02:44.113925 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:02:44.113885    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2d99fef5-d96d-4f40-8122-0576c5066f9d" path="/var/lib/kubelet/pods/2d99fef5-d96d-4f40-8122-0576c5066f9d/volumes"
Sep 08 16:03:44.296574 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296488    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74dcff4f44-2tc56"]
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296847    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7762d22d-1011-4030-b1e5-18aaeaf64036" containerName="maas-api"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296859    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7762d22d-1011-4030-b1e5-18aaeaf64036" containerName="maas-api"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296873    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296879    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296887    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" containerName="main"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296893    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" containerName="main"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296900    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="015e078e-222e-412d-8fcb-c09e54f44905" containerName="payload-pre-processing"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296909    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="015e078e-222e-412d-8fcb-c09e54f44905" containerName="payload-pre-processing"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296920    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2d99fef5-d96d-4f40-8122-0576c5066f9d" containerName="manager"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296925    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2d99fef5-d96d-4f40-8122-0576c5066f9d" containerName="manager"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296931    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07a6760b-a57b-4819-a209-fe35da625a90" containerName="payload-processing"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296936    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="07a6760b-a57b-4819-a209-fe35da625a90" containerName="payload-processing"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296943    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296948    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296953    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58" containerName="cleanup"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296971    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58" containerName="cleanup"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296978    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bfc5d656-c79a-45dc-a05a-edef4afe3f52" containerName="maas-api"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296986    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="bfc5d656-c79a-45dc-a05a-edef4afe3f52" containerName="maas-api"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.296996    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6ec94781-7493-46e7-8c0d-5a9db08bbf06" containerName="maas-api"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297001    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6ec94781-7493-46e7-8c0d-5a9db08bbf06" containerName="maas-api"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297012    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c1c3770-d704-418d-b3fd-8de51a16db35" containerName="payload-pre-processing"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297017    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c1c3770-d704-418d-b3fd-8de51a16db35" containerName="payload-pre-processing"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297027    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297033    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297040    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="549b9225-e92b-4696-810d-ae8f04106299" containerName="payload-processing"
Sep 08 16:03:44.297036 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297045    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="549b9225-e92b-4696-810d-ae8f04106299" containerName="payload-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297053    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa46a3da-3121-4db0-b7ff-0016ee0bfd28" containerName="kuadrant-console-plugin"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297058    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa46a3da-3121-4db0-b7ff-0016ee0bfd28" containerName="kuadrant-console-plugin"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297066    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e793211a-7229-4356-8098-baa42f7a1225" containerName="payload-pre-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297074    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e793211a-7229-4356-8098-baa42f7a1225" containerName="payload-pre-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297082    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b0d5201-e82e-4add-9ea7-1c40c1728428" containerName="payload-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297087    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b0d5201-e82e-4add-9ea7-1c40c1728428" containerName="payload-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297141    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d559c92-0eb2-4c9b-af2f-1b8c2ae63d58" containerName="cleanup"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297151    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa46a3da-3121-4db0-b7ff-0016ee0bfd28" containerName="kuadrant-console-plugin"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297159    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6ec94781-7493-46e7-8c0d-5a9db08bbf06" containerName="maas-api"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297166    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b87c9c71-0180-4b91-a5bb-733ad3dbaa1d" containerName="main"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297172    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="015e078e-222e-412d-8fcb-c09e54f44905" containerName="payload-pre-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297177    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297183    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297188    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e793211a-7229-4356-8098-baa42f7a1225" containerName="payload-pre-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297193    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c1c3770-d704-418d-b3fd-8de51a16db35" containerName="payload-pre-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297199    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="bfc5d656-c79a-45dc-a05a-edef4afe3f52" containerName="maas-api"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297203    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="549b9225-e92b-4696-810d-ae8f04106299" containerName="payload-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297208    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297212    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2d99fef5-d96d-4f40-8122-0576c5066f9d" containerName="manager"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297217    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="07a6760b-a57b-4819-a209-fe35da625a90" containerName="payload-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297224    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b0d5201-e82e-4add-9ea7-1c40c1728428" containerName="payload-processing"
Sep 08 16:03:44.297861 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.297232    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7762d22d-1011-4030-b1e5-18aaeaf64036" containerName="maas-api"
Sep 08 16:03:44.300264 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.300247    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.304314 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.304292    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 16:03:44.304314 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.304300    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qvnl7\""
Sep 08 16:03:44.304500 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.304342    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 16:03:44.304500 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.304436    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 16:03:44.309792 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.309769    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-2tc56"]
Sep 08 16:03:44.401681 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.401635    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ccks\" (UniqueName: \"kubernetes.io/projected/cb1788ba-1c92-46e8-9270-0d278e19e8ec-kube-api-access-6ccks\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.401878 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.401693    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-metrics-certs\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.401878 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.401725    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-webhook-cert\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.503109 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.503054    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ccks\" (UniqueName: \"kubernetes.io/projected/cb1788ba-1c92-46e8-9270-0d278e19e8ec-kube-api-access-6ccks\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.503109 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.503121    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-metrics-certs\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.503395 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.503143    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-webhook-cert\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.505708 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.505686    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-webhook-cert\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.505826 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.505802    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-metrics-certs\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.511394 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.511366    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ccks\" (UniqueName: \"kubernetes.io/projected/cb1788ba-1c92-46e8-9270-0d278e19e8ec-kube-api-access-6ccks\") pod \"maas-controller-74dcff4f44-2tc56\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") " pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.611380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.611335    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:44.881287 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.881257    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-2tc56"]
Sep 08 16:03:44.883064 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:03:44.883031    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb1788ba_1c92_46e8_9270_0d278e19e8ec.slice/crio-53e085e14db5abbd1eab46c9f8723fc6e84e0a6c7e564894246cc6cee150a693 WatchSource:0}: Error finding container 53e085e14db5abbd1eab46c9f8723fc6e84e0a6c7e564894246cc6cee150a693: Status 404 returned error can't find the container with id 53e085e14db5abbd1eab46c9f8723fc6e84e0a6c7e564894246cc6cee150a693
Sep 08 16:03:44.884459 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:44.884442    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:03:45.783771 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:45.783686    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-2tc56" event={"ID":"cb1788ba-1c92-46e8-9270-0d278e19e8ec","Type":"ContainerStarted","Data":"4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c"}
Sep 08 16:03:45.783771 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:45.783736    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-2tc56" event={"ID":"cb1788ba-1c92-46e8-9270-0d278e19e8ec","Type":"ContainerStarted","Data":"53e085e14db5abbd1eab46c9f8723fc6e84e0a6c7e564894246cc6cee150a693"}
Sep 08 16:03:45.783771 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:45.783759    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:03:45.803258 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:45.803201    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74dcff4f44-2tc56" podStartSLOduration=1.155548072 podStartE2EDuration="1.803186322s" totalImagesPullingTime="647.63825ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:03:45.80134884 +0000 UTC m=+1886.161891607" watchObservedRunningTime="2026-09-08 16:03:45.803186322 +0000 UTC m=+1886.163729101"
Sep 08 16:03:56.791442 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:03:56.791405    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:04:03.528876 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:03.528835    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:03.962234 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:03.962194    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:04.080980 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.080924    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-2tc56"]
Sep 08 16:04:04.081289 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.081252    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-74dcff4f44-2tc56" podUID="cb1788ba-1c92-46e8-9270-0d278e19e8ec" containerName="manager" containerID="cri-o://4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c" gracePeriod=30
Sep 08 16:04:04.295330 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.295290    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:04:04.320452 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.320425    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:04:04.488284 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.488249    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6ccks\" (UniqueName: \"kubernetes.io/projected/cb1788ba-1c92-46e8-9270-0d278e19e8ec-kube-api-access-6ccks\") pod \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") "
Sep 08 16:04:04.488432 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.488295    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-webhook-cert\") pod \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") "
Sep 08 16:04:04.488432 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.488348    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-metrics-certs\") pod \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\" (UID: \"cb1788ba-1c92-46e8-9270-0d278e19e8ec\") "
Sep 08 16:04:04.490414 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.490374    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "cb1788ba-1c92-46e8-9270-0d278e19e8ec" (UID: "cb1788ba-1c92-46e8-9270-0d278e19e8ec"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:04:04.490535 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.490458    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "cb1788ba-1c92-46e8-9270-0d278e19e8ec" (UID: "cb1788ba-1c92-46e8-9270-0d278e19e8ec"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:04:04.490535 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.490480    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb1788ba-1c92-46e8-9270-0d278e19e8ec-kube-api-access-6ccks" (OuterVolumeSpecName: "kube-api-access-6ccks") pod "cb1788ba-1c92-46e8-9270-0d278e19e8ec" (UID: "cb1788ba-1c92-46e8-9270-0d278e19e8ec"). InnerVolumeSpecName "kube-api-access-6ccks". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:04:04.589925 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.589882    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6ccks\" (UniqueName: \"kubernetes.io/projected/cb1788ba-1c92-46e8-9270-0d278e19e8ec-kube-api-access-6ccks\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:04:04.589925 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.589924    2579 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-webhook-cert\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:04:04.590379 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.589938    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/cb1788ba-1c92-46e8-9270-0d278e19e8ec-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:04:04.884152 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.884063    2579 generic.go:356] "Generic (PLEG): container finished" podID="cb1788ba-1c92-46e8-9270-0d278e19e8ec" containerID="4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c" exitCode=0
Sep 08 16:04:04.884152 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.884108    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-2tc56" event={"ID":"cb1788ba-1c92-46e8-9270-0d278e19e8ec","Type":"ContainerDied","Data":"4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c"}
Sep 08 16:04:04.884152 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.884111    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-2tc56"
Sep 08 16:04:04.884152 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.884151    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-2tc56" event={"ID":"cb1788ba-1c92-46e8-9270-0d278e19e8ec","Type":"ContainerDied","Data":"53e085e14db5abbd1eab46c9f8723fc6e84e0a6c7e564894246cc6cee150a693"}
Sep 08 16:04:04.884469 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.884176    2579 scope.go:117] "RemoveContainer" containerID="4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c"
Sep 08 16:04:04.893453 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.893429    2579 scope.go:117] "RemoveContainer" containerID="4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c"
Sep 08 16:04:04.893744 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:04:04.893724    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c\": container with ID starting with 4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c not found: ID does not exist" containerID="4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c"
Sep 08 16:04:04.893815 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.893752    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c"} err="failed to get container status \"4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c\": rpc error: code = NotFound desc = could not find container \"4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c\": container with ID starting with 4323ec909cf47897b1bb9f41452b06e656c346e9e3707a4c686f4ea00c595e5c not found: ID does not exist"
Sep 08 16:04:04.906616 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.906589    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-2tc56"]
Sep 08 16:04:04.909919 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:04.909898    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-2tc56"]
Sep 08 16:04:05.718975 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.718929    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:05.834760 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.834723    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-74dcff4f44-f7b9z"]
Sep 08 16:04:05.835081 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.835069    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb1788ba-1c92-46e8-9270-0d278e19e8ec" containerName="manager"
Sep 08 16:04:05.835145 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.835084    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb1788ba-1c92-46e8-9270-0d278e19e8ec" containerName="manager"
Sep 08 16:04:05.835145 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.835095    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy"
Sep 08 16:04:05.835145 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.835100    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="172fe338-85a3-4b70-9d33-e8eb4796d2ea" containerName="istio-proxy"
Sep 08 16:04:05.835246 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.835152    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb1788ba-1c92-46e8-9270-0d278e19e8ec" containerName="manager"
Sep 08 16:04:05.835246 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.835163    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="4358f83c-ae4f-4adc-99fe-b9ae7d4f2d49" containerName="istio-proxy"
Sep 08 16:04:05.839288 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.839271    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:05.843226 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.843202    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-qvnl7\""
Sep 08 16:04:05.843356 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.843229    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Sep 08 16:04:05.843356 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.843261    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-metrics-tls\""
Sep 08 16:04:05.843356 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.843279    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Sep 08 16:04:05.848527 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:05.848502    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-f7b9z"]
Sep 08 16:04:06.002159 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.002064    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3713a460-7bba-4325-a6e7-c5ec0366d6ac-webhook-cert\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.002159 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.002108    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3713a460-7bba-4325-a6e7-c5ec0366d6ac-metrics-certs\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.002159 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.002136    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2shch\" (UniqueName: \"kubernetes.io/projected/3713a460-7bba-4325-a6e7-c5ec0366d6ac-kube-api-access-2shch\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.102957 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.102909    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3713a460-7bba-4325-a6e7-c5ec0366d6ac-webhook-cert\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.102957 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.102987    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3713a460-7bba-4325-a6e7-c5ec0366d6ac-metrics-certs\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.103202 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.103033    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2shch\" (UniqueName: \"kubernetes.io/projected/3713a460-7bba-4325-a6e7-c5ec0366d6ac-kube-api-access-2shch\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.105546 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.105513    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3713a460-7bba-4325-a6e7-c5ec0366d6ac-webhook-cert\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.105689 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.105549    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3713a460-7bba-4325-a6e7-c5ec0366d6ac-metrics-certs\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.111131 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.111106    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2shch\" (UniqueName: \"kubernetes.io/projected/3713a460-7bba-4325-a6e7-c5ec0366d6ac-kube-api-access-2shch\") pod \"maas-controller-74dcff4f44-f7b9z\" (UID: \"3713a460-7bba-4325-a6e7-c5ec0366d6ac\") " pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.114802 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.114776    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb1788ba-1c92-46e8-9270-0d278e19e8ec" path="/var/lib/kubelet/pods/cb1788ba-1c92-46e8-9270-0d278e19e8ec/volumes"
Sep 08 16:04:06.150001 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.149951    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.422413 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.422386    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-74dcff4f44-f7b9z"]
Sep 08 16:04:06.424002 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:04:06.423971    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3713a460_7bba_4325_a6e7_c5ec0366d6ac.slice/crio-22f8aa8a76d6095f9640e71386b546b465faf261e0eddec587dec67f8eb4cb53 WatchSource:0}: Error finding container 22f8aa8a76d6095f9640e71386b546b465faf261e0eddec587dec67f8eb4cb53: Status 404 returned error can't find the container with id 22f8aa8a76d6095f9640e71386b546b465faf261e0eddec587dec67f8eb4cb53
Sep 08 16:04:06.904194 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.904157    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-f7b9z" event={"ID":"3713a460-7bba-4325-a6e7-c5ec0366d6ac","Type":"ContainerStarted","Data":"0af5edff457a2b535f7090e57609526a9b9790a6b45c07c3e0fcb1f2a2754fdb"}
Sep 08 16:04:06.904650 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.904217    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:06.904650 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.904241    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-74dcff4f44-f7b9z" event={"ID":"3713a460-7bba-4325-a6e7-c5ec0366d6ac","Type":"ContainerStarted","Data":"22f8aa8a76d6095f9640e71386b546b465faf261e0eddec587dec67f8eb4cb53"}
Sep 08 16:04:06.924753 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:06.924694    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-74dcff4f44-f7b9z" podStartSLOduration=1.5555864910000001 podStartE2EDuration="1.924671974s" totalImagesPullingTime="369.085483ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:04:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:04:06.922019764 +0000 UTC m=+1907.282562531" watchObservedRunningTime="2026-09-08 16:04:06.924671974 +0000 UTC m=+1907.285214740"
Sep 08 16:04:17.913532 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:17.913494    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-74dcff4f44-f7b9z"
Sep 08 16:04:18.092593 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:18.092561    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:29.709660 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:29.709624    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:04:36.349331 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:36.349289    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:04:37.501434 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:37.501396    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:04:45.001655 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:45.001616    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:04:52.492766 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:04:52.492726    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:05:09.902899 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:05:09.902860    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:05:15.996610 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:05:15.996572    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:06:20.491118 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:06:20.491084    2579 scope.go:117] "RemoveContainer" containerID="bf258c8794c50689c70e311a035d5388080c970bc168e900a2efe4e02a28a99f"
Sep 08 16:06:42.614738 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:06:42.614645    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:06:43.500882 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:06:43.500841    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:06:49.605240 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:06:49.605199    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:06:57.903734 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:06:57.903647    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:07:00.833242 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.833208    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"]
Sep 08 16:07:00.836688 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.836664    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:00.839349 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.839331    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-a-98bb1b05-kserve-self-signed-certs\""
Sep 08 16:07:00.845538 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.845515    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"]
Sep 08 16:07:00.932841 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.932800    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-dshm\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:00.932841 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.932835    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-home\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:00.933125 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.932858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-model-cache\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:00.933125 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.932943    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-tmp-dir\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:00.933125 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.933036    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29d6d\" (UniqueName: \"kubernetes.io/projected/ae22e884-e6d5-478b-a073-b00f99e0dc64-kube-api-access-29d6d\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:00.933125 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:00.933110    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae22e884-e6d5-478b-a073-b00f99e0dc64-tls-certs\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.034260 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.034223    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae22e884-e6d5-478b-a073-b00f99e0dc64-tls-certs\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.034440 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.034304    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-dshm\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.034440 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.034328    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-home\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.034440 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.034349    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-model-cache\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.034440 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.034415    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-tmp-dir\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.034666 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.034461    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29d6d\" (UniqueName: \"kubernetes.io/projected/ae22e884-e6d5-478b-a073-b00f99e0dc64-kube-api-access-29d6d\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.034945 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.034917    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-model-cache\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.035080 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.034977    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-tmp-dir\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.035080 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.035010    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-home\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.036666 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.036647    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-dshm\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.036953 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.036934    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae22e884-e6d5-478b-a073-b00f99e0dc64-tls-certs\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.042443 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.042422    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-29d6d\" (UniqueName: \"kubernetes.io/projected/ae22e884-e6d5-478b-a073-b00f99e0dc64-kube-api-access-29d6d\") pod \"e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") " pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.090440 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.090375    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:01.146820 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.146789    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:01.418112 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.418083    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"]
Sep 08 16:07:01.419891 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:07:01.419861    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae22e884_e6d5_478b_a073_b00f99e0dc64.slice/crio-e39302c4246b6cba54e69850ca97a1911fba3e947375c40ede1f04e33213bc74 WatchSource:0}: Error finding container e39302c4246b6cba54e69850ca97a1911fba3e947375c40ede1f04e33213bc74: Status 404 returned error can't find the container with id e39302c4246b6cba54e69850ca97a1911fba3e947375c40ede1f04e33213bc74
Sep 08 16:07:01.809592 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.809502    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22" event={"ID":"ae22e884-e6d5-478b-a073-b00f99e0dc64","Type":"ContainerStarted","Data":"489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61"}
Sep 08 16:07:01.809592 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.809553    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22" event={"ID":"ae22e884-e6d5-478b-a073-b00f99e0dc64","Type":"ContainerStarted","Data":"e39302c4246b6cba54e69850ca97a1911fba3e947375c40ede1f04e33213bc74"}
Sep 08 16:07:01.827023 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:01.826943    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22" podStartSLOduration=1.8269227099999998 podStartE2EDuration="1.82692271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:07:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:07:01.825622412 +0000 UTC m=+2082.186165202" watchObservedRunningTime="2026-09-08 16:07:01.82692271 +0000 UTC m=+2082.187465478"
Sep 08 16:07:04.208100 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:04.208061    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:07:08.034046 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.034008    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"]
Sep 08 16:07:08.037651 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.037629    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.040319 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.040294    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-same-id-b-98bb1b05-kserve-self-signed-certs\""
Sep 08 16:07:08.045117 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.045094    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"]
Sep 08 16:07:08.093678 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.093640    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-dshm\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.093883 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.093685    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhq7z\" (UniqueName: \"kubernetes.io/projected/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-kube-api-access-nhq7z\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.093883 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.093780    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tmp-dir\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.093883 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.093853    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-model-cache\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.094076 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.093900    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-home\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.094076 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.093922    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tls-certs\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.133008 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.132953    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:08.194820 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.194787    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tmp-dir\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.195056 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.194849    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-model-cache\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.195056 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.194871    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-home\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.195056 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.194888    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tls-certs\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.195056 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.194918    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-dshm\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.195056 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.194936    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhq7z\" (UniqueName: \"kubernetes.io/projected/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-kube-api-access-nhq7z\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.195349 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.195288    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tmp-dir\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.195349 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.195294    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-home\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.195349 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.195336    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-model-cache\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.197362 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.197338    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-dshm\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.197619 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.197600    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tls-certs\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.203312 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.203291    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhq7z\" (UniqueName: \"kubernetes.io/projected/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-kube-api-access-nhq7z\") pod \"e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") " pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.348329 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.348292    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:08.622353 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.622324    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"]
Sep 08 16:07:08.624115 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:07:08.624091    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6843cb63_f6f1_4de7_9a7a_0779febb5e1d.slice/crio-30d21cf6e52dcdbcc51004bfa9b2966e2456fed15f049eefc7f0998936bf5c25 WatchSource:0}: Error finding container 30d21cf6e52dcdbcc51004bfa9b2966e2456fed15f049eefc7f0998936bf5c25: Status 404 returned error can't find the container with id 30d21cf6e52dcdbcc51004bfa9b2966e2456fed15f049eefc7f0998936bf5c25
Sep 08 16:07:08.848936 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.848899    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm" event={"ID":"6843cb63-f6f1-4de7-9a7a-0779febb5e1d","Type":"ContainerStarted","Data":"efcb77426089796dfe7acbfcd39525258972935ca5f1b7580cfa2c811972946e"}
Sep 08 16:07:08.848936 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.848937    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm" event={"ID":"6843cb63-f6f1-4de7-9a7a-0779febb5e1d","Type":"ContainerStarted","Data":"30d21cf6e52dcdbcc51004bfa9b2966e2456fed15f049eefc7f0998936bf5c25"}
Sep 08 16:07:08.866856 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:08.866788    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm" podStartSLOduration=0.866773726 podStartE2EDuration="866.773726ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:07:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:07:08.865546086 +0000 UTC m=+2089.226088851" watchObservedRunningTime="2026-09-08 16:07:08.866773726 +0000 UTC m=+2089.227316490"
Sep 08 16:07:11.147481 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:11.147434    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:11.147910 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:11.147507    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:11.160365 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:11.160342    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:11.701009 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:11.700956    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:07:11.882327 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:11.882292    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:18.349270 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:18.349231    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:18.349840 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:18.349517    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:18.361894 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:18.361863    2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:18.913745 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:18.913710    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:39.223692 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:39.223654    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"]
Sep 08 16:07:39.238530 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:39.238488    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:40.952340 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:40.952306    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"]
Sep 08 16:07:40.972808 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:40.972769    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:41.608168 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:41.608134    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:07:50.606198 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:50.606161    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:07:54.243982 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.243917    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22" podUID="ae22e884-e6d5-478b-a073-b00f99e0dc64" containerName="main" containerID="cri-o://489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61" gracePeriod=45
Sep 08 16:07:54.273744 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.273715    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:54.375537 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.375503    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:07:54.485124 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.485102    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:54.518327 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518262    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-dshm\") pod \"ae22e884-e6d5-478b-a073-b00f99e0dc64\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") "
Sep 08 16:07:54.518327 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518309    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-model-cache\") pod \"ae22e884-e6d5-478b-a073-b00f99e0dc64\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") "
Sep 08 16:07:54.518524 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518338    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae22e884-e6d5-478b-a073-b00f99e0dc64-tls-certs\") pod \"ae22e884-e6d5-478b-a073-b00f99e0dc64\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") "
Sep 08 16:07:54.518524 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518375    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-tmp-dir\") pod \"ae22e884-e6d5-478b-a073-b00f99e0dc64\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") "
Sep 08 16:07:54.518524 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518403    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-29d6d\" (UniqueName: \"kubernetes.io/projected/ae22e884-e6d5-478b-a073-b00f99e0dc64-kube-api-access-29d6d\") pod \"ae22e884-e6d5-478b-a073-b00f99e0dc64\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") "
Sep 08 16:07:54.518524 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518438    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-home\") pod \"ae22e884-e6d5-478b-a073-b00f99e0dc64\" (UID: \"ae22e884-e6d5-478b-a073-b00f99e0dc64\") "
Sep 08 16:07:54.518738 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518555    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-model-cache" (OuterVolumeSpecName: "model-cache") pod "ae22e884-e6d5-478b-a073-b00f99e0dc64" (UID: "ae22e884-e6d5-478b-a073-b00f99e0dc64"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:54.518738 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518637    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ae22e884-e6d5-478b-a073-b00f99e0dc64" (UID: "ae22e884-e6d5-478b-a073-b00f99e0dc64"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:54.518738 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518714    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-home" (OuterVolumeSpecName: "home") pod "ae22e884-e6d5-478b-a073-b00f99e0dc64" (UID: "ae22e884-e6d5-478b-a073-b00f99e0dc64"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:54.518900 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518840    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-model-cache\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:54.518900 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518861    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-tmp-dir\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:54.518900 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.518873    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-home\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:54.520638 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.520614    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-dshm" (OuterVolumeSpecName: "dshm") pod "ae22e884-e6d5-478b-a073-b00f99e0dc64" (UID: "ae22e884-e6d5-478b-a073-b00f99e0dc64"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:54.520744 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.520670    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ae22e884-e6d5-478b-a073-b00f99e0dc64-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ae22e884-e6d5-478b-a073-b00f99e0dc64" (UID: "ae22e884-e6d5-478b-a073-b00f99e0dc64"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:07:54.520744 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.520694    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae22e884-e6d5-478b-a073-b00f99e0dc64-kube-api-access-29d6d" (OuterVolumeSpecName: "kube-api-access-29d6d") pod "ae22e884-e6d5-478b-a073-b00f99e0dc64" (UID: "ae22e884-e6d5-478b-a073-b00f99e0dc64"). InnerVolumeSpecName "kube-api-access-29d6d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:07:54.620341 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.620292    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ae22e884-e6d5-478b-a073-b00f99e0dc64-tls-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:54.620341 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.620338    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-29d6d\" (UniqueName: \"kubernetes.io/projected/ae22e884-e6d5-478b-a073-b00f99e0dc64-kube-api-access-29d6d\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:54.620341 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:54.620350    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ae22e884-e6d5-478b-a073-b00f99e0dc64-dshm\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:55.088891 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.088859    2579 generic.go:356] "Generic (PLEG): container finished" podID="ae22e884-e6d5-478b-a073-b00f99e0dc64" containerID="489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61" exitCode=0
Sep 08 16:07:55.089104 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.088913    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"
Sep 08 16:07:55.089104 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.088954    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22" event={"ID":"ae22e884-e6d5-478b-a073-b00f99e0dc64","Type":"ContainerDied","Data":"489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61"}
Sep 08 16:07:55.089104 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.089020    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22" event={"ID":"ae22e884-e6d5-478b-a073-b00f99e0dc64","Type":"ContainerDied","Data":"e39302c4246b6cba54e69850ca97a1911fba3e947375c40ede1f04e33213bc74"}
Sep 08 16:07:55.089104 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.089039    2579 scope.go:117] "RemoveContainer" containerID="489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61"
Sep 08 16:07:55.099270 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.099256    2579 scope.go:117] "RemoveContainer" containerID="489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61"
Sep 08 16:07:55.099522 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:07:55.099503    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61\": container with ID starting with 489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61 not found: ID does not exist" containerID="489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61"
Sep 08 16:07:55.099568 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.099530    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61"} err="failed to get container status \"489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61\": rpc error: code = NotFound desc = could not find container \"489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61\": container with ID starting with 489a10fd9faf526e553ee8205208b01a093d01483b64a051b004752c1b323b61 not found: ID does not exist"
Sep 08 16:07:55.111813 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.111791    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"]
Sep 08 16:07:55.119702 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.119682    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-a-98bb1b05-kserve-f78db78bc-vrs22"]
Sep 08 16:07:55.972635 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:55.972575    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm" podUID="6843cb63-f6f1-4de7-9a7a-0779febb5e1d" containerName="main" containerID="cri-o://efcb77426089796dfe7acbfcd39525258972935ca5f1b7580cfa2c811972946e" gracePeriod=45
Sep 08 16:07:56.096721 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.096695    2579 generic.go:356] "Generic (PLEG): container finished" podID="6843cb63-f6f1-4de7-9a7a-0779febb5e1d" containerID="efcb77426089796dfe7acbfcd39525258972935ca5f1b7580cfa2c811972946e" exitCode=0
Sep 08 16:07:56.096853 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.096734    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm" event={"ID":"6843cb63-f6f1-4de7-9a7a-0779febb5e1d","Type":"ContainerDied","Data":"efcb77426089796dfe7acbfcd39525258972935ca5f1b7580cfa2c811972946e"}
Sep 08 16:07:56.113726 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.113693    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ae22e884-e6d5-478b-a073-b00f99e0dc64" path="/var/lib/kubelet/pods/ae22e884-e6d5-478b-a073-b00f99e0dc64/volumes"
Sep 08 16:07:56.238177 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.238147    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:56.333666 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.333633    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-dshm\") pod \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") "
Sep 08 16:07:56.333840 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.333678    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tls-certs\") pod \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") "
Sep 08 16:07:56.333840 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.333725    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhq7z\" (UniqueName: \"kubernetes.io/projected/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-kube-api-access-nhq7z\") pod \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") "
Sep 08 16:07:56.333840 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.333747    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tmp-dir\") pod \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") "
Sep 08 16:07:56.333840 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.333766    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-model-cache\") pod \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") "
Sep 08 16:07:56.333840 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.333804    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-home\") pod \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\" (UID: \"6843cb63-f6f1-4de7-9a7a-0779febb5e1d\") "
Sep 08 16:07:56.334146 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.334054    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "6843cb63-f6f1-4de7-9a7a-0779febb5e1d" (UID: "6843cb63-f6f1-4de7-9a7a-0779febb5e1d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:56.334146 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.334085    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-model-cache" (OuterVolumeSpecName: "model-cache") pod "6843cb63-f6f1-4de7-9a7a-0779febb5e1d" (UID: "6843cb63-f6f1-4de7-9a7a-0779febb5e1d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:56.334146 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.334123    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-home" (OuterVolumeSpecName: "home") pod "6843cb63-f6f1-4de7-9a7a-0779febb5e1d" (UID: "6843cb63-f6f1-4de7-9a7a-0779febb5e1d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:56.334289 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.334198    2579 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-model-cache\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:56.334289 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.334219    2579 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tmp-dir\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:56.335954 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.335931    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-dshm" (OuterVolumeSpecName: "dshm") pod "6843cb63-f6f1-4de7-9a7a-0779febb5e1d" (UID: "6843cb63-f6f1-4de7-9a7a-0779febb5e1d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Sep 08 16:07:56.336055 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.336000    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "6843cb63-f6f1-4de7-9a7a-0779febb5e1d" (UID: "6843cb63-f6f1-4de7-9a7a-0779febb5e1d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:07:56.336096 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.336054    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-kube-api-access-nhq7z" (OuterVolumeSpecName: "kube-api-access-nhq7z") pod "6843cb63-f6f1-4de7-9a7a-0779febb5e1d" (UID: "6843cb63-f6f1-4de7-9a7a-0779febb5e1d"). InnerVolumeSpecName "kube-api-access-nhq7z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:07:56.435591 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.435548    2579 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-dshm\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:56.435591 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.435582    2579 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-tls-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:56.435591 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.435593    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhq7z\" (UniqueName: \"kubernetes.io/projected/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-kube-api-access-nhq7z\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:56.435591 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:56.435602    2579 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6843cb63-f6f1-4de7-9a7a-0779febb5e1d-home\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:07:57.102813 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:57.102783    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"
Sep 08 16:07:57.103232 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:57.102777    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm" event={"ID":"6843cb63-f6f1-4de7-9a7a-0779febb5e1d","Type":"ContainerDied","Data":"30d21cf6e52dcdbcc51004bfa9b2966e2456fed15f049eefc7f0998936bf5c25"}
Sep 08 16:07:57.103232 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:57.102919    2579 scope.go:117] "RemoveContainer" containerID="efcb77426089796dfe7acbfcd39525258972935ca5f1b7580cfa2c811972946e"
Sep 08 16:07:57.126444 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:57.126415    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"]
Sep 08 16:07:57.130235 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:57.130211    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["llm/e2e-same-id-b-98bb1b05-kserve-66c5d79759-7mmvm"]
Sep 08 16:07:58.114777 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:58.114744    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6843cb63-f6f1-4de7-9a7a-0779febb5e1d" path="/var/lib/kubelet/pods/6843cb63-f6f1-4de7-9a7a-0779febb5e1d/volumes"
Sep 08 16:07:59.598801 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:07:59.598766    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:08:00.257426 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.257391    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"]
Sep 08 16:08:00.257742 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.257729    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae22e884-e6d5-478b-a073-b00f99e0dc64" containerName="main"
Sep 08 16:08:00.257786 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.257743    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae22e884-e6d5-478b-a073-b00f99e0dc64" containerName="main"
Sep 08 16:08:00.257786 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.257754    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6843cb63-f6f1-4de7-9a7a-0779febb5e1d" containerName="main"
Sep 08 16:08:00.257786 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.257760    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="6843cb63-f6f1-4de7-9a7a-0779febb5e1d" containerName="main"
Sep 08 16:08:00.257885 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.257814    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="6843cb63-f6f1-4de7-9a7a-0779febb5e1d" containerName="main"
Sep 08 16:08:00.257885 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.257821    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae22e884-e6d5-478b-a073-b00f99e0dc64" containerName="main"
Sep 08 16:08:00.262273 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.262247    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.265174 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.265147    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-tq4f4\""
Sep 08 16:08:00.274919 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.274893    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"]
Sep 08 16:08:00.370896 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.370858    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-maas-api-tls\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.371109 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.370934    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-openshift-service-ca\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.371109 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.370997    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsknc\" (UniqueName: \"kubernetes.io/projected/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-kube-api-access-zsknc\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.371109 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.371048    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-metrics-certs\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.472354 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.472308    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsknc\" (UniqueName: \"kubernetes.io/projected/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-kube-api-access-zsknc\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.472563 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.472369    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-metrics-certs\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.472563 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.472443    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-maas-api-tls\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.472563 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.472520    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-openshift-service-ca\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.473200 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.473163    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-openshift-service-ca\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.474905 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.474873    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-maas-api-tls\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.474905 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.474902    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-metrics-certs\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.479742 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.479719    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsknc\" (UniqueName: \"kubernetes.io/projected/6de8f2b1-6d63-41e5-8300-4da66ee3f6aa-kube-api-access-zsknc\") pod \"maas-api-d7bcf777d-vxzfk\" (UID: \"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa\") " pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.575641 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.575611    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:00.850981 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:00.850940    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"]
Sep 08 16:08:00.852979 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:08:00.852921    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6de8f2b1_6d63_41e5_8300_4da66ee3f6aa.slice/crio-6ddac1fbb44c80f1aa5080137064d3832af7c1aae69d77e6b167f3675cb582bc WatchSource:0}: Error finding container 6ddac1fbb44c80f1aa5080137064d3832af7c1aae69d77e6b167f3675cb582bc: Status 404 returned error can't find the container with id 6ddac1fbb44c80f1aa5080137064d3832af7c1aae69d77e6b167f3675cb582bc
Sep 08 16:08:01.124767 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:01.124675    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk" event={"ID":"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa","Type":"ContainerStarted","Data":"6ddac1fbb44c80f1aa5080137064d3832af7c1aae69d77e6b167f3675cb582bc"}
Sep 08 16:08:02.131307 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:02.131268    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk" event={"ID":"6de8f2b1-6d63-41e5-8300-4da66ee3f6aa","Type":"ContainerStarted","Data":"c1005bb2d1cb5cc8706ade6fe72f1dde33cbd71d4f47d24c52ec7c775fdd76a0"}
Sep 08 16:08:02.131762 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:02.131455    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:02.149701 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:02.149643    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk" podStartSLOduration=1.5040194759999999 podStartE2EDuration="2.149628214s" totalImagesPullingTime="645.608738ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:08:02.146949498 +0000 UTC m=+2142.507492262" watchObservedRunningTime="2026-09-08 16:08:02.149628214 +0000 UTC m=+2142.510170979"
Sep 08 16:08:07.608227 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:07.608190    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:08:08.142096 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:08.142065    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-d7bcf777d-vxzfk"
Sep 08 16:08:08.192113 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:08.192082    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"]
Sep 08 16:08:08.192334 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:08.192314    2579 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4" podUID="56f719e7-e9eb-499c-8cdf-5a3823b84933" containerName="maas-api" containerID="cri-o://6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3" gracePeriod=30
Sep 08 16:08:09.440902 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.440876    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 16:08:09.554713 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.554611    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2x4w9\" (UniqueName: \"kubernetes.io/projected/56f719e7-e9eb-499c-8cdf-5a3823b84933-kube-api-access-2x4w9\") pod \"56f719e7-e9eb-499c-8cdf-5a3823b84933\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") "
Sep 08 16:08:09.554713 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.554653    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-metrics-certs\") pod \"56f719e7-e9eb-499c-8cdf-5a3823b84933\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") "
Sep 08 16:08:09.554956 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.554727    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-maas-api-tls\") pod \"56f719e7-e9eb-499c-8cdf-5a3823b84933\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") "
Sep 08 16:08:09.554956 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.554760    2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f719e7-e9eb-499c-8cdf-5a3823b84933-openshift-service-ca\") pod \"56f719e7-e9eb-499c-8cdf-5a3823b84933\" (UID: \"56f719e7-e9eb-499c-8cdf-5a3823b84933\") "
Sep 08 16:08:09.555197 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.555173    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/56f719e7-e9eb-499c-8cdf-5a3823b84933-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "56f719e7-e9eb-499c-8cdf-5a3823b84933" (UID: "56f719e7-e9eb-499c-8cdf-5a3823b84933"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Sep 08 16:08:09.556910 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.556883    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-metrics-certs" (OuterVolumeSpecName: "metrics-certs") pod "56f719e7-e9eb-499c-8cdf-5a3823b84933" (UID: "56f719e7-e9eb-499c-8cdf-5a3823b84933"). InnerVolumeSpecName "metrics-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:08:09.557034 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.556973    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56f719e7-e9eb-499c-8cdf-5a3823b84933-kube-api-access-2x4w9" (OuterVolumeSpecName: "kube-api-access-2x4w9") pod "56f719e7-e9eb-499c-8cdf-5a3823b84933" (UID: "56f719e7-e9eb-499c-8cdf-5a3823b84933"). InnerVolumeSpecName "kube-api-access-2x4w9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Sep 08 16:08:09.557034 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.556972    2579 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "56f719e7-e9eb-499c-8cdf-5a3823b84933" (UID: "56f719e7-e9eb-499c-8cdf-5a3823b84933"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Sep 08 16:08:09.655541 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.655490    2579 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-maas-api-tls\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:08:09.655541 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.655536    2579 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/56f719e7-e9eb-499c-8cdf-5a3823b84933-openshift-service-ca\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:08:09.655541 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.655547    2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2x4w9\" (UniqueName: \"kubernetes.io/projected/56f719e7-e9eb-499c-8cdf-5a3823b84933-kube-api-access-2x4w9\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:08:09.655541 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:09.655556    2579 reconciler_common.go:299] "Volume detached for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56f719e7-e9eb-499c-8cdf-5a3823b84933-metrics-certs\") on node \"ip-10-0-134-78.ec2.internal\" DevicePath \"\""
Sep 08 16:08:10.174973 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.174938    2579 generic.go:356] "Generic (PLEG): container finished" podID="56f719e7-e9eb-499c-8cdf-5a3823b84933" containerID="6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3" exitCode=0
Sep 08 16:08:10.175191 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.175019    2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"
Sep 08 16:08:10.175191 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.175030    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4" event={"ID":"56f719e7-e9eb-499c-8cdf-5a3823b84933","Type":"ContainerDied","Data":"6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3"}
Sep 08 16:08:10.175191 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.175081    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4" event={"ID":"56f719e7-e9eb-499c-8cdf-5a3823b84933","Type":"ContainerDied","Data":"b1bed7de3812644f603d8b824ab247d8108cbb3ac55d6d9a1263baf737ccf636"}
Sep 08 16:08:10.175191 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.175104    2579 scope.go:117] "RemoveContainer" containerID="6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3"
Sep 08 16:08:10.184324 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.184306    2579 scope.go:117] "RemoveContainer" containerID="6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3"
Sep 08 16:08:10.184608 ip-10-0-134-78 kubenswrapper[2579]: E0908 16:08:10.184588    2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3\": container with ID starting with 6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3 not found: ID does not exist" containerID="6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3"
Sep 08 16:08:10.184672 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.184625    2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3"} err="failed to get container status \"6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3\": rpc error: code = NotFound desc = could not find container \"6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3\": container with ID starting with 6ad9eacbeb97fd38fd9d923828d3b65514beb68091ee8519ea255579f08331a3 not found: ID does not exist"
Sep 08 16:08:10.195038 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.195011    2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"]
Sep 08 16:08:10.205792 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:10.205767    2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-6b689f8c54-chwk4"]
Sep 08 16:08:12.113793 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:12.113710    2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="56f719e7-e9eb-499c-8cdf-5a3823b84933" path="/var/lib/kubelet/pods/56f719e7-e9eb-499c-8cdf-5a3823b84933/volumes"
Sep 08 16:08:14.704798 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:14.704761    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:08:20.711474 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:20.711442    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:08:27.306370 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:27.306335    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-84994f7ffc-fhxwq"]
Sep 08 16:08:30.182862 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:30.182828    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7654c9c68c-rttcz_2212135f-fc9d-44ac-a2fb-e416ceb4a6d5/authorino/0.log"
Sep 08 16:08:35.930051 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:35.930017    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-b6r6g_c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97/manager/0.log"
Sep 08 16:08:36.062593 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:36.062556    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74dcff4f44-f7b9z_3713a460-7bba-4325-a6e7-c5ec0366d6ac/manager/0.log"
Sep 08 16:08:36.299691 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:36.299613    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nwbc7_19426fb2-40b1-4aed-8565-d77c5e28907b/manager/0.log"
Sep 08 16:08:36.681453 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:36.681428    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84d887cf8-nd9pl_bad74b12-756d-4ee7-b686-84dc940a2b88/copy-manifests/0.log"
Sep 08 16:08:36.688979 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:36.688937    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84d887cf8-nd9pl_bad74b12-756d-4ee7-b686-84dc940a2b88/manager/0.log"
Sep 08 16:08:37.168361 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:37.168324    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-d7bcf777d-vxzfk_6de8f2b1-6d63-41e5-8300-4da66ee3f6aa/maas-api/0.log"
Sep 08 16:08:38.332356 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:38.332322    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7654c9c68c-rttcz_2212135f-fc9d-44ac-a2fb-e416ceb4a6d5/authorino/0.log"
Sep 08 16:08:38.710122 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:38.710038    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vrhkk_734346ed-87c2-41c9-9788-097b79ae330a/kuadrant-console-plugin/0.log"
Sep 08 16:08:38.955784 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:38.955758    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fhxwq_e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb/limitador/0.log"
Sep 08 16:08:39.685013 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:39.684955    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6995f664-h9784_a31d0753-34ed-4036-9a1c-347b04b47b19/kube-auth-proxy/0.log"
Sep 08 16:08:40.051502 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:40.051406    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kkjwl_1519a97f-4c91-46a1-9239-439b8916f2f2/payload-pre-processing/0.log"
Sep 08 16:08:40.780372 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:40.780339    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-p5n9x_ead29dbd-6a33-49e1-9010-dc4e3221212d/main/0.log"
Sep 08 16:08:41.019660 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:41.019624    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-w7pv8_18050f2d-bd66-42b2-898b-e365be991325/main/0.log"
Sep 08 16:08:41.252074 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:41.252038    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-cpnkz_f1a4290b-200b-423e-9903-6a91787ed56c/main/0.log"
Sep 08 16:08:41.369035 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:41.369002    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-57fc66f697-qspjf_83ebcf21-fc91-42da-9764-7ff49be23c87/main/0.log"
Sep 08 16:08:47.124654 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.124615    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zhg9q/must-gather-689mm"]
Sep 08 16:08:47.125150 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.125014    2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56f719e7-e9eb-499c-8cdf-5a3823b84933" containerName="maas-api"
Sep 08 16:08:47.125150 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.125027    2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="56f719e7-e9eb-499c-8cdf-5a3823b84933" containerName="maas-api"
Sep 08 16:08:47.125150 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.125097    2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="56f719e7-e9eb-499c-8cdf-5a3823b84933" containerName="maas-api"
Sep 08 16:08:47.128855 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.128827    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zhg9q/must-gather-689mm"
Sep 08 16:08:47.131684 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.131659    2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-zhg9q\"/\"default-dockercfg-7qzb5\""
Sep 08 16:08:47.131684 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.131680    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zhg9q\"/\"kube-root-ca.crt\""
Sep 08 16:08:47.132678 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.132659    2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-zhg9q\"/\"openshift-service-ca.crt\""
Sep 08 16:08:47.140463 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.140439    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zhg9q/must-gather-689mm"]
Sep 08 16:08:47.142072 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.142040    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:47.202020 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.201984    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j78h6\" (UniqueName: \"kubernetes.io/projected/9c115193-f573-46a1-8aea-2df69648f712-kube-api-access-j78h6\") pod \"must-gather-689mm\" (UID: \"9c115193-f573-46a1-8aea-2df69648f712\") " pod="openshift-must-gather-zhg9q/must-gather-689mm"
Sep 08 16:08:47.202214 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.202034    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c115193-f573-46a1-8aea-2df69648f712-must-gather-output\") pod \"must-gather-689mm\" (UID: \"9c115193-f573-46a1-8aea-2df69648f712\") " pod="openshift-must-gather-zhg9q/must-gather-689mm"
Sep 08 16:08:47.234185 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.234150    2579 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log" limit=1024
Sep 08 16:08:47.303251 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.303217    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j78h6\" (UniqueName: \"kubernetes.io/projected/9c115193-f573-46a1-8aea-2df69648f712-kube-api-access-j78h6\") pod \"must-gather-689mm\" (UID: \"9c115193-f573-46a1-8aea-2df69648f712\") " pod="openshift-must-gather-zhg9q/must-gather-689mm"
Sep 08 16:08:47.303462 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.303292    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c115193-f573-46a1-8aea-2df69648f712-must-gather-output\") pod \"must-gather-689mm\" (UID: \"9c115193-f573-46a1-8aea-2df69648f712\") " pod="openshift-must-gather-zhg9q/must-gather-689mm"
Sep 08 16:08:47.303618 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.303599    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/9c115193-f573-46a1-8aea-2df69648f712-must-gather-output\") pod \"must-gather-689mm\" (UID: \"9c115193-f573-46a1-8aea-2df69648f712\") " pod="openshift-must-gather-zhg9q/must-gather-689mm"
Sep 08 16:08:47.312210 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.312183    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j78h6\" (UniqueName: \"kubernetes.io/projected/9c115193-f573-46a1-8aea-2df69648f712-kube-api-access-j78h6\") pod \"must-gather-689mm\" (UID: \"9c115193-f573-46a1-8aea-2df69648f712\") " pod="openshift-must-gather-zhg9q/must-gather-689mm"
Sep 08 16:08:47.438148 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.438059    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zhg9q/must-gather-689mm"
Sep 08 16:08:47.709816 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.709791    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zhg9q/must-gather-689mm"]
Sep 08 16:08:47.712110 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:08:47.712081    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c115193_f573_46a1_8aea_2df69648f712.slice/crio-0ef2afa636a8c2e225dca711c11e6e590ddcb50a4a8afaf279d74121d88053f0 WatchSource:0}: Error finding container 0ef2afa636a8c2e225dca711c11e6e590ddcb50a4a8afaf279d74121d88053f0: Status 404 returned error can't find the container with id 0ef2afa636a8c2e225dca711c11e6e590ddcb50a4a8afaf279d74121d88053f0
Sep 08 16:08:47.713944 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:47.713927    2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Sep 08 16:08:48.377160 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:48.377119    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhg9q/must-gather-689mm" event={"ID":"9c115193-f573-46a1-8aea-2df69648f712","Type":"ContainerStarted","Data":"0ef2afa636a8c2e225dca711c11e6e590ddcb50a4a8afaf279d74121d88053f0"}
Sep 08 16:08:49.388153 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:49.388112    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhg9q/must-gather-689mm" event={"ID":"9c115193-f573-46a1-8aea-2df69648f712","Type":"ContainerStarted","Data":"254c2f8dca1ba948e2a007c80368508dfbccaf566f346606acc52f003841642e"}
Sep 08 16:08:49.388576 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:49.388171    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhg9q/must-gather-689mm" event={"ID":"9c115193-f573-46a1-8aea-2df69648f712","Type":"ContainerStarted","Data":"adcee470e1274cb46682419ac6d2798c8ca1f55451c5e4670e95a0719b439ef3"}
Sep 08 16:08:49.412555 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:49.410039    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zhg9q/must-gather-689mm" podStartSLOduration=1.482178631 podStartE2EDuration="2.410016492s" totalImagesPullingTime="927.837861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-08 16:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:08:49.40902102 +0000 UTC m=+2189.769563781" watchObservedRunningTime="2026-09-08 16:08:49.410016492 +0000 UTC m=+2189.770559260"
Sep 08 16:08:50.349640 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:50.349595    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-sms54_64661b07-5e5d-4f6c-bcf3-d77316769cfd/global-pull-secret-syncer/0.log"
Sep 08 16:08:50.405674 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:50.405637    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2bl57_a9f914ab-e624-4504-9680-436b9c127d8e/konnectivity-agent/0.log"
Sep 08 16:08:50.497807 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:50.497756    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-78.ec2.internal_d44a152144865d9e36334453185dfa67/haproxy/0.log"
Sep 08 16:08:54.994342 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:54.994304    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7654c9c68c-rttcz_2212135f-fc9d-44ac-a2fb-e416ceb4a6d5/authorino/0.log"
Sep 08 16:08:55.086484 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:55.086451    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-vrhkk_734346ed-87c2-41c9-9788-097b79ae330a/kuadrant-console-plugin/0.log"
Sep 08 16:08:55.163802 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:55.163774    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-84994f7ffc-fhxwq_e2ec3574-bc6c-4c1b-bca2-3ed85b046cdb/limitador/0.log"
Sep 08 16:08:57.151777 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:57.151744    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksrvp_83eb7ece-ab61-41a2-bbd1-dae9c34efa66/node-exporter/0.log"
Sep 08 16:08:57.174864 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:57.174832    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksrvp_83eb7ece-ab61-41a2-bbd1-dae9c34efa66/kube-rbac-proxy/0.log"
Sep 08 16:08:57.202197 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:08:57.202163    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-ksrvp_83eb7ece-ab61-41a2-bbd1-dae9c34efa66/init-textfile/0.log"
Sep 08 16:09:00.551393 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:00.551359    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-ccbc7cdd8-zzsgl_7046d96c-c2f6-4a45-b9e9-d95e1980ada1/console/0.log"
Sep 08 16:09:01.228904 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.228855    2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"]
Sep 08 16:09:01.235570 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.235541    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.239644 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.239614    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"]
Sep 08 16:09:01.272009 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.271977    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-695c895bd6-bxkg5_337c1de9-5b39-40c4-99b1-18ff31d5cbb0/volume-data-source-validator/0.log"
Sep 08 16:09:01.349406 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.349365    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-proc\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.349684 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.349662    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6g8h\" (UniqueName: \"kubernetes.io/projected/42ed5e82-12a4-496e-bd82-f620d4336287-kube-api-access-d6g8h\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.349819 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.349803    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-podres\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.350006 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.349949    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-sys\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.350175 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.350160    2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-lib-modules\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.451434 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.451390    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6g8h\" (UniqueName: \"kubernetes.io/projected/42ed5e82-12a4-496e-bd82-f620d4336287-kube-api-access-d6g8h\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.451702 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.451682    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-podres\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.451843 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.451829    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-sys\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.451988 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.451972    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-lib-modules\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.452154 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.452030    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-podres\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.452263 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.452241    2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-proc\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.452347 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.452176    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-lib-modules\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.452437 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.452415    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-sys\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.452539 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.452524    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/42ed5e82-12a4-496e-bd82-f620d4336287-proc\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.468532 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.463140    2579 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6g8h\" (UniqueName: \"kubernetes.io/projected/42ed5e82-12a4-496e-bd82-f620d4336287-kube-api-access-d6g8h\") pod \"perf-node-gather-daemonset-dw6jx\" (UID: \"42ed5e82-12a4-496e-bd82-f620d4336287\") " pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.553001 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.552887    2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:01.842108 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:01.842061    2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"]
Sep 08 16:09:01.844921 ip-10-0-134-78 kubenswrapper[2579]: W0908 16:09:01.844883    2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod42ed5e82_12a4_496e_bd82_f620d4336287.slice/crio-efd8f328ba62142e0d07b50676ae38f5cdbe44cfacc252c9528b4e73843afa5f WatchSource:0}: Error finding container efd8f328ba62142e0d07b50676ae38f5cdbe44cfacc252c9528b4e73843afa5f: Status 404 returned error can't find the container with id efd8f328ba62142e0d07b50676ae38f5cdbe44cfacc252c9528b4e73843afa5f
Sep 08 16:09:02.455164 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:02.455133    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-blrnj_573ec29c-f2da-42f9-8a3d-4207f5521735/dns/0.log"
Sep 08 16:09:02.478125 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:02.478064    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-blrnj_573ec29c-f2da-42f9-8a3d-4207f5521735/kube-rbac-proxy/0.log"
Sep 08 16:09:02.512689 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:02.512655    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx" event={"ID":"42ed5e82-12a4-496e-bd82-f620d4336287","Type":"ContainerStarted","Data":"e01fbaf3e84d8d64950475a3af947dcb966921e93115afadb572b6b24e8b89a7"}
Sep 08 16:09:02.512839 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:02.512711    2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx" event={"ID":"42ed5e82-12a4-496e-bd82-f620d4336287","Type":"ContainerStarted","Data":"efd8f328ba62142e0d07b50676ae38f5cdbe44cfacc252c9528b4e73843afa5f"}
Sep 08 16:09:02.512839 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:02.512738    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:02.529107 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:02.529061    2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx" podStartSLOduration=1.529043138 podStartE2EDuration="1.529043138s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-08 16:09:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-08 16:09:02.527924507 +0000 UTC m=+2202.888467286" watchObservedRunningTime="2026-09-08 16:09:02.529043138 +0000 UTC m=+2202.889585903"
Sep 08 16:09:02.597973 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:02.597939    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-h28rz_157b136a-9d8d-4374-aa00-9e2e945e12e9/dns-node-resolver/0.log"
Sep 08 16:09:03.214408 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:03.214377    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-snrjc_e7b3c4b8-fdd1-4e92-b20b-3690484981ae/node-ca/0.log"
Sep 08 16:09:04.730066 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:04.730031    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6995f664-h9784_a31d0753-34ed-4036-9a1c-347b04b47b19/kube-auth-proxy/0.log"
Sep 08 16:09:04.843200 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:04.843160    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kkjwl_1519a97f-4c91-46a1-9239-439b8916f2f2/payload-pre-processing/0.log"
Sep 08 16:09:05.756756 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:05.756724    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-rtsvw_c49db913-6137-4007-9639-7b4ecdca2171/serve-healthcheck-canary/0.log"
Sep 08 16:09:06.267829 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:06.267791    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-hxzg9_bf2eb183-a8ef-41fb-a0fc-11dd92e7326f/insights-operator/0.log"
Sep 08 16:09:06.268390 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:06.268361    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-76bcd6ccf5-hxzg9_bf2eb183-a8ef-41fb-a0fc-11dd92e7326f/insights-operator/1.log"
Sep 08 16:09:06.351269 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:06.351241    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hlcgw_c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc/kube-rbac-proxy/0.log"
Sep 08 16:09:06.369563 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:06.369526    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hlcgw_c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc/exporter/0.log"
Sep 08 16:09:06.392436 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:06.392404    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-hlcgw_c2e74e0a-c02e-4d54-bb7a-8d8deb79f6bc/extractor/0.log"
Sep 08 16:09:08.534112 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:08.534081    2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-zhg9q/perf-node-gather-daemonset-dw6jx"
Sep 08 16:09:08.896852 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:08.896804    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-b6r6g_c9a19fd1-2d9d-4185-ae2f-2c3d4f589d97/manager/0.log"
Sep 08 16:09:08.971874 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:08.971830    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-74dcff4f44-f7b9z_3713a460-7bba-4325-a6e7-c5ec0366d6ac/manager/0.log"
Sep 08 16:09:09.128263 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:09.128175    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nwbc7_19426fb2-40b1-4aed-8565-d77c5e28907b/manager/0.log"
Sep 08 16:09:09.350757 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:09.350731    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84d887cf8-nd9pl_bad74b12-756d-4ee7-b686-84dc940a2b88/manager/0.log"
Sep 08 16:09:09.368380 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:09.368350    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-84d887cf8-nd9pl_bad74b12-756d-4ee7-b686-84dc940a2b88/copy-manifests/0.log"
Sep 08 16:09:10.760767 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:10.760715    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-j74rv_c60c4dfa-79a0-4aa7-a460-f4bfef54410c/openshift-lws-operator/0.log"
Sep 08 16:09:11.630020 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:11.629984    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6995f664-h9784_a31d0753-34ed-4036-9a1c-347b04b47b19/kube-auth-proxy/0.log"
Sep 08 16:09:11.710859 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:11.710775    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kkjwl_1519a97f-4c91-46a1-9239-439b8916f2f2/payload-pre-processing/0.log"
Sep 08 16:09:13.881802 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:13.881768    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7c6995f664-h9784_a31d0753-34ed-4036-9a1c-347b04b47b19/kube-auth-proxy/0.log"
Sep 08 16:09:13.962764 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:13.962722    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-kkjwl_1519a97f-4c91-46a1-9239-439b8916f2f2/payload-pre-processing/0.log"
Sep 08 16:09:15.853979 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:15.853927    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-kvltf_ae206cb3-bd67-4af9-b59c-c135ef04d1be/migrator/0.log"
Sep 08 16:09:15.872949 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:15.872890    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-fdbb8fdff-kvltf_ae206cb3-bd67-4af9-b59c-c135ef04d1be/graceful-termination/0.log"
Sep 08 16:09:17.617137 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.617107    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg86p_3781875d-6d59-49ac-a0c6-f98fc520af7d/kube-multus-additional-cni-plugins/0.log"
Sep 08 16:09:17.676595 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.676551    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg86p_3781875d-6d59-49ac-a0c6-f98fc520af7d/egress-router-binary-copy/0.log"
Sep 08 16:09:17.727835 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.727787    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg86p_3781875d-6d59-49ac-a0c6-f98fc520af7d/cni-plugins/0.log"
Sep 08 16:09:17.749045 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.749015    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg86p_3781875d-6d59-49ac-a0c6-f98fc520af7d/bond-cni-plugin/0.log"
Sep 08 16:09:17.768525 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.768499    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg86p_3781875d-6d59-49ac-a0c6-f98fc520af7d/routeoverride-cni/0.log"
Sep 08 16:09:17.800593 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.800564    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg86p_3781875d-6d59-49ac-a0c6-f98fc520af7d/whereabouts-cni-bincopy/0.log"
Sep 08 16:09:17.822927 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.822898    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-sg86p_3781875d-6d59-49ac-a0c6-f98fc520af7d/whereabouts-cni/0.log"
Sep 08 16:09:17.895131 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.895030    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-g79rb_8dea2c94-a3f2-4dbe-b27f-8eb8745980ae/kube-multus/0.log"
Sep 08 16:09:17.961098 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.961069    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7ctjw_1545a607-e922-4781-af5d-4e80d497ffc1/network-metrics-daemon/0.log"
Sep 08 16:09:17.975504 ip-10-0-134-78 kubenswrapper[2579]: I0908 16:09:17.975479    2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-7ctjw_1545a607-e922-4781-af5d-4e80d497ffc1/kube-rbac-proxy/0.log"